In this study, the authors develop a state transition probability model for an isolated intersection on the basis of link‐based state transition probability matrix. The state of an intersection is defined as the combination of its input links’ states which represent their respective congestion level by occupancy rate. This way of modelling is further extended to a compact region by likening the region to a virtual node with several virtual input links to avoid dimension expansion. Based on the state transition probability model, the stochastic signal control problem for both intersections and compact regions is formulated as a Markov decision process with the specified definition of state, action, probability and reward. A sensitivity‐based policy iteration algorithm is employed to solve the Markov decision process in real‐time, which has a great advantage in computational efficiency. The results of the numerical study on a calibrated network of Caohejing District in Shanghai indicate that the authors’ proposed method outperforms the fixed‐time and actuated signal control at high loads in terms of many indices and greatly decreases the variability in the traffic performance. In addition, the compact region control can improve the optimisation efficiency while providing similar performance to the intersection control at different loads.
Stochastic traffic modelling and decentralised signal control based on a state transition probability model
IET Intelligent Transport Systems ; 12 , 8 ; 909-920
2018-10-01
12 pages
Article (Journal)
Electronic Resource
English
traffic control , state transition probability model , sensitivity‐based policy iteration algorithm , decentralised control , sensitivity analysis , optimisation efficiency , stochastic signal control problem , decentralised signal control , matrix algebra , compact region control , stochastic systems , iterative methods , virtual input links , stochastic traffic modelling , Markov processes , congestion level , decision theory , isolated intersection , link‐based state transition probability matrix , numerical study , probability , occupancy rate , traffic performance , Markov decision process , dimension expansion , virtual node
Modelling Decentralised Decision Making
British Library Conference Proceedings | 1996
|Stochastic adaptive control model for traffic signal systems
Online Contents | 2006
|