This research applies R-Markov Average Reward Technique based reinforcement learning (RL) algorithm, namely RMART, for vehicular signal control problem leveraging information sharing among signal controllers in connected vehicle environment. We implemented the algorithm in a network of 18 signalized intersections and compare the performance of RMART with fixed, adaptive, and variants of the RL schemes. Results show significant improvement in system performance for RMART algorithm with information sharing over both traditional fixed signal timing plans and real time adaptive control schemes. The comparison with reinforcement learning algorithms including Q learning and SARSA indicate that RMART performs better at higher congestion levels. Further, a multi-reward structure is proposed that dynamically adjusts the reward function with varying congestion states at the intersection. Finally, the results from test networks show significant reduction in emissions (CO, CO2, NOx, VOC, PM10) when RL algorithms are implemented compared to fixed signal timings and adaptive schemes.
Learning-based traffic signal control algorithms with neighborhood information sharing: An application for sustainable mobility
Journal of Intelligent Transportation Systems ; 22 , 1 ; 40-52
2018-01-02
13 pages
Article (Journal)
Electronic Resource
English
Neighborhood Traffic Control-Do You Really Want A Traffic Signal?
British Library Conference Proceedings | 1995
|Traffic light control method based on neighborhood information fusion and terminal
European Patent Office | 2023
|Optimising Traffic Signal Control with Evolutionary Algorithms
British Library Conference Proceedings | 2000
|Multi-agent reinforcement learning traffic signal control method based on neighbor knowledge sharing
European Patent Office | 2023
|