We present a novel ramp metering algorithm that incorporates multi-agent deep reinforcement learning (DRL) techniques, which utilizes monitoring data from loop detectors. Our proposed approach employed a multi-agent DRL framework to generate optimized ramp metering schedules for each ramp meter in real-time, enhancing the operational efficiency of urban freeways with less investment. To simplify the implementation and training of the algorithm, we developed a simulation platform based on SUMO microscopic traffic simulator. We conducted a series of simulation experiments, including local and coordinated ramp metering scenarios with various traffic demands profiles. The simulation results indicate that the proposed DRL-based algorithm outperforms the state-of-the-practice ramp metering methods, considering a comprehensive evaluation index encompassing mainstream speed at the bottleneck and queue length on ramp. Additionally, the method exhibits robustness, scalability, and the potential for further improvement through online learning during implementation.
A dynamic self-improving ramp metering algorithm based on multi-agent deep reinforcement learning
F. DENG ET AL.
TRANSPORTATION LETTERS
Transportation Letters ; 16 , 7 ; 649-657
08.08.2024
9 pages
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Self-Learning Adaptive Ramp Metering
Transportation Research Record | 2013
|Reinforcement Learning–Based Ramp Metering Strategy Considering Queue Management
DOAJ | 2025
|Learning-Based Control Algorithm for Ramp Metering
Springer Verlag | 2016
|