We present a novel ramp metering algorithm that incorporates multi-agent deep reinforcement learning (DRL) techniques, which utilizes monitoring data from loop detectors. Our proposed approach employed a multi-agent DRL framework to generate optimized ramp metering schedules for each ramp meter in real-time, enhancing the operational efficiency of urban freeways with less investment. To simplify the implementation and training of the algorithm, we developed a simulation platform based on SUMO microscopic traffic simulator. We conducted a series of simulation experiments, including local and coordinated ramp metering scenarios with various traffic demands profiles. The simulation results indicate that the proposed DRL-based algorithm outperforms the state-of-the-practice ramp metering methods, considering a comprehensive evaluation index encompassing mainstream speed at the bottleneck and queue length on ramp. Additionally, the method exhibits robustness, scalability, and the potential for further improvement through online learning during implementation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A dynamic self-improving ramp metering algorithm based on multi-agent deep reinforcement learning


    Additional title:

    F. DENG ET AL.
    TRANSPORTATION LETTERS


    Contributors:
    Deng, Fuwen (author) / Jin, Jiandong (author) / Shen, Yu (author) / Du, Yuchuan (author)

    Published in:

    Transportation Letters ; 16 , 7 ; 649-657


    Publication date :

    2024-08-08


    Size :

    9 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning

    Belletti, Francois / Haziza, Daniel / Gomes, Gabriel et al. | IEEE | 2018


    Self-Learning Adaptive Ramp Metering

    Rezaee, Kasra / Abdulhai, Baher / Abdelgawad, Hossam | Transportation Research Record | 2013


    Reinforcement Learning–Based Ramp Metering Strategy Considering Queue Management

    Yang Yang / Shixuan Yu / Fan Ding et al. | DOAJ | 2025

    Free access

    Learning-Based Control Algorithm for Ramp Metering

    Gregurić, Martin / Ivanjko, Edouard / Mandžuka, Sadko | Springer Verlag | 2016