We present a novel ramp metering algorithm that incorporates multi-agent deep reinforcement learning (DRL) techniques, which utilizes monitoring data from loop detectors. Our proposed approach employed a multi-agent DRL framework to generate optimized ramp metering schedules for each ramp meter in real-time, enhancing the operational efficiency of urban freeways with less investment. To simplify the implementation and training of the algorithm, we developed a simulation platform based on SUMO microscopic traffic simulator. We conducted a series of simulation experiments, including local and coordinated ramp metering scenarios with various traffic demands profiles. The simulation results indicate that the proposed DRL-based algorithm outperforms the state-of-the-practice ramp metering methods, considering a comprehensive evaluation index encompassing mainstream speed at the bottleneck and queue length on ramp. Additionally, the method exhibits robustness, scalability, and the potential for further improvement through online learning during implementation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A dynamic self-improving ramp metering algorithm based on multi-agent deep reinforcement learning


    Weitere Titelangaben:

    F. DENG ET AL.
    TRANSPORTATION LETTERS


    Beteiligte:
    Deng, Fuwen (Autor:in) / Jin, Jiandong (Autor:in) / Shen, Yu (Autor:in) / Du, Yuchuan (Autor:in)

    Erschienen in:

    Transportation Letters ; 16 , 7 ; 649-657


    Erscheinungsdatum :

    08.08.2024


    Format / Umfang :

    9 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning

    Belletti, Francois / Haziza, Daniel / Gomes, Gabriel et al. | IEEE | 2018


    Self-Learning Adaptive Ramp Metering

    Rezaee, Kasra / Abdulhai, Baher / Abdelgawad, Hossam | Transportation Research Record | 2013


    Reinforcement Learning–Based Ramp Metering Strategy Considering Queue Management

    Yang Yang / Shixuan Yu / Fan Ding et al. | DOAJ | 2025

    Freier Zugriff

    Learning-Based Control Algorithm for Ramp Metering

    Gregurić, Martin / Ivanjko, Edouard / Mandžuka, Sadko | Springer Verlag | 2016