The objective of this paper is to optimize the overall traffic flow on freeways using multiple ramp metering controls plus its complementary Dynamic Speed Limits (DSLs). An optimal freeway operation can be reached when minimizing the difference between the freeway density and the critical ratio for maximum traffic flow. In this paper, a Multi-Agent Reinforcement Learning for Freeways Control (MARL-FWC) system for ramps metering and DSLs is proposed. MARL-FWC introduces a new microscopic framework at the network level based on collaborative Markov Decision Process modeling (Markov game) and an associated cooperative Q-learning algorithm. The technique incorporates payoff propagation (Max-Plus algorithm) under the coordination graphs framework, particularly suited for optimal control purposes. MARL-FWC provides three control designs: fully independent, fully distributed, and centralized; suited for different network architectures. MARL-FWC was extensively tested in order to assess the proposed model of the joint payoff, as well as the global payoff. Experiments are conducted with heavy traffic flow under the renowned VISSIM traffic simulator to evaluate MARL-FWC. The experimental results show a significant decrease in the total travel time and an increase in the average speed (when compared with the base case) while maintaining an optimal traffic flow.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures


    Weitere Titelangaben:

    Lecture Notes on Data Engineering and Communications Technologies


    Beteiligte:
    Hassanien, Aboul Ella (Herausgeber:in) / Rizk, Rawya Y. (Herausgeber:in) / Snášel, Václav (Herausgeber:in) / Abdel-Kader, Rehab F. (Herausgeber:in) / Fares, Ahmed (Autor:in) / A. Khamis, Mohamed (Autor:in) / Gomaa, Walid (Autor:in)

    Kongress:

    International Conference on Advanced Machine Learning Technologies and Applications ; 2022 ; cario, Egypt May 05, 2022 - May 07, 2022



    Erscheinungsdatum :

    17.04.2022


    Format / Umfang :

    14 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures

    Fares, Ahmed / Gomaa, Walid / Khamis, Mohamed A. | ArXiv | 2018

    Freier Zugriff

    Microsimulations of freeway traffic including control measures

    Treiber, M. / Helbing, D. | Tema Archiv | 2001



    Evaluation of Supplementary Traffic Control Measures for Freeway Work-Zone Approaches

    Sanford Bernhardt, Kristen L. / Virkler, Mark R. / Shaik, Nawaz M. | Transportation Research Record | 2001


    Freeway traffic surveillance and control

    Isaksen, L. / Payne, H.J. | Tema Archiv | 1973