This article presents the first field deployment of a multi-agent reinforcement-learning (MARL) based variable speed limit (VSL) control system on the I–24 freeway near Nashville, Tennessee. We describe how we train MARL agents in a traffic simulator and directly deploy the simulation-based policy on a 17 -mile stretch of Interstate 24 with 67 VSL controllers. We use invalid action masking and several safety guards to ensure the posted speed limits satisfy the real-world constraints from the traffic management center and the Tennessee Department of Transportation. Since the time of launch of the system through April, 2024, the system has made approximately 10,000,000 decisions on 8,000,000 trips. The analysis of the controller shows that the MARL policy takes control for up to 98 % of the time without intervention from safety guards. The time-space diagrams of traffic speed and control commands illustrate how the algorithm behaves during rush hour. Finally, we quantify the domain mismatch between the simulation and real-world data and demonstrate the robustness of the MARL policy to this mismatch.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Field Deployment of Multi-Agent Reinforcement Learning Based Variable Speed Limit Controllers


    Contributors:


    Publication date :

    2024-09-24


    Size :

    8085218 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Extended Variable Speed Limit control using Multi-agent Reinforcement Learning

    Kusic, Kresimir / Dusparic, Ivana / Gueriau, Maxime et al. | IEEE | 2020


    Dynamic Variable Speed Limit Zones Allocation Using Distributed Multi-Agent Reinforcement Learning

    Kusic, Kresimir / Ivanjko, Edouard / Vrbanic, Filip et al. | IEEE | 2021


    Variable Speed Limit Control for Highway Scenarios a Multi-agent Reinforcement Learning Based Approach

    Kővári, Bálint / Knáb, István Gellért / Bécsi, Tamás | Springer Verlag | 2025