Variable Speed Limit (VSL) control acts as a promising highway traffic management strategy with worldwide deployment, which can enhance traffic safety by dynamically adjusting speed limits according to real-time traffic conditions. Most of the deployed VSL control algorithms so far are rule-based, lacking generalizability under varying and complex traffic scenarios. In this work, we propose MARVEL (Multi-Agent Reinforcement-learning for large-scale Variable spEed Limits), a novel framework for large-scale VSL control on highway corridors with real-world deployment settings. MARVEL utilizes only sensing information observable in the real world as state input and learns through a reward structure that incorporates adaptability to traffic conditions, safety, and mobility, thereby enabling multi-agent coordination. With parameter sharing among all VSL agents, the proposed framework scales to cover corridors with many agents. The policies are trained in a microscopic traffic simulation environment, focusing on a short freeway stretch with 8 VSL agents spanning 7 miles. For testing, these policies are applied to a more extensive network with 34 VSL agents spanning 17 miles of I-24 near Nashville, TN, USA. MARVEL-based method improves traffic safety by 63.4% compared to the no control scenario and enhances traffic mobility by 58.6% compared to a state-of-the-practice algorithm that has been deployed on I-24. Besides, we conduct an explainability analysis to examine the decision-making process of the agents and explore the learned policy under different traffic conditions. Finally, we test the response of the policy learned from the simulation-based experiments with real-world data collected from I-24 and illustrate its deployment capability.


    Access

    Download


    Export, share and cite



    Title :

    MARVEL: Multi-Agent Reinforcement-Learning for Large-Scale Variable Speed Limits


    Contributors:

    Publication date :

    2023


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Extended Variable Speed Limit control using Multi-agent Reinforcement Learning

    Kusic, Kresimir / Dusparic, Ivana / Gueriau, Maxime et al. | IEEE | 2020


    Field Deployment of Multi-Agent Reinforcement Learning Based Variable Speed Limit Controllers

    Zhang, Yuhang / Zhang, Zhiyao / Quinones-Grueiro, Marcos et al. | IEEE | 2024


    Dynamic Variable Speed Limit Zones Allocation Using Distributed Multi-Agent Reinforcement Learning

    Kusic, Kresimir / Ivanjko, Edouard / Vrbanic, Filip et al. | IEEE | 2021


    Mini marvel

    Scoltock,J. / Mini,GB | Automotive engineering | 2011


    Deep Reinforcement Learning Freeway Controller Chooses Ramp Metering Over Variable Speed Limits

    ElSamadisy, Omar / Smirnov, Ilia / Wang, Xiaoyu et al. | Transportation Research Record | 2025