Variable Speed Limit (VSL) is a traffic control approach that optimises the mainstream traffic on motorways. Reinforcement Learning approach to VSL has been shown to achieve improvements in controlling the mainstream traffic bottleneck on motorways. However, single-agent VSL, applied to a shorter motorway segment, can produce a discontinuity in traffic flow by causing the significant differences in speeds between the uncontrolled upstream flow and the flow affected by VSL. A multi-agent control strategy can be used to overcome these problems by assigning speed limits in multiple upstream motorway sections enabling smoother speed transition. In this paper, we proposed a novel approach to set up multi-agent RLbased VSL by using the W-Learning algorithm (WL-VSL), in which two agents control two segments in the lead up to the congested area. The reward function for each agent is based on the agent’s local performance as well as the downstream bottleneck. WL-VSL is evaluated in a microscopic simulation on two traffic scenarios using dynamic and static traffic demand. We show that WL-VSL outperforms base cases (no control, single agent, and two independent agents) with the improvement of traffic parameters up to 18 %.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Extended Variable Speed Limit control using Multi-agent Reinforcement Learning


    Contributors:


    Publication date :

    2020-09-20


    Size :

    961465 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Dynamic Variable Speed Limit Zones Allocation Using Distributed Multi-Agent Reinforcement Learning

    Kusic, Kresimir / Ivanjko, Edouard / Vrbanic, Filip et al. | IEEE | 2021


    Field Deployment of Multi-Agent Reinforcement Learning Based Variable Speed Limit Controllers

    Zhang, Yuhang / Zhang, Zhiyao / Quinones-Grueiro, Marcos et al. | IEEE | 2024


    Variable Speed Limit Control for Highway Scenarios a Multi-agent Reinforcement Learning Based Approach

    Kővári, Bálint / Knáb, István Gellért / Bécsi, Tamás | Springer Verlag | 2025