Traffic congestion at signalized intersections often leads to serious impacts on adjacent intersections on a corridor. To enhance intersections’ throughput efficiency, traffic signals are commonly coordinated across intersections. Traditional signal coordination methods control the adjacent intersections by setting a fixed phase offset. However, these traditional coordination methods may have poor adaptability to dynamic traffic conditions, which can cause additional congestion. To reduce arterial traffic delays, this paper develops an adaptive coordination control method based on multi-agent reinforcement learning (MARL). Most existing MARL-based methods rely on impractical assumptions to improve their performance in complex and dynamic traffic scenarios. To overcome these assumptions, this paper proposes a fully scalable MARL algorithm for arterial traffic signal coordination based on the proximal policy optimization algorithm. We apply a parameter-sharing training protocol to mitigate the slow convergence due to nonstationarity and to reduce computational requirements. In addition, a new action setting is designed by using the lead-lag phase sequence to simultaneously improve the implementation and coordination flexibility of the method. Extensive simulation experiments and comparisons with existing methods demonstrate that the proposed method performed stably in both simulated and real-world arterial corridors. Hence, the proposed signal coordination method can alleviate traffic congestion more effectively than existing traditional and MARL-based methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Distributed Signal Control of Arterial Corridors Using Multi-Agent Deep Reinforcement Learning


    Beteiligte:
    Zhang, Weibin (Autor:in) / Yan, Chen (Autor:in) / Li, Xiaofeng (Autor:in) / Fang, Liangliang (Autor:in) / Wu, Yao-Jan (Autor:in) / Li, Jun (Autor:in)


    Erscheinungsdatum :

    2023-01-01


    Format / Umfang :

    3443997 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control

    Chu, Tianshu / Wang, Jie / Codeca, Lara et al. | IEEE | 2020


    Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control

    Zhao, Yang / Hu, Jian-Ming / Gao, Ming-Yang et al. | ASCE | 2020


    Distributed Optimisation in Multi-Agent Systems Through Deep Reinforcement Learning

    Eriksson, Andreas / Hansson, Jonas | BASE | 2019

    Freier Zugriff