In this paper, we examine the practical problem of minimizing the delay in traffic networks that are controlled at each intersection independently, without a centralized supervisory computer and with limited communication bandwidth. We find that existing learning algorithms have lackluster performance or are too computationally complex to be implemented in the field. Instead, we introduce a simple yet efficient and effective approach using multi-agent reinforcement learning (MARL) that applies the Deep Q-Network (DQN) learning algorithm in a fully decentralized setting. First, we decouple the DQN into per-intersection Q-networks and then transmit the output of each Q-network’s hidden layer to its intersection neighbors. We show that our method is computationally efficient compared with other MARL methods, with minimal additional overhead compared with a naive isolated learning approach with no communication. This property enables our method to be implemented in real-world scenarios with less computation power. Finally, we conduct experiments for both synthetic and real-world scenarios and show that our method achieves better performance in minimizing intersection delay than other methods.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    eMARLIN: Distributed Coordinated Adaptive Traffic Signal Control with Topology-Embedding Propagation


    Weitere Titelangaben:

    Transportation Research Record: Journal of the Transportation Research Board


    Beteiligte:
    Wang, Xiaoyu (Autor:in) / Taitler, Ayal (Autor:in) / Smirnov, Ilia (Autor:in) / Sanner, Scott (Autor:in) / Abdulhai, Baher (Autor:in)


    Erscheinungsdatum :

    2023-07-07




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Adaptive & Coordinated Traffic Signal System

    Dampage, Eng. S.U. / Munasingha, T.D. / Gunathilake, W.D.K et al. | IEEE | 2020


    Transition scheme of traffic signal coordinated control

    Ding, Hai-long / Zhang, Tao-tao / Liu, Bo | British Library Conference Proceedings | 2022


    Adaptive Coordinated Traffic Control Under Demand Uncertainty

    LI, Lubing / LO, Hong K. / HUANG, Wei | TIBKAT | 2016


    CoSIGN: A Parallel Algorithm for Coordinated Traffic Signal Control

    Shih-Fen Cheng, / Epelman, M.A. / Smith, R.L. | IEEE | 2006


    Research on the Model of Traffic Signal Control and Signal Coordinated Control

    Zeng, Xiaoqing / Wu, Chaoyang / Chen, Yujia et al. | Springer Verlag | 2017