In this paper, we examine the practical problem of minimizing the delay in traffic networks that are controlled at each intersection independently, without a centralized supervisory computer and with limited communication bandwidth. We find that existing learning algorithms have lackluster performance or are too computationally complex to be implemented in the field. Instead, we introduce a simple yet efficient and effective approach using multi-agent reinforcement learning (MARL) that applies the Deep Q-Network (DQN) learning algorithm in a fully decentralized setting. First, we decouple the DQN into per-intersection Q-networks and then transmit the output of each Q-network’s hidden layer to its intersection neighbors. We show that our method is computationally efficient compared with other MARL methods, with minimal additional overhead compared with a naive isolated learning approach with no communication. This property enables our method to be implemented in real-world scenarios with less computation power. Finally, we conduct experiments for both synthetic and real-world scenarios and show that our method achieves better performance in minimizing intersection delay than other methods.


    Access

    Download


    Export, share and cite



    Title :

    eMARLIN: Distributed Coordinated Adaptive Traffic Signal Control with Topology-Embedding Propagation


    Additional title:

    Transportation Research Record: Journal of the Transportation Research Board


    Contributors:


    Publication date :

    2023-07-07




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Adaptive & Coordinated Traffic Signal System

    Dampage, Eng. S.U. / Munasingha, T.D. / Gunathilake, W.D.K et al. | IEEE | 2020


    Distributed Traffic Signal Control via Coordinated Maximum Pressure-Plus-Penalty

    Tutsch, Vinzenz / He, Zhiyu / Dorfler, Florian et al. | IEEE | 2024


    Transition scheme of traffic signal coordinated control

    Ding, Hai-long / Zhang, Tao-tao / Liu, Bo | British Library Conference Proceedings | 2022


    Adaptive Coordinated Traffic Control Under Demand Uncertainty

    LI, Lubing / LO, Hong K. / HUANG, Wei | TIBKAT | 2016