State-of-the-art theoretical models and new traffic signal control technologies are key guarantees for improving the management and safety performance of transportation systems, and multiagent reinforcement learning (MARL) methods have been widely applied in the field of signal control. Researchers in the transportation domain have effectively addressed the issues of poor convergence and suboptimal optimization encountered in RL for multi-intersection signal control scenarios by adopting the centralized training with decentralized execution (CTDE) approach. However, due to the heterogeneity among intersections, simply decomposing the global reward into a sum of intersection-level rewards is unreasonable, posing a challenge in balancing the interests of individual intersections and the entire road network. Additionally, the assumption that all intersections within the system make decisions synchronously is rather strong. Therefore, this paper proposes a distributed traffic model tailored for synchronous decision-making and, based on that, introduces an asynchronous decision-making traffic model according to decoupled intersection control. Simulation experiments show that the asynchronous decision-making method proposed in this paper not only improves the model convergence speed by at least 19% compared to the multiagent deep RL (MADRL) algorithm used for synchronous decision-making, but also improves the model by at least 10.5% in vehicle driving speed, maximum queue length, and average queue length within the decodable range (the traffic density is between 100 vehicles/km and 400 vehicles/km). In the same traffic scenario, the MADRL algorithm used for asynchronous decision-making has improved the average vehicle delay and average queue length by at least 55% compared to traditional arterial green wave control methods and adaptive control methods, and by at least 5% compared to SAC and A2C methods.


    Access

    Download


    Export, share and cite



    Title :

    Multi-Intersection Signal Control Based on Asynchronous Reinforcement Learning


    Contributors:
    Jixiang Wang (author) / Siqi Chen (author) / Jing Wei (author) / Boao Wang (author) / Haiyang Yu (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Signal-lamp-free intersection vehicle scheduling method based on asynchronous reinforcement learning algorithm

    LYU YONG / OUYANG ZHUO / HU HEXUAN et al. | European Patent Office | 2023

    Free access

    Multi-intersection signal cooperative control method based on deep reinforcement learning

    MA CHANGXI / LIU YAN / ZHAO HONGXING et al. | European Patent Office | 2025

    Free access

    Multi-intersection traffic signal control method based on deep reinforcement learning

    DENG HENG / WANG YULONG / GAO YANG et al. | European Patent Office | 2024

    Free access