With the increase of private cars, traditional traffic signal control methods cannot alleviate the traffic congestion problem. Reinforcement learning (RL) is increasingly used in adaptive traffic light control. As urban traffic becomes more complex, reinforcement learning algorithms solely based on value or policy are not suitable for such scenarios. Moreover, the centralized method does not show a good effect on the multi-intersection, in particular, when the traffic flow is in the high-dimensional continuous state space. In this article, we propose a decentralized framework based on the advantage actor-critic (A2C) algorithm by assigning global control to each local RL agent or intersection. A2C algorithm involved in this article is a product of combining policy function and value function, which has good convergence ability and can be applied to continuous state space. The decentralized methods may put a new challenge: from the perspective of each local agent, the environment becomes partially observable. We overcome this problem by putting forward a region-aware cooperative strategy (RACS) based on graph attention network (GAT), which can incorporate the spatial information of the surrounding agents. We carry out experiments on synthetic traffic grid and real-world traffic network of Monaco city to compare with the existing A2C and Q-learning algorithms. Experimental results confirm that our RACS method has a shorter queue length and less waiting time than the two existing algorithms, and can reduce the total vehicle travel time.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Traffic Signal Control With Reinforcement Learning Based on Region-Aware Cooperative Strategy


    Beteiligte:
    Wang, Min (Autor:in) / Wu, Libing (Autor:in) / Li, Jianxin (Autor:in) / He, Liu (Autor:in)


    Erscheinungsdatum :

    01.07.2022


    Format / Umfang :

    2641843 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    MATLIT: MAT-Based Cooperative Reinforcement Learning for Urban Traffic Signal Control

    Liu, Bingyi / Su, Kaixiang / Wang, Enshu et al. | IEEE | 2025


    IALight: Importance-Aware Multi-Agent Reinforcement Learning for Arterial Traffic Cooperative Control

    Lu WEI / Xiaoyan ZHANG / Lijun FAN et al. | DOAJ | 2025

    Freier Zugriff

    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024