Centralized traffic control in a large-scale grid is quite challenging due to the large search space of the policy. To deal with this problem, we propose a hierarchical regional control framework that can learn more quickly and efficiently, based on prior knowledge. Specifically, the traffic at intersections is controlled by local controller based on well-adjusted policies. The coordination of the local controllers is decided by a master controller that is trained by using reinforcement learning. The control of the whole grid is handled solely by learning a master policy. The master controller continuously observes the state of the traffic network and predicts the best possible traffic control strategy for the current state. In this way, the dimension of the action space is dramatically decreased, and it is much easier to explore the optimal policy. We verify our method by implementing a series of experiments in SUMO. The numerical experiments demonstrate that our method outperforms the traditional methods and the new control methods based on deep reinforcement learning in various typical scenarios. We also demonstrate that our method is easy to train and operates robustly.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Hierarchical Regional Control for Traffic Grid Signal Optimization


    Beteiligte:
    Shu, Lingzhou (Autor:in) / Wu, Jia (Autor:in) / Li, Ziyan (Autor:in)


    Erscheinungsdatum :

    2019-10-01


    Format / Umfang :

    625871 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    A Hierarchical Control Model for Regional Traffic Signal Coordination

    Zhou, Huxing / Yang, Zhaosheng / Gao, Peng | ASCE | 2011


    Regional road traffic signal control optimization method based on multiple agents

    REN ANHU / REN YANGYANG | Europäisches Patentamt | 2022

    Freier Zugriff

    Regional traffic signal control optimization method based on quantum genetic algorithm

    ZHOU WEI / WU JIAYI / WANG DADONG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Regional traffic signal cooperative control system and method

    YANG YUNFEI | Europäisches Patentamt | 2022

    Freier Zugriff

    CenLight: Centralized traffic grid signal optimization via action and state decomposition

    Jia Wu / Yunchuan Ran / Yican Lou et al. | DOAJ | 2023

    Freier Zugriff