Centralized traffic control in a large-scale grid is quite challenging due to the large search space of the policy. To deal with this problem, we propose a hierarchical regional control framework that can learn more quickly and efficiently, based on prior knowledge. Specifically, the traffic at intersections is controlled by local controller based on well-adjusted policies. The coordination of the local controllers is decided by a master controller that is trained by using reinforcement learning. The control of the whole grid is handled solely by learning a master policy. The master controller continuously observes the state of the traffic network and predicts the best possible traffic control strategy for the current state. In this way, the dimension of the action space is dramatically decreased, and it is much easier to explore the optimal policy. We verify our method by implementing a series of experiments in SUMO. The numerical experiments demonstrate that our method outperforms the traditional methods and the new control methods based on deep reinforcement learning in various typical scenarios. We also demonstrate that our method is easy to train and operates robustly.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Hierarchical Regional Control for Traffic Grid Signal Optimization


    Contributors:
    Shu, Lingzhou (author) / Wu, Jia (author) / Li, Ziyan (author)


    Publication date :

    2019-10-01


    Size :

    625871 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Hierarchical Control Model for Regional Traffic Signal Coordination

    Zhou, Huxing / Yang, Zhaosheng / Gao, Peng | ASCE | 2011


    Regional road traffic signal control optimization method based on multiple agents

    REN ANHU / REN YANGYANG | European Patent Office | 2022

    Free access

    Regional traffic signal control optimization method based on quantum genetic algorithm

    ZHOU WEI / WU JIAYI / WANG DADONG et al. | European Patent Office | 2024

    Free access

    Regional traffic signal cooperative control system and method

    YANG YUNFEI | European Patent Office | 2022

    Free access

    CenLight: Centralized traffic grid signal optimization via action and state decomposition

    Jia Wu / Yunchuan Ran / Yican Lou et al. | DOAJ | 2023

    Free access