The traffic signal control is expected to flexibly control the phase sequence and duration based on dynamic traffic flow in each direction, enabling efficient traffic efficiency and reducing congestion. To this end, in this paper, we propose a hierarchical spatio-temporal collaboration reinforcement learning (HSTCRL) algorithm, which achieves fine-grained control to each phase with flexible duration. For the basic layer, long short-term memory (LSTM) and graph attention mechanism (GAT) are introduced to model the temporal and spatial dependence of traffic flow respectively, enabling intersections to choose phase cooperatively. For the high layer, double DQN is used to adjust phase duration based on information from the intersection of the entire region, avoiding insufficient or too long green light time. The experiment results have demonstrated the effectiveness of HSTCRL, which shows better traffic performance than the state-of-the-art methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Hierarchical Spatio-Temporal Cooperative Reinforcement Learning Approach for Traffic Signal Control


    Contributors:
    Li, Muyu (author) / Hu, Zhiqun (author) / Huang, Hao (author) / Lu, Zhaoming (author) / Wen, Xiangming (author)


    Publication date :

    2022-10-08


    Size :

    1169564 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English