Despite the success of reinforcement learning to traffic signal control, conventional reinforcement learning-based methods have mostly tackled the traffic signal control for a single network, which requires a large computational cost, and has insufficient generalization ability to the new environment. To solve the above problems, we propose a gradient-based meta-reinforcement learning method for the centralized traffic signal control to extract meta-knowledge from multiple meta-training tasks and utilize the accumulated meta-knowledge to a new task, thus improving the training efficiency. In addition, to mitigate the curse of dimensionality problem of the centralized control, we design a special agent, which decomposes the search space by using the Divide and Conquer paradigm. To the best of our knowledge, we are the first to combine the centralized control method with the meta-reinforcement learning method. Experimental results show that our method successfully generalizes to multiple unseen traffic networks. Compared with the traditional methods and the state-of-the-art reinforcement learning-based methods, our method achieves higher traffic signal control efficiency, faster convergence speed, and more stable performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Meta-Reinforcement Learning for Centralized Multiple Intersections Traffic Signal Control


    Contributors:
    Ren, Yanyu (author) / Wu, Jia (author) / Yi, Chenglin (author) / Ran, Yunchuan (author) / Lou, Yican (author)


    Publication date :

    2022-10-08


    Size :

    486327 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Formally Constrained Reinforcement Learning for Traffic Signal Control at Intersections

    Barhoumi, Oumaima / Zaki, Mohamed H / Tahar, Sofiene | IEEE | 2025



    Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

    Duowei Li / Jianping Wu / Ming Xu et al. | DOAJ | 2020

    Free access


    Heterogeneous traffic intersections control design based on reinforcement learning

    Shen, Jiajing / Hu, Jiaxing / Zhao, Qinpei et al. | Wiley | 2024

    Free access