The prevailing reinforcement-learning-based traffic signal control methods are typically staging-optimizable or duration-optimizable, depending on the action spaces. In this paper, we use hybrid proximal policy optimization to synchronously optimize the stage specification and green interval duration. Under reformulated traffic demands, the intrinsic imperfections of (implementing optimization in) discrete or continuous action spaces are revealed. By comparison, hybrid action space offers a unified search space, in which our proposed method is able to better balance the trade-off between frequent switching and unsaturated release. Experiments in both single-agent and multi-agent scenarios are given to demonstrate that the proposed method reduces queue length and delay by an average of 12.72% and 11.89%, compared to the state-of-the-art RL methods. Furthermore, by calculating the Gini coefficients of right-of-way, we reveal that the proposed method does not harm fairness while improving efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning for Traffic Signal Control in Hybrid Action Space


    Contributors:
    Luo, Haoqing (author) / Bie, Yiming (author) / Jin, Sheng (author)


    Publication date :

    2024-06-01


    Size :

    8260865 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Deep Reinforcement Learning-Based Traffic Signal Control

    Hu, Penghui / Zhang, Xinran / Hu, Jianming | ASCE | 2024


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023


    Diagnosing Reinforcement Learning for Traffic Signal Control

    Zheng, Guanjie / Zang, Xinshi / Xu, Nan et al. | ArXiv | 2019

    Free access