Reinforcement learning (RL) for traffic signal control (TSC) has shown better performance in simulation for controlling the traffic flow of intersections than conventional approaches. However, due to several challenges, no RL-based TSC has been deployed in the field yet. One major challenge for real-world deployment is to ensure that all safety requirements are met at all times during operation. We present an approach to ensure safety in a real-world intersection by using an action space that is safe by design. The action space encompasses traffic phases, which represent the combination of non-conflicting signal colors of the intersection. Additionally, an action masking mechanism makes sure that only appropriate phase transitions are carried out. Another challenge for realworld deployment is to ensure a control behavior that avoids stress for road users. We demonstrate how to achieve this by incorporating domain knowledge through extending the action masking mechanism. We test and verify our approach in a realistic simulation scenario. By ensuring safety and psychologically pleasant control behavior, our approach drives development towards real-world deployment of RL for TSC.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe and Psychologically Pleasant Traffic Signal Control with Reinforcement Learning using Action Masking


    Contributors:


    Publication date :

    2022-10-08


    Size :

    1237818 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning for Traffic Signal Control in Hybrid Action Space

    Luo, Haoqing / Bie, Yiming / Jin, Sheng | IEEE | 2024


    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Urban traffic signal control using reinforcement learning agents

    Balaji, P.G. / German, X. / Srinivasan, D. | IET | 2010


    Deep Reinforcement Learning-Based Traffic Signal Control

    Hu, Penghui / Zhang, Xinran / Hu, Jianming | ASCE | 2024


    Reinforcement Learning with Explainability for Traffic Signal Control

    Rizzo, Stefano Giovanni / Vantini, Giovanna / Chawla, Sanjay | IEEE | 2019