With rapid development of the urbanization, how to improve the traffic lights efficiency has become an urgent issue. The traditional traffic light control is a method that calculates a series of corresponding timing parameters by optimizing the cycle length. However, fixing sequence and duration of traffic lights is inefficient for dynamic traffic flow regulation. In order to solve the above problem, this study proposes a traffic light timing optimization scheme based on deep reinforcement learning (DRL). In this scheme, the traffic lights can output an appropriate phase according to the traffic flow state of each direction at the intersection and dynamically adjust the phase length. Specifically, we first adopt Proximal Policy Optimization (PPO) to improve the convergence speed of the model. Then, we elaborate the design of state, action, and reward, with the vehicle state defined by Discrete Traffic State Encoding (DTSE) method. Finally, we conduct experiments on real traffic data via the traffic simulation platform SUMO. The results show that, compared to the traditional timing control, the proposed scheme can effectively reduce the waiting time of vehicles and queue length in various traffic flow modes.


    Access

    Download


    Export, share and cite



    Title :

    Adaptive Optimization of Traffic Signal Timing via Deep Reinforcement Learning


    Contributors:
    Zibo Ma (author) / Tongchao Cui (author) / Wenxing Deng (author) / Fengyao Jiang (author) / Liguo Zhang (author)


    Publication date :

    2021




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Traffic signal lamp adaptive timing control method and system based on deep reinforcement learning

    TAO FAZHAN / ZHANG JIE / FU ZHUMU et al. | European Patent Office | 2025

    Free access

    Traffic Signal Timing via Parallel Reinforcement Learning

    Zhao, Qian / Xu, Cheng / jin, Sheng | Springer Verlag | 2019


    Adaptive Traffic Signal Control System Using Deep Reinforcement Learning

    Agrawal, Satyam / Sharma, Ritvij / Srivastava, Pankaj et al. | IEEE | 2024



    Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control

    Shabestary, Soheil Mohamad Alizadeh / Abdulhai, Baher | IEEE | 2018