Controlling traffic signals to alleviate increasing traffic pressure is a concept that has received public attention for a long time. However, existing systems and methodologies for controlling traffic signals are insufficient for addressing the problem. To this end, we build a truly adaptive traffic signal control model in a traffic microsimulator, i.e., “Simulation of Urban Mobility” (SUMO), using the technology of modern deep reinforcement learning. The model is proposed based on a deep Q-network algorithm that precisely represents the elements associated with the problem: agents, environments, and actions. The real-time state of traffic, including the number of vehicles and the average speed, at one or more intersections is used as an input to the model. To reduce the average waiting time, the agents provide an optimal traffic signal phase and duration that should be implemented in both single-intersection cases and multi-intersection cases. The co-operation between agents enables the model to achieve an improvement in overall performance in a large road network. By testing with data sets pertaining to three different traffic conditions, we prove that the proposed model is better than other methods (e.g., Q-learning method, longest queue first method, and Webster fixed timing control method) for all cases. The proposed model reduces both the average waiting time and travel time, and it becomes more advantageous as the traffic environment becomes more complex.


    Access

    Download


    Export, share and cite



    Title :

    Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning


    Contributors:
    Duowei Li (author) / Jianping Wu (author) / Ming Xu (author) / Ziheng Wang (author) / Kezhen Hu (author)


    Publication date :

    2020




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown






    Formally Constrained Reinforcement Learning for Traffic Signal Control at Intersections

    Barhoumi, Oumaima / Zaki, Mohamed H / Tahar, Sofiene | IEEE | 2025


    Adaptive Traffic Signal Control System Using Deep Reinforcement Learning

    Agrawal, Satyam / Sharma, Ritvij / Srivastava, Pankaj et al. | IEEE | 2024


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023