Cities of all sizes around the world are facing increasing levels of congestion, which leads to increasing travel time and emissions, and ultimately affects the quality of life. Relevant research suggests that adaptive traffic light control systems can improve the traffic flow, but their impact on energy-efficiency of vehicle propulsion systems is not well understood. In this study, we use Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to develop an optimized adaptive traffic light control systems that controls three traffic lights simultaneously. For this purpose, we have created a microscopic traffic simulation of the city of Aachen, Germany, calibrated on the basis of traffic measurements, where the actual traffic light schedule, a green-wave, fixed-time control scheme, serves as a reference. The traffic simulation is coupled with detailed, physics-based powertrain models of both conventional and electric vehicles, which are validated against chassis dynamometer measurements. By analyzing the complex interactions between traffic light control, the resulting vehicle trajectories and the powertrain components, we show that Reinforcement Learning-based adaptive control can significantly improve the traffic flow, with a 41% increase in average velocity, without any drawbacks in CO2 emission (−1%). Furthermore, we find that maximizing traffic flow and minimizing CO2 emissions are not necessarily contradictory objectives, and identify an increased energy saving potential at low traffic densities. Thus, we prove that adaptive traffic light control can make traffic not only more time-efficient, but also more sustainable.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive Traffic Light Control With Deep Reinforcement Learning: An Evaluation of Traffic Flow and Energy Consumption


    Contributors:

    Published in:

    Publication date :

    2023-12-01


    Size :

    1753254 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Adaptive traffic light control method based on deep reinforcement learning

    KONG YAN / CHO JUN-HO | European Patent Office | 2023

    Free access

    Deep reinforcement learning traffic light control method

    KONG YAN / LI YING / CHIH-CHAO YANG | European Patent Office | 2024

    Free access

    Deep Reinforcement Learning for Autonomous Traffic Light Control

    Garg, Deepeka / Chli, Maria / Vogiatzis, George | IEEE | 2018


    Adaptive traffic signal control method combining traffic flow prediction and reinforcement learning

    PI JIATIAN / YANG XINMIN / WU CHANGZHI | European Patent Office | 2023

    Free access

    Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control

    Shabestary, Soheil Mohamad Alizadeh / Abdulhai, Baher | IEEE | 2018