Cities of all sizes around the world are facing increasing levels of congestion, which leads to increasing travel time and emissions, and ultimately affects the quality of life. Relevant research suggests that adaptive traffic light control systems can improve the traffic flow, but their impact on energy-efficiency of vehicle propulsion systems is not well understood. In this study, we use Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to develop an optimized adaptive traffic light control systems that controls three traffic lights simultaneously. For this purpose, we have created a microscopic traffic simulation of the city of Aachen, Germany, calibrated on the basis of traffic measurements, where the actual traffic light schedule, a green-wave, fixed-time control scheme, serves as a reference. The traffic simulation is coupled with detailed, physics-based powertrain models of both conventional and electric vehicles, which are validated against chassis dynamometer measurements. By analyzing the complex interactions between traffic light control, the resulting vehicle trajectories and the powertrain components, we show that Reinforcement Learning-based adaptive control can significantly improve the traffic flow, with a 41% increase in average velocity, without any drawbacks in CO2 emission (−1%). Furthermore, we find that maximizing traffic flow and minimizing CO2 emissions are not necessarily contradictory objectives, and identify an increased energy saving potential at low traffic densities. Thus, we prove that adaptive traffic light control can make traffic not only more time-efficient, but also more sustainable.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Adaptive Traffic Light Control With Deep Reinforcement Learning: An Evaluation of Traffic Flow and Energy Consumption


    Beteiligte:
    Koch, Lucas (Autor:in) / Brinkmann, Tobias (Autor:in) / Wegener, Marius (Autor:in) / Badalian, Kevin (Autor:in) / Andert, Jakob (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.12.2023


    Format / Umfang :

    1753254 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Adaptive Traffic Control Using Deep Reinforcement Learning

    N, Dhashyanth / R, Hemchand / R, Priyanga et al. | IEEE | 2024


    Deep reinforcement learning traffic light control method

    KONG YAN / LI YING / CHIH-CHAO YANG | Europäisches Patentamt | 2024

    Freier Zugriff

    Deep Reinforcement Learning for Autonomous Traffic Light Control

    Garg, Deepeka / Chli, Maria / Vogiatzis, George | IEEE | 2018


    Adaptive Traffic Signal Control System Using Deep Reinforcement Learning

    Agrawal, Satyam / Sharma, Ritvij / Srivastava, Pankaj et al. | IEEE | 2024


    Adaptive traffic signal control method combining traffic flow prediction and reinforcement learning

    PI JIATIAN / YANG XINMIN / WU CHANGZHI | Europäisches Patentamt | 2023

    Freier Zugriff