Intelligent traffic signal controllers, applying DQN algorithms to traffic light policy optimization, efficiently reduce traffic congestion by adjusting traffic signals to real-time traffic. Most propositions in the literature however consider that all vehicles at the intersection are detected, an unrealistic scenario. Recently, new wireless communication technologies have enabled cost-efficient detection of connected vehicles by infrastructures. With only a small fraction of the total fleet currently equipped, methods able to perform under low detection rates are desirable. In this paper, we propose a deep reinforcement Q-learning model to optimize traffic signal control at an isolated intersection, in a partially observable environment with connected vehicles. First, we present the novel DQN model within the RL framework. We introduce a new state representation for partially observable environments and a new reward function for traffic signal control, and provide a network architecture and tuned hyper-parameters. Second, we evaluate the performances of the model in numerical simulations on multiple scenarios, in two steps. At first in full detection against existing actuated controllers, then in partial detection with loss estimates for proportions of connected vehicles. Finally, from the obtained results, we define thresholds for detection rates with acceptable and optimal performance levels. The source code implementation of the model is available at: https://github.com/romainducrocq/DQN-ITSCwPD


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection


    Weitere Titelangaben:

    Int. J. ITS Res.


    Beteiligte:
    Ducrocq, Romain (Autor:in) / Farhi, Nadir (Autor:in)


    Erscheinungsdatum :

    2023-04-01


    Format / Umfang :

    15 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Using Reinforcement Learning With Partial Vehicle Detection for Intelligent Traffic Signal Control

    Zhang, Rusheng / Ishikawa, Akihiro / Wang, Wenli et al. | IEEE | 2021


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023


    A Deep Reinforcement Learning Approach to Traffic Signal Control

    Razack, Aquib Junaid / Ajith, Vysyakh / Gupta, Rajiv | IEEE | 2021


    Traffic signal control method based on deep reinforcement learning

    LIU DUANYANG / SHEN SI / SHEN GUOJIANG et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Applications on Deep Reinforcement Learning in Traffic Signal Control

    Sun, Haolun / Sun, Yilong / Yu, Boyang | IEEE | 2022