The model-free reinforcement learning algorithm relieves traffic signal control problem from complex traffic modeling, and is able to learn a reasonable traffic light control policy from virtual simulation. However, the intrinsic characteristic of traffic flow might be helpful for learning a more suitable traffic signal control policy. Hence, in this paper, we investigate the performance of training reinforcement learning agent under different traffic conditions and propose a framework to combine prior traffic knowledge with deep reinforcement learning idea. The proposed network structure contains a simple Softmax classification branch and Q-value network branch, namely Mixed Q-network (MQN), is trained by using Q-learning with memory palace that maintains different replay buffers for different classifications. The comparative deep Q-network (DQN) is trained by using Q-learning with experience replay. Based on the experiments, both DQN and MQN method are able to learn a reasonable traffic signal timing and achieve lower average delay, shorter queue length and less waiting time than fixed time control. Moreover, the MQN could classify the traffic environment and select corresponding reinforcement learning controller at the same time.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Training Reinforcement Learning Agent for Traffic Signal Control under Different Traffic Conditions


    Beteiligte:
    Zeng, Jinghong (Autor:in) / Hu, Jianming (Autor:in) / Zhang, Yi (Autor:in)


    Erscheinungsdatum :

    2019-10-01


    Format / Umfang :

    711262 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Agent-Based Traffic Signal Control Using a Reinforcement Learning Approach

    Agafonov, Anton / Yumaganov, Alexander | IEEE | 2021


    Reinforcement learning-based multi-agent system for network traffic signal control

    Arel, I. / Liu, C. / Urbanik, T. et al. | Tema Archiv | 2010


    Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control

    Zhao, Yang / Hu, Jian-Ming / Gao, Ming-Yang et al. | ASCE | 2020


    Traffic light signal control method based on multi-agent reinforcement learning

    ZHAO SHENGJIE / DENG HAO / CHEN ZHI | Europäisches Patentamt | 2022

    Freier Zugriff

    Adaptive traffic signal control method based on multi-agent reinforcement learning

    ZHANG CHENGWEI / JIN SHAN / ZHENG KANGJIE | Europäisches Patentamt | 2021

    Freier Zugriff