Urban intersection is the key element to determine the traffic operation of road network. Under the CAVs environment, the roadside control equipment of intersection can communicate with CAVs in real time, collect vehicle state data and optimize traffic control schemes. This paper presents a method for intersection traffic signal control based on deep learning of CAVs data. In addition, intelligent control agent of traffic signal (ICATS) is designed to simulate CAVs. ICATS can perceive real-time changes of traffic flow, model different conditions of intersection and generate the corresponding traffic signal scheme. ICATS used double Q-learning method combination with deep neural network, which is an effective model-independent deep learning algorithm. Moreover, the real traffic data is collected and tested in this paper for evaluating the experiment performance, including vehicle delay, number of passing vehicles, total stop times and passing time. ICATS is compared with another three popular traffic signal control algorithms, like static, actuated and delay_based control algorithm. By means of experimental analysis of real high-flow and low-flow data, the results indicate that signal timing efficiency can be significantly improved by using ICATS method. The experimental results demonstrate that the vehicle delay is shorter, and number of passing vehicles is larger compared with other methods. In this model, the optimal behavior strategy is found depending on trial and error, and the associated state-behavior value is updated by feedback. Finally, by means of this research, ICATS method can more accurately capture the dynamic correlation characteristics of traffic flow and signal timing, and obviously improve the operation efficiency of the intersection.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Double Q-Learning Method for CAVs Traffic Signal Control


    Additional title:

    Sae Technical Papers


    Contributors:
    Zhao, Chunxia (author) / Lin, Peiqun (author) / Liu, QingChao (author) / Su, Ziyi (author)

    Conference:

    3rd International Forum on Connected Automated Vehicle Highway System through the China Highway & Transportation Society ; 2020



    Publication date :

    2020-12-30




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Deep Double Q-Learning Method for CAVs Traffic Signal Control

    Su, Ziyi / Liu, QingChao / Zhao, Chunxia et al. | British Library Conference Proceedings | 2020


    Integrated Routing and Traffic Signal Control for CAVs via Reinforcement Learning Approach

    Park, Jiho / Zhang, Guohui / Wang, Chieh et al. | IEEE | 2024


    CAVS 2019 Reviewers

    IEEE | 2019

    Free access

    Simulated CAVs Driving and Characteristics of the Mixed Traffic Using Reinforcement Learning Method

    Guo, Jingqiu / Liu, Yangzexi / Fang, Shouen | Springer Verlag | 2019


    CAVS 2019 Panel

    IEEE | 2019

    Free access