The invention discloses a traffic signal control method based on reinforcement learning, and the method comprises the steps: observing a current road condition through a road network, generating a training sample, carrying out the training of a deep reinforcement learning (DQN) network which comprises a state space S, an action space A and an excitation function r, and finally generating a signal lamp prediction value through the trained DQN network, and carrying out the control of an actual traffic signal. According to the method, signal control is carried out by adopting a reinforcement learning method, so that the characteristic of real-time change of road conditions is fully considered, the throughput rate of a road network is improved, a traffic flow model is introduced, risk factors are strictly selected, and the problems caused by inherent defects of reinforcement learning are effectively avoided.

    一种基于强化学习的交通信号控制方法,通过路网观测当前道路状况生成训练样本,对包含状态空间S、动作空间A和激励函数r的深度强化学习(DQN)网络进行训练,最终采用训练后的DQN网络生成信号灯预测值对实际交通信号进行控制。本发明采用强化学习的方法进行信号控制从而充分考虑路况的实时变化的特点,从而提升路网的吞吐率的同时,引入交通流模型,同时严格选取冒险因子,从而有效避免因为强化学习固有缺陷而带来的问题。


    Access

    Download


    Export, share and cite



    Title :

    Traffic signal control method based on reinforcement learning


    Additional title:

    基于强化学习的交通信号控制方法


    Contributors:
    LONG SHUI (author) / YU JIADI (author)

    Publication date :

    2023-02-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023


    Traffic signal control method based on deep reinforcement learning

    LIU DUANYANG / SHEN SI / SHEN GUOJIANG et al. | European Patent Office | 2021

    Free access

    Crossroad traffic signal lamp control method based on reinforcement learning

    WU LIBING / WANG MIN / ZHANG RUI et al. | European Patent Office | 2020

    Free access

    A Method of Reinforcement Learning Based Automatic Traffic Signal Control

    Wang, Yaping / Zhang, Zheng | Tema Archive | 2011


    Reinforcement Learning with Explainability for Traffic Signal Control

    Rizzo, Stefano Giovanni / Vantini, Giovanna / Chawla, Sanjay | IEEE | 2019