The invention discloses a reinforcement learning-based ramp signal control optimization method and system; the method comprises the steps: a ramp intersection optimization control step: detecting a real-time traffic flow on a road through single-point adaptive control, selecting a ramp signal control scheme by an upper computer according to the real-time traffic flow, and building an SARSA signal control model; a model parameter calibration step: acquiring a vehicle following and lane changing model, and calibrating parameters of the vehicle following and lane changing model; and a simulation step: training the SARSA signal control model and the vehicle following and lane changing model after parameter calibration according to a preset demand to obtain an optimized ramp signal control scheme. According to the method, the reinforcement learning-based on-ramp signal control optimization method on the expressway is designed, and on the basis of ramp control method verification and effect evaluation of traffic simulation, the SUMO simulation is used for verifying the effect, so that a new thought and a new method are provided for later theoretical research and engineering application.

    本发明公开了一种基于强化学习的匝道信号控制优化方法和系统,包括:匝道交叉口优化控制步骤,通过单点自适应控制检测道路上的实时交通流,上位机根据所述实时交通流选择匝道信号控制方案,建立SARSA信号控制模型;模型参数标定步骤,获取车辆跟驰与换道模型,对所述车辆跟驰与换道模型的参数进行标定;仿真步骤,根据预设的需求训练所述SARSA信号控制模型和标定参数后的车辆跟驰与换道模型,得到优化的匝道信号控制方案。本发明通过设计基于强化学习的快速路上匝道信号控制优化方法,并基于交通仿真的匝道控制方法验证及效果评价,使用SUMO仿真验证效果,为以后的理论研究和工程应用提供新的思路和方法。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Ramp signal control optimization method and system based on reinforcement learning


    Weitere Titelangaben:

    一种基于强化学习的匝道信号控制优化方法和系统


    Beteiligte:
    JI SHENGYI (Autor:in) / WANG XIANG (Autor:in) / WANG XI (Autor:in) / DONG CAIYIN (Autor:in) / TIAN WENJING (Autor:in) / REN ZEQI (Autor:in) / ZHANG YINGXIN (Autor:in)

    Erscheinungsdatum :

    2021-09-17


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Ramp control method based on offline reinforcement learning and macroscopic model

    HAN YU / LI LINGHUI / GAO JINDA et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Multi-ramp coordination control method based on different strategy reinforcement learning

    HAN YU / GAO JINDA / LI LINGHUI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Vehicle ramp entrance confluence control method based on deep reinforcement learning

    TONG NING / LI FENGQI / WANG KUNRUI | Europäisches Patentamt | 2023

    Freier Zugriff

    Reinforcement Learning for Ramp Control: An Analysis of Learning Parameters

    Chao Lu / Jie Huang / Jianwei Gong | DOAJ | 2016

    Freier Zugriff

    Reinforcement Learning Control for On-Ramp Metering Based on Traffic Simulation

    Wang, Xingju / Liu, Bohang / Niu, Xueqin et al. | ASCE | 2009