The invention discloses a DQN-based expressway entrance ramp control method. The method comprises the following steps: modeling a road network model according to an actual road network, designing various traffic demands, and adjusting a vehicle following model and a vehicle lane changing model; designing ramp control signal timing as action selection, changing the ramp control signal timing to adjust the turn-in rate of the ramp traffic flow, and changing the green light duration to adjust the number of vehicles entering the main line; the actual congestion condition of the expressway is reflected by the change of the total travel time, the goal of the minimum total travel time is converted into the goal of enabling the lane occupancy rate of the main line to be close to the expected occupancy rate, a reward function is established, and hierarchical control is performed on the reward function through the number of vehicles queued on the ramp; and training the DQN by using various traffic demands, and taking the trained deep reinforcement learning model as a ramp control model. The method gives consideration to the better passing efficiency of the main line and the shorter time loss of the vehicles on the ramps, so that the queuing phenomenon on the ramps is reduced as much as possible while the passing of the main line is smoother.

    本发明公开了一种基于DQN的高速公路入口匝道控制方法,包括根据实际路网对路网模型进行建模,设计多种交通需求,调整车辆跟驰模型、车辆换道模型;设计匝道控制信号配时作为动作选择,改变匝道控制信号配时来调节匝道交通流的入匝率,改变绿灯时长来调节进入主线的车辆数;以总行程时间的变化反映高速公路实际拥堵情况,将总行程时间最小的目标转化为使主线的车道占有率接近期望占有率,建立奖励函数,通过匝道排队车辆数对奖励函数进行分级控制;使用多种交通需求对DQN进行训练,取训练后的深度强化学习模型作为匝道控制模型。本发明兼顾主线通行效率较优与匝道车辆损失时间较小,使主线通行更加通畅的同时尽可能减少匝道排队现象。


    Access

    Download


    Export, share and cite



    Title :

    DQN-based expressway entrance ramp control method


    Additional title:

    一种基于DQN的高速公路入口匝道控制方法


    Contributors:
    LI ZHENLONG (author) / WU LIN (author) / QU YANSONG (author) / DIAO MENGXIAO (author) / DONG XIAOBO (author) / CAO SHUYU (author)

    Publication date :

    2024-02-27


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Urban expressway and entrance ramp control method

    ZHUO YAJUAN / WANG JUNXIA / HAN ZHIQIANG et al. | European Patent Office | 2023

    Free access

    Vehicle-road cooperative control method for expressway entrance ramp

    WU JIAXIN / ZHENG PENGJUN / WEN YIQING et al. | European Patent Office | 2023

    Free access

    Expressway entrance ramp control method and system based on heterogeneous traffic scene

    GUO YUQI / HOU DEZAO / LI QIANYAO et al. | European Patent Office | 2020

    Free access

    Expressway long-distance downstream bottleneck road section entrance ramp control method

    ZHAO LING / CHENG CAN / CHEN AIYING et al. | European Patent Office | 2020

    Free access

    Expressway main line divided lane control and entrance ramp cooperative control method

    SONG LANG / YU SHANCHUAN / AN WENJUAN et al. | European Patent Office | 2023

    Free access