The invention discloses an on-ramp vehicle afflux strategy generation method and device, equipment and a medium, and relates to the field of intelligent traffic, and the method comprises the steps: obtaining preset traffic data, determining a state space set and an action space set based on the preset traffic data, and constructing a deep reinforcement learning model; the deep reinforcement learning model comprises a strategy network and a value network; for a current state in the state space set, generating a probability corresponding to each executable action in the action space set by using the current strategy network, and determining a current state action pair based on the executable action with the highest probability; and determining a current expected return of the current state action pair according to the current value network, training the current strategy network and the current value network based on the current expected return until the strategy network parameters and the value network parameters meet preset stable conditions, and determining a corresponding on-ramp vehicle afflux strategy based on the latest current strategy network. And performing corresponding vehicle confluence control by using the on-ramp vehicle confluence strategy.

    本申请公开了一种入匝道车辆汇入策略生成方法、装置、设备及介质,涉及智能交通领域,包括:获取预设交通数据,基于预设交通数据确定状态空间集合和动作空间集合并构建深度强化学习模型;深度强化学习模型包括策略网络和价值网络;针对状态空间集合中的当前状态,利用当前策略网络生成与动作空间集合中各可执行动作对应的概率,基于概率最高的可执行动作确定当前状态动作对;根据当前价值网络确定当前状态动作对的当前预期回报并基于当前预期回报对当前策略网络和当前价值网络进行训练,直至策略网络参数和价值网络参数满足预设稳定条件,基于最新的当前策略网络确定相应的入匝道车辆汇入策略,以利用入匝道车辆汇入策略进行相应的车辆汇入控制。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    On-ramp vehicle afflux strategy generation method, device, equipment and medium


    Weitere Titelangaben:

    一种入匝道车辆汇入策略生成方法、装置、设备及介质


    Beteiligte:
    WEI KAI (Autor:in) / DING BING (Autor:in) / ZHANG JUN (Autor:in) / ZHANG HONGYUAN (Autor:in) / LIU QINGWEN (Autor:in) / YANG SHIHAO (Autor:in)

    Erscheinungsdatum :

    28.02.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Vehicle ramp afflux method, device and equipment and storage medium

    SONG PING / WANG SHANCHAO / LI CHAO et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Vehicle ramp afflux-in and afflux-out cooperative control method

    SHAN PING | Europäisches Patentamt | 2022

    Freier Zugriff

    Ramp vehicle afflux guiding method, electronic equipment and storage medium

    SONG JUNZI / YANG MING / WU YUHAN et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Ramp afflux-in and afflux-out early warning system

    YANG LEI / HONG TAO / WANG HENGDA et al. | Europäisches Patentamt | 2021

    Freier Zugriff