The invention is suitable for the technical field of automatic driving control of road vehicles, and provides a signal lamp intersection passing method based on near-end strategy optimization, which comprises the following steps: building a deep reinforcement learning network model based on a PPO algorithm, and taking collected real-time road information as a state space of an economical signal lamp intersection passing model; step 2, proposing an economical signal lamp intersection passage reward function based on limiting factors; and step 3, performing real-time interaction with the environment according to an action variable generated by the economical signal lamp intersection passage model, evaluating actions adopted by a controlled vehicle in the current state according to a reward function, optimizing strategy parameters in deep reinforcement learning according to the actions, and finally obtaining an economical signal lamp intersection passage strategy. According to the method, the condition of idling driving at the intersection due to the red light can be avoided, the traffic efficiency of the road is improved, and the economical driving behavior in the whole driving process can further reduce the energy consumption of the vehicle.

    本发明适用于道路车辆自动驾驶控制技术领域,提供了一种基于近端策略优化的信号灯路口通行方法,包括以下步骤:搭建基于PPO算法的深度强化学习网络模型,采集的实时道路信息作为经济性信号灯路口通行模型的状态空间;步骤2、基于限制因素提出经济性信号灯路口通行奖励函数;步骤3、根据经济性信号灯路口通行模型生成的动作变量与环境进行实时交互,依据奖励函数对当前状态下被控车辆所采取的动作进行评价,并以此对深度强化学习中的策略参数进行优化,最终得到经济性信号灯路口通行策略。该方法不仅可以避免在路口处因红灯怠速行驶的情况,增加道路的通行效率,而且在整个行驶过程中的经济性驾驶行为可以进一步的降低车辆的能量消耗。


    Access

    Download


    Export, share and cite



    Title :

    Signal lamp intersection passing method based on near-end strategy optimization


    Additional title:

    一种基于近端策略优化的信号灯路口通行方法


    Contributors:
    LIU QIFANG (author) / SUN DAZHEN (author) / CHEN HAOWEN (author) / ZHAO HAIYAN (author) / YU SHUYOU (author)

    Publication date :

    2023-10-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Signal-lamp-free intersection vehicle safe passing method

    LUO JIANFEI / WU ZHONGCHENG | European Patent Office | 2020

    Free access

    Multi-signal-lamp intersection vehicle passing auxiliary optimization method considering driving style

    WANG JIANQIANG / ZOU CHONGHAO / HUANG HEYE et al. | European Patent Office | 2020

    Free access

    Method for safely passing through intersection without signal lamp

    ZHANG YAN | European Patent Office | 2021

    Free access

    Intersection signal lamp auxiliary guide passing method based on Internet of Vehicles

    WU DI / ZHANG SHENGRUI / HAN WEI et al. | European Patent Office | 2021

    Free access

    Vehicle passing method, device and equipment at intersection without signal lamp

    WU DONGSHENG / OUYANG HANG / YUAN AIPING et al. | European Patent Office | 2024

    Free access