Compared with an ecological driving strategy based on an optimization method, the intelligent network connection automobile signal intersection passing strategy based on safety reinforcement learning has the advantages that the calculation time is shorter, and the real-time performance is higher; compared with a traditional ecological driving strategy based on reinforcement learning, the method is designed through a safety layer error correction mechanism, violation of safety constraints in the training process is ingeniously avoided, the safety performance is better, and the actual application value is higher. According to the method, the nonlinear traffic light constraint is converted into the time-varying linear state constraint aiming at the upper and lower reference trajectories of the vehicle position, so that the problem of reward sparseness during reinforcement learning agent trial-and-error training is effectively solved.

    本发明提供了一种基于安全强化学习的智能网联汽车信号交叉口处通行策略,其相比基于优化方法的生态驾驶策略,计算时间更少,实时性更高;相比传统基于强化学习的生态驾驶策略,本发明通过安全层纠错机制设计,巧妙地避免了在训练过程中安全约束的违反,安全性能更好,实际应用价值更高。本发明针对车辆位置的上下参考轨迹将非线性交通灯约束转化为时变线性状态约束,从而有效解决了强化学习智能体试错训练时面临的奖励稀疏问题。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent network connection automobile signal intersection passing strategy based on safety reinforcement learning


    Additional title:

    基于安全强化学习的智能网联汽车信号交叉口处通行策略


    Contributors:
    HE HONGWEN (author) / LI JIAQI (author) / WANG YONG (author) / WANG HAOYU (author)

    Publication date :

    2024-07-05


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Intersection passing method and system for intelligent network connection vehicles

    ZHAO XIN / ZHOU SHUHAN / YUAN WANG et al. | European Patent Office | 2023

    Free access

    Intersection intelligent network connection vehicle control method based on reinforcement learning

    WANG YOU / SHI HENGLIANG / CHEN HUAKUI et al. | European Patent Office | 2024

    Free access

    Intelligent network connection vehicle no-signal-control intersection passing optimization method based on coupling algorithm

    WEI XINKAI / SONG TAO / TAN CHANGLIANG et al. | European Patent Office | 2025

    Free access

    Intelligent network connection automobile decision-making method and system for intersection without signal lamp

    YE YULIN / ZHANG HAN / ZHAO WANZHONG et al. | European Patent Office | 2023

    Free access

    Intersection reinforcement learning signal control method for network connection vehicle detection state perception

    ZHANG JIAN / WANG HAN / WANG BO et al. | European Patent Office | 2022

    Free access