The invention discloses a non-signalized intersection vehicle cooperation method based on asynchronous deep reinforcement learning, and the method comprises the steps: describing the cooperation problem of vehicles in an intersection region through formulating a Markov decision framework, and the system problem comprises an observation state space, an action space and a reward function; designing a vehicle cooperation model based on a shared deep neural network architecture, wherein the content of the shared deep neural network architecture design comprises a control output strategy and a value function estimation strategy; using an asynchronous training strategy to train the vehicle cooperation model; and processing vehicle information in an actual scene according to the trained vehicle cooperation model, and outputting a vehicle cooperation scheme of a non-signalized intersection. According to the embodiment of the invention, effective cooperation of vehicles in a non-signalized intersection scene can be realized in limited computing resources, vehicle congestion and conflicts are reduced, the safety and traffic efficiency of traffic management are improved, and the method can be widely applied to the technical field of intelligent traffic.

    本发明公开了一种基于异步深度强化学习的无信号交叉口车辆协作方法,方法包括:通过制定马尔可夫决策框架来描述车辆在交叉口区域的协同问题,所述系统问题包括观测状态空间、动作空间和奖励函数;基于共享深度神经网络架构设计车辆协作模型,所述共享深度神经网络架构设计的内容包括控制输出策略与值函数估计策略;使用异步训练策略对所述车辆协作模型进行训练;根据训练完成后的所述车辆协作模型对实际场景中的车辆信息进行处理,输出无信号交叉口的车辆协作方案。本发明实施例可在有限的计算资源内,实现车辆在无信号交叉口场景的有效协作,减少车辆堵塞和冲突,提升交通管理的安全性与通行效率,可广泛应用于智能交通技术领域。


    Access

    Download


    Export, share and cite



    Title :

    Non-signalized intersection vehicle cooperation method based on asynchronous deep reinforcement learning


    Additional title:

    一种基于异步深度强化学习的无信号交叉口车辆协作方法


    Contributors:
    WANG SHUAI (author) / DING YUHAO (author)

    Publication date :

    2025-02-14


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Automatic driving non-signalized intersection decision generation method based on hierarchical reinforcement learning

    CHEN XUEMEI / TANG YUNHAO / HAO JIACHEN et al. | European Patent Office | 2024

    Free access

    Non-signalized intersection early warning system and early warning method based on vehicle cloud cooperation

    SONG XUANXUAN / XUE WEIPING / XU JIEXIN et al. | European Patent Office | 2024

    Free access


    Signal-lamp-free intersection vehicle scheduling method based on asynchronous reinforcement learning algorithm

    LYU YONG / OUYANG ZHUO / HU HEXUAN et al. | European Patent Office | 2023

    Free access