A diversion area mixed traffic flow control method based on graph neural network reinforcement learning comprises the following steps: step 1, setting a task scene of mixed traffic flow control, and defining a state space which can be observed by an intelligent agent; 2, constructing an adjacent matrix of a vehicle network to express a vehicle relationship, and determining an overall network structure of the model; 3, defining an action space and a reward function of the reinforcement learning agent; defining an action space as a set of lane changing actions based on a task scene, and setting a reward function to guide an intelligent agent to learn a strategy capable of obtaining an optimal action; 4, training and testing the whole model; and training the whole model by using experience playback and a target network, and then testing the performance of the reinforcement learning agent model under different traffic conditions. According to the invention, efficient control of the mixed traffic flow can be realized without occupying too many vehicle computing resources, and the traffic efficiency of the diversion area of the expressway is improved.

    一种基于图神经网络强化学习的分流区混合交通流控制方法,包括:步骤1:设置混合交通流控制的任务情景,并定义智能体所能观测到的状态空间;步骤2:构建车辆网络的邻接矩阵对车辆关系进行表示,确定模型的整体网络结构;步骤3:定义强化学习智能体的动作空间和奖励函数;基于任务场景将动作空间定义为换道动作的集合,设置奖励函数以引导智能体学习能得到最优动作的策略;步骤4:对整体模型进行训练和测试;使用经验回放和目标网络对整体模型进行训练,之后在不同的交通条件下中测试强化学习智能体模型的性能。本发明能在不占用过多车辆计算资源的情况下实现对混合交通流的高效控制,提升高速公路分流区的交通效率。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Flow distribution area mixed traffic flow control method based on graph neural network reinforcement learning


    Weitere Titelangaben:

    基于图神经网络强化学习的分流区混合交通流控制方法


    Beteiligte:
    XU DONGWEI (Autor:in) / LIU PEIWEN (Autor:in) / QIU QINGWEI (Autor:in)

    Erscheinungsdatum :

    2023-05-02


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Ramp confluence area mixed traffic flow control method based on time-space diagram neural network reinforcement learning

    XU DONGWEI / QIU QINGWEI / GAO GUANGYAN et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Graph neural network traffic flow prediction method based on deep learning

    CHENG XIAOHUI / HE YUHAO / LU QIU | Europäisches Patentamt | 2023

    Freier Zugriff

    Airport traffic flow prediction method based on graph neural network

    YAN ZHEN / YANG HONGYU / WU XIPING et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Traffic flow prediction method based on dynamic graph neural network

    XU GUANGXIA / HU XINTING / CHEN LANG et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Urban road network traffic flow simulation method based on graph neural network

    MAO TIANLU / LIU JINGYAO / WANG ZHAOQI et al. | Europäisches Patentamt | 2024

    Freier Zugriff