The invention discloses a traffic signal control method and system based on safety reinforcement learning, and the method comprises the steps: obtaining a plurality of pieces of historical state information, a first probability value, a first reward value, a second reward value, a first cost value and a second cost value are obtained through processing by utilizing an attention network, an actor network, a reward approver network and a cost approver network, and then an advantage evaluation value and a cost evaluation value are obtained through a reward advantage evaluation function and a cost advantage evaluation function; optimizing the actor network, the reward approver network and the cost approver network based on the advantage evaluation value, the cost evaluation value, the first probability value, the reward value, the first reward value, the cost value and the first cost value, and repeating the above process until a preset number of times is exceeded to obtain a trained actor network; and obtaining observation information at the current moment, and inputting the observation information into the trained actor network to obtain a current action so as to control a traffic signal. According to the invention, the safety of the intersection is ensured under the condition of ensuring efficiency.

    本发明公开了一种基于安全强化学习的交通信号控制方法及系统,所述方法包括:获取多个历史状态信息,并利用注意力网络、行动者网络、奖励批评者网络和代价批评者网络处理得到第一概率值、第一奖励价值、第二奖励价值、第一代价价值和第二代价价值,然后通过奖励优势评估函数和代价优势评估函数得到优势评估值和代价评估值;基于优势评估值、代价评估值、第一概率值、奖励值、第一奖励价值、代价值和第一代价价值优化行动者网络、奖励批评者网络和代价批评者网络,重复上述过程,直至超过预设次数,得到训练后的行动者网络;获取当前时刻的观测信息,并输入至训练后的行动者网络得到当前动作以控制交通信号。本发明在保证效率下确保路口的安全性。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Traffic signal control method and system based on safety reinforcement learning


    Weitere Titelangaben:

    一种基于安全强化学习的交通信号控制方法及系统


    Beteiligte:
    REN YILONG (Autor:in) / FU XIANG (Autor:in) / YU HAIYANG (Autor:in) / JIANG HAN (Autor:in)

    Erscheinungsdatum :

    03.01.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Reinforcement learning traffic signal control method based on safety consciousness aggregation

    REN YILONG / FU XIANG / YU HAIYANG et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Traffic signal control method based on reinforcement learning

    LONG SHUI / YU JIADI | Europäisches Patentamt | 2023

    Freier Zugriff

    Deep Reinforcement Learning-Based Traffic Signal Control

    Hu, Penghui / Zhang, Xinran / Hu, Jianming | ASCE | 2024


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023