The invention discloses a reinforcement learning traffic signal control method based on internal reward enhancement. The method comprises the following steps: acquiring traffic state data under different conditions; designing and constructing a traffic signal agent; state feature extraction is carried out based on a multi-layer perceptron, and internal reward solution is carried out based on a determinant point process; traffic signal control is carried out after traffic signal optimization based on internal reward enhancement and independent reinforcement learning. The method encourages an intelligent agent to explore a new state by introducing a diversity enhanced internal reward method, and enables a reinforcement learning agent to learn a higher reward by evaluating the diversity between adjacent states based on a deterministic point process.

    本发明公开了一种基于内在奖励增强的强化学习交通信号控制方法,包括获取不同情况下的交通状态数据;设计并构建交通信号智能体;基于多层感知机进行状态特征提取,并基于行列式点过程进行内在奖励求解;基于内在奖励增强和独立强化学习优化交通信号后进行交通信号控制。本发明通过引入多样性增强内在奖励方法,鼓励智能体探索新状态,并使强化学习代理能够通过基于确定性点过程评估相邻状态之间的多样性来学习更高的奖励。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement learning traffic signal control method based on internal reward enhancement


    Weitere Titelangaben:

    一种基于内在奖励增强的强化学习交通信号控制方法


    Beteiligte:
    REN YILONG (Autor:in) / FU XIANG (Autor:in) / CHEN JIAXU (Autor:in) / LYU TAN (Autor:in) / YU HAIYANG (Autor:in) / HAO YING (Autor:in) / JIANG HAN (Autor:in)

    Erscheinungsdatum :

    2024-05-17


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | IET | 2021

    Freier Zugriff

    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | Wiley | 2020

    Freier Zugriff

    Reward Function Design in Multi-Agent Reinforcement Learning for Traffic Signal Control

    Koohy, Behrad / Stein, Sebastian / Gerding, Enrico et al. | TIBKAT | 2022

    Freier Zugriff

    Traffic signal control method based on deep reinforcement learning

    LIU DUANYANG / SHEN SI / SHEN GUOJIANG et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Traffic signal control method based on reinforcement learning

    LONG SHUI / YU JIADI | Europäisches Patentamt | 2023

    Freier Zugriff