The invention provides a traffic signal lamp control method and device and a storage medium, and relates to the field of intelligent traffic control. The method comprises the following steps: randomly initializing an Actor-Critic network, a memory bank and random noise in a DDPG model; acquiring traffic flow data, acquiring intersection state information of each intersection by adopting an intelligent agent, and generating an initial strategy based on the intersection state information; collecting the total queue length, the total delay, the total waiting duration and the throughput of each lane, and calculating a reward for an initial action; through the intelligent agent, executing an initial action to update the intersection state information so as to generate sample data; storing the sample data in a memory bank in a sum tree form; and making the sample data randomly extracted from the memory bank to carry out reinforcement learning training and iterative optimization on an Actor-Critic network until an optimal control strategy for an intelligent agent is generated to carry out traffic signal lamp control. The method is used for solving the problem that a traffic signal control method suitable for multiple intersections is lacked at present.

    本发明提供了一种交通信号灯控制方法、设备及存储介质,涉及智能交通控制领域,包括以下:随机初始化DDPG模型中的Actor‑Critic网络、记忆库以及随机噪声;获取车流数据,采用智能体采集各个交叉口的路口状态信息,基于路口状态信息生成的初始策略;采集各个车道的总队列长度、总延迟、等待总时长以及吞吐量,计算用于初始动作的奖励;智能体执行初始动作更新路口状态信息,以生成样本数据;在记忆库中将样本数据以和树形式存储;从记忆库中随机抽取样本数据对Actor‑Critic网络进行强化学习训练,迭代优化,直至生成用于智能体的最优控制策略进行交通信号灯控制,用于解决现有缺乏一种可适用于多交叉口的交通信号控制方法的问题。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Traffic signal lamp control method and device and storage medium


    Weitere Titelangaben:

    一种交通信号灯控制方法、设备及存储介质


    Beteiligte:
    WU BIN (Autor:in) / WANG XUN (Autor:in)

    Erscheinungsdatum :

    2021-08-24


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES



    Traffic signal lamp intelligent control method, storage medium and traffic signal lamp

    JIANG DONGDONG / GUO LIN / YAN YAPING et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Traffic signal lamp control method and device and storage medium

    HUANG JIEMING / ZHONG SUIHONG | Europäisches Patentamt | 2020

    Freier Zugriff

    Traffic signal lamp control method and device, equipment and storage medium

    ZHAN XIANYUAN / LI JIANXIONG / YUAN JIRUI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Traffic signal lamp control method and device, equipment and storage medium

    JIANG SONGTAO / CHEN ZHIQUAN / ZHOU DABING et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Traffic signal lamp control method, device and equipment and storage medium

    QIN XI | Europäisches Patentamt | 2023

    Freier Zugriff