The invention discloses a traffic signal lamp control method and device, a medium and equipment, and relates to the technical field of traffic signal lamp control. Comprising the following steps: inputting the real-time position and speed of a vehicle at an intersection into an Actor branch of an Actor-Critic network, and outputting a corresponding signal lamp action; the operation is input into the Critic branch, and the value of the operation is output, which represents the cumulative increment fuel consumption due to the change of the operation. In order to solve the problems of waste of vehicle fuel consumption and extra increase of waiting time in a signal lamp control process, a traffic signal control problem is converted into a Markov decision process, so that a reinforcement learning technology is introduced into the field of traffic signal control, incremental fuel consumption is used as an award of the Markov decision process, and the traffic signal control efficiency is improved. The phase of the traffic signal lamp is optimized based on the incremental fuel consumption, so that the network model can learn a traffic signal lamp phase change scheme which enables the fuel consumption of the vehicle to be lower.

    本发明公开了一种交通信号灯控制方法、装置、介质和设备,涉及交通信号灯控制技术领域。包括:将所在交叉口的车辆实时位置与速度输入到Actor‑Critic网络的Actor分支中,输出对应的信号灯动作;将该动作输入到Critic分支中,输出动作的价值,该价值表述由于该动作变化而产生的累积增量油耗。本发明为了解决在信号灯控制过程中车辆油耗浪费、等待时间额外增加的问题,将交通信号控制问题转化为马尔科夫决策过程,从而引入强化学习技术到交通信号控制领域中,并以增量油耗为马尔科夫决策过程的奖励,基于增量油耗优化交通信号灯的相位,使得网络模型可以学习到使得车辆油耗更低的交通信号灯相位变化方案。


    Access

    Download


    Export, share and cite



    Title :

    Traffic signal lamp control method and device, medium and equipment


    Additional title:

    一种交通信号灯控制方法、装置、介质和设备


    Contributors:
    ZHAO HONGXING (author) / DUAN LIN (author) / NIE JIANGLONG (author) / LIANG RUIYAN (author) / HE RUICHUN (author)

    Publication date :

    2025-03-04


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Traffic signal lamp control method, device, equipment, medium and product

    LIU HAO / LAI SIQI / XU ZHAO et al. | European Patent Office | 2024

    Free access

    Regional traffic signal lamp control method, device, equipment and medium

    YIN CHENFENG | European Patent Office | 2024

    Free access

    Traffic signal lamp intelligent control method, storage medium and traffic signal lamp

    JIANG DONGDONG / GUO LIN / YAN YAPING et al. | European Patent Office | 2020

    Free access

    Traffic intersection signal lamp control method, device, system, equipment and medium

    QIN HONGBO / CAO TAIYU / DUI HONGYAN et al. | European Patent Office | 2024

    Free access

    Traffic signal lamp control method and device, equipment and storage medium

    JIANG SONGTAO / CHEN ZHIQUAN / ZHOU DABING et al. | European Patent Office | 2023

    Free access