The invention discloses a traffic signal lamp control method and device, a medium and equipment, and relates to the technical field of traffic signal lamp control. Comprising the following steps: inputting the real-time position and speed of a vehicle at an intersection into an Actor branch of an Actor-Critic network, and outputting a corresponding signal lamp action; the operation is input into the Critic branch, and the value of the operation is output, which represents the cumulative increment fuel consumption due to the change of the operation. In order to solve the problems of waste of vehicle fuel consumption and extra increase of waiting time in a signal lamp control process, a traffic signal control problem is converted into a Markov decision process, so that a reinforcement learning technology is introduced into the field of traffic signal control, incremental fuel consumption is used as an award of the Markov decision process, and the traffic signal control efficiency is improved. The phase of the traffic signal lamp is optimized based on the incremental fuel consumption, so that the network model can learn a traffic signal lamp phase change scheme which enables the fuel consumption of the vehicle to be lower.
本发明公开了一种交通信号灯控制方法、装置、介质和设备,涉及交通信号灯控制技术领域。包括:将所在交叉口的车辆实时位置与速度输入到Actor‑Critic网络的Actor分支中,输出对应的信号灯动作;将该动作输入到Critic分支中,输出动作的价值,该价值表述由于该动作变化而产生的累积增量油耗。本发明为了解决在信号灯控制过程中车辆油耗浪费、等待时间额外增加的问题,将交通信号控制问题转化为马尔科夫决策过程,从而引入强化学习技术到交通信号控制领域中,并以增量油耗为马尔科夫决策过程的奖励,基于增量油耗优化交通信号灯的相位,使得网络模型可以学习到使得车辆油耗更低的交通信号灯相位变化方案。
Traffic signal lamp control method and device, medium and equipment
一种交通信号灯控制方法、装置、介质和设备
2025-03-04
Patent
Electronic Resource
Chinese
IPC: | G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen |
Traffic signal lamp control method, device, equipment, medium and product
European Patent Office | 2024
|Regional traffic signal lamp control method, device, equipment and medium
European Patent Office | 2024
|Traffic signal lamp intelligent control method, storage medium and traffic signal lamp
European Patent Office | 2020
|Traffic intersection signal lamp control method, device, system, equipment and medium
European Patent Office | 2024
|Traffic signal lamp control method and device, equipment and storage medium
European Patent Office | 2023
|