The invention discloses an all-crossroad traffic light dynamic regulation and control method. The method comprises the steps of determining an environment state of an intelligent agent; determining a corresponding state action value according to the environment state of the current intelligent agent; selecting an action to be executed by the current agent at the next moment, and executing the selected action on the current agent; obtaining a reward value of the selected action executed by the current agent, and converting an environment state at the same time; adding the experience samples into an experience pool by adopting an experience playback mechanism; when the number of the experience samples in the current experience pool does not exceed the maximum capacity threshold value, selecting a set number of experience samples from the experience pool, and determining a current state action value; calculating a model loss function according to the current state action value, and updating parameters of the target network model and a random probability value of a greedy strategy; and when the current number of iterations reaches the total number of iterations, outputting a current state action value. The accuracy and efficiency of the traffic control system can be improved.
本发明公开了一种全十字路口红绿灯动态调控方法,包括确定智能体的环境状态;根据当前智能体的环境状态确定对应的状态动作值;选择当前智能体的下一时刻所要执行的动作,并对当前智能体执行所选择的动作;获取当前智能体执行所选择动作的奖励值,同时转换环境状态;采用经验回放机制将经验样本添加到经验池中;当当前经验池的经验样本数量未超过最大容量阈值时,从经验池中选取设定数量的经验样本,确定当前状态动作值;根据当前状态动作值计算模型损失函数,并更新目标网络模型的参数以及贪心策略的随机概率值;当当前迭代次数达到迭代总次数时输出当前状态动作值。本发明能提升交通控制系统的准确性和效率。
Method for dynamically regulating and controlling traffic lights at all crossroads
一种全十字路口红绿灯动态调控方法
2023-09-15
Patent
Electronic Resource
Chinese
IPC: | G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
British Library Online Contents | 2014
Using adaptive traffic lights for improvement of environmental situaiton at metropolis crossroads
DOAJ | 2020
|Controlling traffic lights by radio
Engineering Index Backfile | 1954