The invention discloses an all-crossroad traffic light dynamic regulation and control method. The method comprises the steps of determining an environment state of an intelligent agent; determining a corresponding state action value according to the environment state of the current intelligent agent; selecting an action to be executed by the current agent at the next moment, and executing the selected action on the current agent; obtaining a reward value of the selected action executed by the current agent, and converting an environment state at the same time; adding the experience samples into an experience pool by adopting an experience playback mechanism; when the number of the experience samples in the current experience pool does not exceed the maximum capacity threshold value, selecting a set number of experience samples from the experience pool, and determining a current state action value; calculating a model loss function according to the current state action value, and updating parameters of the target network model and a random probability value of a greedy strategy; and when the current number of iterations reaches the total number of iterations, outputting a current state action value. The accuracy and efficiency of the traffic control system can be improved.

    本发明公开了一种全十字路口红绿灯动态调控方法,包括确定智能体的环境状态;根据当前智能体的环境状态确定对应的状态动作值;选择当前智能体的下一时刻所要执行的动作,并对当前智能体执行所选择的动作;获取当前智能体执行所选择动作的奖励值,同时转换环境状态;采用经验回放机制将经验样本添加到经验池中;当当前经验池的经验样本数量未超过最大容量阈值时,从经验池中选取设定数量的经验样本,确定当前状态动作值;根据当前状态动作值计算模型损失函数,并更新目标网络模型的参数以及贪心策略的随机概率值;当当前迭代次数达到迭代总次数时输出当前状态动作值。本发明能提升交通控制系统的准确性和效率。


    Access

    Download


    Export, share and cite



    Title :

    Method for dynamically regulating and controlling traffic lights at all crossroads


    Additional title:

    一种全十字路口红绿灯动态调控方法


    Contributors:
    WU LIJUN (author)

    Publication date :

    2023-09-15


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    TRAFFIC LIGHTS SYSTEM FOR CROSSROADS

    YE SANGDON / SEO SEHONG / HEO SEONGJUN et al. | European Patent Office | 2019

    Free access

    Controlling traffic lights

    British Library Online Contents | 2014


    Using adaptive traffic lights for improvement of environmental situaiton at metropolis crossroads

    G. A. Galchenko / M. V. Burnyasheva / D. S. Drozdov | DOAJ | 2020

    Free access

    Controlling traffic lights by radio

    Engineering Index Backfile | 1954


    Method and server for controlling traffic lights

    SCHEIDER THOMAS / ZOECHMANN ERICH | European Patent Office | 2025

    Free access