Methods, systems, and processor-readable media for adaptive periodic level traffic signal control are described. The invention discloses a self-adaptive periodic traffic signal controller and a control method. The self-adaptive periodic traffic signal controller operates in a continuous action space. A reinforcement learning algorithm named as Proximal Policy Optimization (PPO), which is a behavior-evaluation model for reinforcement learning, may be used to generate a signal period phase duration selected from a range of continuous values. Therefore, the controller does not take the action space as discrete, but generates a continuous value as an output. The generated phase duration may define a complete traffic signal period. Input of the controller may indicate current and past states of a traffic environment. The average delay duration of the vehicle in the traffic environment may be used to calculate a reward for a reinforcement learning model that drives the behavior of the controller.

    本申请描述了用于自适应周期级交通信号控制的方法、系统和处理器可读介质。一种自适应周期级交通信号控制器和控制方法,其在连续动作空间内运作。一种名为近端策略优化(Proximal Policy Optimization,PPO)的强化学习算法,其为一种用于强化学习的行为‑评判模型,可用于生成从连续值范围中选择的信号周期阶段持续时间。因此,所述控制器不将动作空间视为离散的,而是产生连续值作为输出。生成的阶段持续时间可定义完整的交通信号周期。所述控制器的输入可指示交通环境的当前和过往状态。车辆在交通环境中的平均延迟持续时间可用于计算驱动所述控制器的行为的强化学习模型的奖励。


    Access

    Download


    Export, share and cite



    Title :

    Method and system for adaptive periodic-level traffic signal control


    Additional title:

    自适应周期级交通信号控制的方法和系统


    Contributors:

    Publication date :

    2023-06-06


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    METHOD AND SYSTEM FOR ADAPTIVE CYCLE-LEVEL TRAFFIC SIGNAL CONTROL

    MOHAMAD ALIZADEH SHABESTARY SOHEIL / ABDULHAI BAHER / MA HAO HAI et al. | European Patent Office | 2022

    Free access

    Method and system for adaptive cycle-level traffic signal control

    MOHAMAD ALIZADEH SHABESTARY SOHEIL / ABDULHAI BAHER / MA HAO HAI et al. | European Patent Office | 2023

    Free access

    Traffic signal machine adaptive control method, traffic signal machine and control system

    YANG PENG / LIN JIE / CHENG YAN et al. | European Patent Office | 2022

    Free access

    METHOD AND SYSTEM FOR ADAPTIVE CYCLE-LEVEL TRAFFIC SIGNAL CONTROL

    MOHAMAD ALIZADEH SHABESTARY SOHEIL / ABDULHAI BAHER / MA HAO HAI et al. | European Patent Office | 2022

    Free access

    City-level integral traffic signal control method and city-level integral traffic signal control device

    CHEN WEIQIANG / MA XIAOLONG | European Patent Office | 2020

    Free access