Recent advances in combining deep neural network architectures with reinforcement learning (RL) techniques have shown promising potential results in solving complex control problems with high‐dimensional state and action spaces. Inspired by these successes, in this study, the authors built two kinds of RL algorithms: deep policy‐gradient (PG) and value‐function‐based agents which can predict the best possible traffic signal for a traffic intersection. At each time step, these adaptive traffic light control agents receive a snapshot of the current state of a graphical traffic simulator and produce control signals. The PG‐based agent maps its observation directly to the control signal; however, the value‐function‐based agent first estimates values for all legal control signals. The agent then selects the optimal control action with the highest value. Their methods show promising results in a traffic network simulated in the simulation of urban mobility traffic simulator, without suffering from instability issues during the training process.
Traffic light control using deep policy‐gradient and value‐function‐based reinforcement learning
IET Intelligent Transport Systems ; 11 , 7 ; 417-423
2017-09-01
7 pages
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
value‐function‐based agent RL algorithms , urban mobility traffic simulator , complex control problems , optimal control , control signals , traffic signal , deep policy‐gradient RL algorithm , PG‐based agent maps , value‐function‐based reinforcement learning , graphical traffic simulator , high‐dimensional state space , road traffic control , digital simulation , traffic light control , traffic engineering computing , learning (artificial intelligence) , traffic intersection , gradient methods , control engineering computing , adaptive control , action spaces , deep neural network architectures , training process , adaptive traffic light control agents
Traffic light control using deep policy-gradient and value-function-based reinforcement learning
IET | 2017
|Intelligent Traffic Light via Policy-based Deep Reinforcement Learning
Springer Verlag | 2022
|Traffic light control method based on deep reinforcement learning and inverse reinforcement learning
Europäisches Patentamt | 2023
|Adaptive traffic light control method based on deep reinforcement learning
Europäisches Patentamt | 2023
|