Recent advances in combining deep neural network architectures with reinforcement learning (RL) techniques have shown promising potential results in solving complex control problems with high-dimensional state and action spaces. Inspired by these successes, in this study, the authors built two kinds of RL algorithms: deep policy-gradient (PG) and value-function-based agents which can predict the best possible traffic signal for a traffic intersection. At each time step, these adaptive traffic light control agents receive a snapshot of the current state of a graphical traffic simulator and produce control signals. The PG-based agent maps its observation directly to the control signal; however, the value-function-based agent first estimates values for all legal control signals. The agent then selects the optimal control action with the highest value. Their methods show promising results in a traffic network simulated in the simulation of urban mobility traffic simulator, without suffering from instability issues during the training process.
Traffic light control using deep policy-gradient and value-function-based reinforcement learning
IET Intelligent Transport Systems ; 11 , 7 ; 417-423
2017-09-20
7 pages
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
action spaces , training process , adaptive traffic light control agents , graphical traffic simulator , deep policy-gradient RL algorithm , learning (artificial intelligence) , optimal control , high-dimensional state space , road traffic control , traffic intersection , deep neural network architectures , PG-based agent maps , traffic signal , value-function-based reinforcement learning , value-function-based agent RL algorithms , traffic engineering computing , gradient methods , traffic light control , digital simulation , complex control problems , control engineering computing , adaptive control , urban mobility traffic simulator , control signals
Metadata by IET is licensed under CC BY 3.0
Traffic light control using deep policy‐gradient and value‐function‐based reinforcement learning
Wiley | 2017
|Intelligent Traffic Light via Policy-based Deep Reinforcement Learning
Springer Verlag | 2022
|Deep reinforcement learning traffic light control method
Europäisches Patentamt | 2024
|Traffic light control method based on deep reinforcement learning and inverse reinforcement learning
Europäisches Patentamt | 2023
|