In recent years, the advancement of artificial intelligence techniques has led to significant interest in reinforcement learning (RL) within the traffic and transportation community. Dynamic traffic control has emerged as a prominent application field for RL in traffic systems. This paper presents a comprehensive survey of RL studies in dynamic traffic control, addressing the challenges associated with implementing RL-based traffic control strategies in practice, and identifying promising directions for future research. The first part of this paper provides a comprehensive overview of existing studies on RL-based traffic control strategies, encompassing their model designs, training algorithms, and evaluation methods. It is found that only a few studies have isolated the training and testing environments while evaluating their RL controllers. Subsequently, we examine the challenges involved in implementing existing RL-based traffic control strategies. We investigate the learning costs associated with online RL methods and the transferability of offline RL methods through simulation experiments. The simulation results reveal that online training methods with random exploration suffer from high exploration and learning costs. Additionally, the performance of offline RL methods is highly reliant on the accuracy of the training simulator. These limitations hinder the practical implementation of existing RL-based traffic control strategies. The final part of this paper summarizes and discusses a few existing efforts which attempt to overcome these challenges. This review highlights a rising volume of studies dedicated to mitigating the limitations of RL strategies, with the specific aim of enhancing their practical implementation in recent years.


    Access

    Download


    Export, share and cite



    Title :

    Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation


    Contributors:
    Yu Han (author) / Meng Wang (author) / Ludovic Leclercq (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Leveraging autonomous vehicles in mixed-autonomy traffic networks with reinforcement learning-controlled intersections

    Mosharafian, Sahand / Afzali, Shirin / Mohammadpour Velni, Javad | Taylor & Francis Verlag | 2023


    TRAFFIC CONTROL WITH REINFORCEMENT LEARNING

    GANTI RAGHU KIRAN / SRIVASTA MUDHAKAR / RAO VENKATESH ASHOK RAO et al. | European Patent Office | 2020

    Free access

    Traffic control with reinforcement learning

    GANTI RAGHU KIRAN / SRIVATSA MUDHAKAR / RAO VENKATESH ASHOK RAO et al. | European Patent Office | 2022

    Free access


    Deep reinforcement learning traffic light control method

    KONG YAN / LI YING / CHIH-CHAO YANG | European Patent Office | 2024

    Free access