Deep reinforcement learning (DRL) algorithms often face challenges in achieving stability and efficiency due to significant policy gradient variance and inaccurate reward function estimation in complex scenarios. This study addresses these issues in the context of multi-objective car-following control tasks with time lag in traffic oscillations. We propose an expert demonstration reinforcement learning (EDRL) approach that aims to stabilize training, accelerate learning, and enhance car-following performance. The key idea is to leverage expert demonstrations, which represent superior car-following control experiences, to improve the DRL policy. Our method involves two sequential steps. In the first step, expert demonstrations are obtained during offline pretraining by utilizing prior traffic knowledge, including car-following trajectories from an empirical database and classic car-following models. In the second step, expert demonstrations are obtained during online training, where the agent interacts with the car-following environment. The EDRL agents are trained through supervised regression on the expert demonstrations using the behavioral cloning technique. Experimental results conducted in various traffic oscillation scenarios demonstrate that our proposed method significantly enhances training stability, learning speed, and rewards compared to baseline algorithms.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Enhancing Car-Following Performance in Traffic Oscillations Using Expert Demonstration Reinforcement Learning


    Beteiligte:
    Li, Meng (Autor:in) / Li, Zhibin (Autor:in) / Cao, Zehong (Autor:in)


    Erscheinungsdatum :

    01.07.2024


    Format / Umfang :

    3000754 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Enhancing Traffic Control Strategies through Dynamic Simulation and Reinforcement Learning

    Sebastian, Alona Mary / Athulram, K R / Michael, Colin et al. | IEEE | 2024


    Enhancing Urban Traffic Management in Taipei: A Reinforcement Learning Approach

    William, Ivander / Kozhevnikov, Sergei / Sontheimer, Moritz et al. | IEEE | 2024


    Enhancing UAS Integration in Controlled Traffic Regions Through Reinforcement Learning

    Joaquin Vico Navarro / Juan Antonio Vila Carbó | DOAJ | 2025

    Freier Zugriff


    Enhancing Urban Pollution Reduction via Reinforcement Learning-Based Traffic Light Optimization

    Essamlali, Ismail / Nhaila, Hasna / El Khaili, Mohamed | Springer Verlag | 2025