This work studies mixed-autonomy traffic optimization at a network level with Deep Reinforcement Learning (DRL). In mixed-autonomy traffic, a mixture of connected autonomous vehicles (CAVs) and human driving vehicles is present on the roads at the same time. We hypothesize that controlling distributed CAVs at a network level can outperform the individually controlled CAVs. Our goal is to improve traffic fluidity in terms of the vehicle's average velocity and collision avoidance. We propose three distributed learning control policies for CAVs in mixed-autonomy traffic using Proximal Policy Optimization (PPO), a policy gradient DRL method. We conduct the experiments with different traffic settings and CAV penetration rates on the Flow framework, a new open-source microscopic traffic simulator. The experiments show that network-level RL policies for controlling CAVs outperform the individual-level RL policies in terms of the total rewards and the average velocity.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Mixed-Autonomy Traffic Control with Proximal Policy Optimization


    Beteiligte:
    Wei, Haoran (Autor:in) / Liu, Xuanzhang (Autor:in) / Mashayekhy, Lena (Autor:in) / Decker, Keith (Autor:in)


    Erscheinungsdatum :

    01.12.2019


    Format / Umfang :

    1555289 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Improving traffic signal control operations using proximal policy optimization

    Huang, Liben / Qu, Xiaohui | Wiley | 2023

    Freier Zugriff

    Improving traffic signal control operations using proximal policy optimization

    Liben Huang / Xiaohui Qu | DOAJ | 2023

    Freier Zugriff

    Traffic Signal Timing and Trajectory Optimization in a Mixed Autonomy Traffic Stream

    Tajalli, Mehrdad / Hajbabaie, Ali | IEEE | 2022

    Freier Zugriff

    Simulation Environment for Traffic Control Systems Targeting Mixed Autonomy Traffic Scenarios

    Link, Christopher / Malena, Kevin / Gausemeier, Sandra et al. | Fraunhofer Publica | 2023

    Freier Zugriff

    A mixed autonomy coordination methodology for multi-robotic traffic control

    Aditya, V.T. / Viswanath, D.V.K. / Krishna, K.M. | Tema Archiv | 2008