Human driven vehicles (HDVs) with selfish objectives cause low traffic efficiency in an un-signalized intersection. On the other hand, autonomous vehicles can overcome this inefficiency through perfect coordination. In this paper, we propose an intermediate solution, where we use vehicular communication and a small number of autonomous vehicles to improve the transportation system efficiency in such intersections. In our solution, two connected autonomous vehicles (CAVs) lead multiple HDVs in a double-lane intersection in order to avoid congestion in front of the intersection. The CAVs are able to communicate and coordinate their behavior, which is controlled by a deep reinforcement learning (DRL) agent. We design an altruistic reward function which enables CAVs to adjust their velocities flexibly in order to avoid queuing in front of the intersection. The proximal policy optimization (PPO) algorithm is applied to train the policy and the generalized advantage estimation (GAE) is used to estimate state values. Training results show that two CAVs are able to achieve significantly better traffic efficiency compared to similar scenarios without and with one altruistic autonomous vehicle.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Connected autonomous vehicles for improving mixed traffic efficiency in unsignalized intersections with deep reinforcement learning


    Beteiligte:
    Bile Peng (Autor:in) / Musa Furkan Keskin (Autor:in) / Balázs Kulcsár (Autor:in) / Henk Wymeersch (Autor:in)


    Erscheinungsdatum :

    2021




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Can Autonomous Vehicles Enhance Traffic Safety at Unsignalized Intersections?

    Maryam Mousavi, Seyedeh / Lord, Dominique / Dadashova, Bahar et al. | ASCE | 2020


    Can Autonomous Vehicles Enhance Traffic Safety at Unsignalized Intersections?

    Mousavi, Seyedeh Maryam / Lord, Dominique / Dadashova, Bahar et al. | TIBKAT | 2020


    Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections

    Spatharis, Christos / Blekas, Konstantinos | Taylor & Francis Verlag | 2024


    On the Awareness of Connected Vehicles at Unsignalized Intersections

    Avedisov, Sergei S. / Higuchi, Takamasa / Sakr, Ahmed Hamdi et al. | IEEE | 2022


    Unsignalized Intersections

    Elefteriadou, Lily | Springer Verlag | 2013