Previous studies on car-following controllers for autonomous vehicles (AVs) in mixed traffic have a narrow focus on maximizing the AV's utility, neglecting the utility of the entire traffic flow. This leads to self-centered AVs that may not be beneficial to surrounding vehicles. Thus, this study aims to develop a leading cruise controller for AVs that considers not only the AV's behaviors, but also the behaviors of both the lead human-driven vehicle (LHDV) and the following human-driven vehicle (FHDV). To achieve this, the study uses real-world data from the Waymo Open Dataset to approximate the behaviors of human-driven vehicles (HDVs) through an inverse reinforcement learning (IRL) approach. The study then proposes a preference-based soft actor-critic (PbSAC) algorithm to optimize the speed of AVs in a three-vehicle car- following scenario, while also considering safety, efficiency, and string stability for both AV and FHDV in the reward function. To further improve the control algorithm, the study develops a preference-adjusting module that adaptively updates the weights of the reward function based on expert evaluation. Experimental results show that the proposed algorithm can significantly improve safety, efficiency, and string stability for both AV and FHDV.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Leading Cruise Controller for Autonomous Vehicles in Mixed Autonomy Based on Preference-Based Reinforcement Learning


    Beteiligte:
    Wen, Xiao Luke (Autor:in) / Jian, Sisi (Autor:in) / He, Dengbo (Autor:in)


    Erscheinungsdatum :

    2024-06-02


    Format / Umfang :

    1218197 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Leveraging autonomous vehicles in mixed-autonomy traffic networks with reinforcement learning-controlled intersections

    Mosharafian, Sahand / Afzali, Shirin / Mohammadpour Velni, Javad | Taylor & Francis Verlag | 2023


    Reinforcement Learning for Mixed Autonomy Intersections

    Yan, Zhongxia / Wu, Cathy | IEEE | 2021



    Hybrid Reinforcement Learning based controller for autonomous navigation

    Joglekar, Ajinkya / Krovi, Venkat / Brudnak, Mark et al. | IEEE | 2022


    Reinforcement Learning-Based Predictive Control for Autonomous Electrified Vehicles

    Liu, Teng / Yang, Chao / Hu, Chuanzheng et al. | IEEE | 2018