Highlights Reinforcement learning (RL)-based longitudinal control for absorbing shockwaves. Cooperative control benefits both ego and surrounding vehicles. RL controllers trained on HighD trajectories generalize well to commercial ACC data. Taking information from two lead vehicles further improve RL model performance.

    Abstract Stop-and-go traffic poses significant challenges to the efficiency and safety of traffic operations. In this study, a cooperative longitudinal control based on Soft Actor Critic (SAC) Reinforcement Learning (RL) is proposed to address this issue. The reward function is carefully designed to consider vehicle cooperation and to achieve three main objectives: safety, efficiency, and oscillation dampening. A global performance metric for oscillation dampening is proposed to evaluate the developed RL and other baseline models. Depending on the number of preceding vehicles that can share maneuver information, two models RL-1 and RL-2 are proposed and compared with human driven (HD) and an adaptive cruise control (ACC) model using the HighD and simulated data. It is found that with information from additional preceding vehicles, RL-2 can dampen shockwaves more efficiently. Specifically, RL-1 and RL-2 decrease traffic oscillation by 15%-36% and 15%-42%, respectively, while HD amplifies the oscillation by 14–37%. The ACC model can also dampen shockwaves but is not as effective as RL-1 and RL-2. The two RL control methods are further evaluated based on data collected using a commercial Model X vehicle. Compared with the commercial Model X ACC vehicle in some controlled settings, the proposed RL methods can better dampen the stop-and-go waves by generating smaller oscillation growth, overshooting, and average acceleration/deceleration rate change, suggesting that they can generalize well in a new but similar environment. Finally, the RL methods are evaluated considering a platoon of vehicles with different RL penetration rates. The results show that they consistently outperform HD and ACC in dampening shockwaves.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning based cooperative longitudinal control for reducing traffic oscillations and improving platoon stability


    Beteiligte:
    Jiang, Liming (Autor:in) / Xie, Yuanchang (Autor:in) / Evans, Nicholas G. (Autor:in) / Wen, Xiao (Autor:in) / Li, Tienan (Autor:in) / Chen, Danjue (Autor:in)


    Erscheinungsdatum :

    2022-06-02




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Altruistic cooperative adaptive cruise control of mixed traffic platoon based on deep reinforcement learning

    Lu, Sikai / Cai, Yingfeng / Chen, Long et al. | Wiley | 2023

    Freier Zugriff

    Platoon traffic system and platoon traffic control method

    TESHIMA HISANORI / YANO KOJIN / SAKIKAWA SHUICHIRO et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    PLATOON TRAFFIC SYSTEM AND PLATOON TRAFFIC CONTROL METHOD

    TESHIMA HISANORI / YANO KOJIN / SAKIKAWA SHUICHIRO et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Cooperative vehicle platoon control considering longitudinal and lane-changing dynamics*

    Hou, Kangning / Zheng, Fangfang / Liu, Xiaobo et al. | Taylor & Francis Verlag | 2024