Abstract One of the biggest challenges in the development of learning-driven automated driving technologies remains the handling of uncommon, rare events that may have not been encountered in training. Especially when training a model with real driving data, unusual situations, such as emergency brakings, may be underrepresented, resulting in a model that lacks robustness in rare events. This study focuses on car-following based on reinforcement learning and demonstrates that existing approaches, trained with real driving data, fail to handle safety–critical situations. Since collecting data representing all kinds of possible car-following events, including safety–critical situations, is challenging, we propose a training environment that harnesses stochastic processes to generate diverse and challenging scenarios. Our experiments show that training with real data can lead to models that collide in safety–critical situations, whereas the proposed model exhibits excellent performance and remains accident-free, comfortable, and string-stable even in extreme scenarios, such as full-braking by the leading vehicle. Its robustness is demonstrated by simulating car-following scenarios for various reward function parametrizations and a diverse range of artificial and real leader data that were not included in training and were qualitatively different from the learning data. We further show that conventional reward designs can encourage aggressive behavior when approaching other vehicles. Additionally, we compared the proposed model with classical car-following models and found it to achieve equal or superior results.

    Highlights This study proposes a car-following model based on reinforcement learning. The model is trained with a special focus on robustness in safety–critical situations. The proposed approach outperforms conventional designs of training environments. Compared to classical car-following models, equal or superior results were achieved. Robustness is proven in various validation experiments, not included in training.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Towards robust car-following based on deep reinforcement learning


    Beteiligte:
    Hart, Fabian (Autor:in) / Okhrin, Ostap (Autor:in) / Treiber, Martin (Autor:in)


    Erscheinungsdatum :

    2024-01-08




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Towards robust reinforcement learning

    Paul, S | BASE | 2022

    Freier Zugriff

    Proactive Car-Following Using Deep-Reinforcement Learning

    Yen, Yi-Tung / Chou, Jyun-Jhe / Shih, Chi-Sheng et al. | IEEE | 2020



    Vehicle following speed control method based on deep reinforcement learning

    FEI RONG / YANG LU / QIU YUAN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Towards monocular vision based obstacle avoidance through deep reinforcement learning

    Xie, L / Wang, S / Markham, A et al. | BASE | 2020

    Freier Zugriff