Traffic scenarios in roundabouts pose substantial complexity for automated driving. Manually mapping all possible scenarios into a state space is labor-intensive and challenging. Deep reinforcement learning (DRL) with its ability to learn from interacting with the environment emerges as a promising solution for training such automated driving models. This study explores, employs, and implements various DRL algorithms, namely Deep Deterministic Policy Gradient (DDPG), Proximal Policy Optimization (PPO), and Trust Region Policy Optimization (TRPO) to instruct automated vehicles' driving through roundabouts. The driving state space, action space, and reward function are designed. The reward function considers safety, efficiency, comfort, and energy consumption to align with real-world requirements. All three tested DRL algorithms succeed in enabling automated vehicles to drive through the roundabout. To holistically evaluate the performance of these algorithms, this study establishes an evaluation methodology considering multiple indicators, i.e., safety, efficiency, comfort and energy consumption level. A method employing the Analytic Hierarchy Process is also developed to weigh these evaluation indicators. Experimental results on various testing scenarios reveal that the TRPO algorithm outperforms DDPG and PPO in terms of safety and efficiency, while PPO performs the best in terms of comfort level and energy consumption. Lastly, to verify the model's adaptability and robustness regarding other driving scenarios, this study also deploys the model trained by TRPO to a range of different testing scenarios, e.g., highway driving and merging. Experimental results demonstrate that the TRPO model trained on only roundabout driving scenarios exhibits a certain degree of proficiency in highway driving and merging scenarios. This study provides a foundation for the application of automated driving with DRL.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Safe, Efficient, Comfort, and Energy-Saving Automated Driving Through Roundabout Based on Deep Reinforcement Learning


    Beteiligte:
    Yuan, Henan (Autor:in) / Li, Penghui (Autor:in) / Van Arem, Bart (Autor:in) / Kang, Liujiang (Autor:in) / Farah, Haneen (Autor:in) / Dong, Yongqi (Autor:in)


    Erscheinungsdatum :

    24.09.2023


    Format / Umfang :

    536021 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Intelligent Roundabout Insertion using Deep Reinforcement Learning

    Capasso, Alessandro Paolo / Bacchiani, Giulio / Molinari, Daniele | ArXiv | 2020

    Freier Zugriff

    Comfort-Based AI-Driven Roundabout Control for Automated Vehicles

    Moradi, Sina / Nadar, Ali / Harri, Jerome | IEEE | 2023



    Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving

    Gupta, Dikshant / Klusch, Mathias | ArXiv | 2022

    Freier Zugriff

    Parameter Sharing Reinforcement Learning for Modeling Multi-Agent Driving Behavior in Roundabout Scenarios

    Konstantinidis, Fabian / Hofmann, Ulrich / Sackmann, Moritz et al. | IEEE | 2021