Roundabouts frequently present challenging traffic scenarios, often leading to accidents, making it crucial to design a safe and efficient automatic driving decision-making system for effective navigation. While deep reinforcement learning (DRL) has shown promise in this field, it faces challenges such as poor sample efficiency and safety concerns. To address these issues, this paper proposes a hybrid approach that combines DRL with heuristic rules. We introduce an action filter module that pre-screens the action space to select valid actions based on the strategy, thereby improving sample efficiency. Additionally, we propose a novel reward function that encourages vehicles to switch to the outer lane before exiting the roundabout. This function helps mitigate safety concerns and traffic congestion under varying vehicle densities, enhancing the robustness of the algorithm. The proposed method is tested in a two-lane roundabout scenario. Experimental results demonstrate that the action filter module significantly improves training speed and traffic safety, while the novel reward function enhances the adaptability and robustness of the model.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Autonomous Decision-Making in Roundabouts Using Deep Reinforcement Learning and Heuristics Rules


    Beteiligte:
    Zhang, Haikuo (Autor:in) / Han, Weizhen (Autor:in) / Shi, Haiyong (Autor:in) / Feng, Haiyang (Autor:in) / Hu, Jin (Autor:in)


    Erscheinungsdatum :

    05.11.2024


    Format / Umfang :

    1398844 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Heuristics‐oriented overtaking decision making for autonomous vehicles using reinforcement learning

    Liu, Teng / Huang, Bing / Deng, Zejian et al. | Wiley | 2020

    Freier Zugriff

    Game Theoretic Decision-Making for Autonomous Driving Considering Traffic Rules at Roundabouts

    Huang, Liting / Chu, Duanfeng / Deng, Zejian et al. | IEEE | 2024


    Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

    Liu, Teng / Huang, Bing / Deng, Zejian et al. | IET | 2020

    Freier Zugriff

    Adaptive Game-Theoretic Decision Making for Autonomous Vehicle Control at Roundabouts

    Tian, Ran / Li, Sisi / Li, Nan et al. | ArXiv | 2018

    Freier Zugriff

    Autonomous Lane Change Decision Making Using Different Deep Reinforcement Learning Methods

    Feng, Xidong / Hu, Jianming / Huo, Yusen et al. | ASCE | 2019