Reinforcement learning has gradually demonstrated its decision-making ability in autonomous driving. Reinforcement learning is learning how to map states to actions by interacting with environment so as to maximize the long-term reward. Within limited interactions, the learner will get a suitable driving policy according to the designed reward function. However there will be a lot of unsafe behaviors during training in traditional reinforcement learning. This paper proposes a RL-based method combined with RL agent and Monte Carlo tree search algorithm to reduce unsafe behaviors. The proposed safe reinforcement learning framework mainly consists of two modules: risk state estimation module and safe policy search module. Once the future state will be risky calculated by the risk state estimation module using current state information and the action outputted by the RL agent, the MCTS based safe policy search module will activate to guarantee a safer exploration by adding an additional reward for risk actions. We test the approach in several random overtake scenarios, resulting in faster convergence and safer behaviors compared to traditional reinforcement learning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe Reinforcement Learning for Autonomous Vehicle Using Monte Carlo Tree Search


    Contributors:
    Mo, Shuojie (author) / Pei, Xiaofei (author) / Wu, Chaoxian (author)


    Publication date :

    2022-07-01


    Size :

    1956923 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Maximum Entropy Inverse Reinforcement Learning Using Monte Carlo Tree Search for Autonomous Driving

    Rodrigues da Silva, Junior Anderson / Grassi, Valdir / Wolf, Denis Fernando | IEEE | 2024


    Monte Carlo Tree Search With Reinforcement Learning for Motion Planning

    Weingertner, Philippe / Ho, Minnie / Timofeev, Andrey et al. | IEEE | 2020



    TACTICAL COOPERATIVE PLANNING FOR AUTONOMOUS HIGHWAY DRIVING USING MONTE-CARLO TREE SEARCH

    Lenz, David / Kessler, Tobias / Knoll, Alois | British Library Conference Proceedings | 2016