The random exploration nature of reinforcement learning (RL) impedes the way to achieve human-like autonomous driving, owing to the prohibitively high safety requirement. In this paper, we propose a deep refine reinforcement learning (DR2L) approach to removing non-safety-critical actions and reconstructing critical ones, which effectively enhance the efficiency of exploration. The core is to design an action filter based on two-stage vehicle motion model to calculate the critical value of dangerous actions and reconstructe the action space by filtering out the obvious incorrect actions. Besides, we propose to use the beta distribution as the stochastic policy, which eliminates the bias of the Gaussian policy and provides faster convergence. Finally, we design spacial-temporal attention network to extract hidden information of environment as the state to enhance the performance of RL. The simulation shows that DR2L can effectively improve the safety of agent during training process. Our resutls show that the beta policy provides significantly faster convergence over the Gaussian policy when both are used with proximal policy optimization (PPO).


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Refine Reinforcement Learning for Safety Training of Autonomous Driving


    Contributors:
    Yang, Fukun (author) / Hu, Zhiqun (author) / Zhang, Yuanming (author) / Huang, Hao (author) / Wang, Guixin (author)


    Publication date :

    2024-09-24


    Size :

    1733868 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    DEEP REINFORCEMENT LEARNING WITH ENHANCED SAFETY FOR AUTONOMOUS HIGHWAY DRIVING

    Baheri, Ali / Nageshrao, Subramanya / Tseng, H. Eric et al. | British Library Conference Proceedings | 2020


    Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

    Baheri, Ali / Nageshrao, Subramanya / Tseng, H. Eric et al. | IEEE | 2020


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023


    COMPUTER-IMPLEMENTED METHOD TRAINING A CNN / RNN FOR AUTONOMOUS DRIVING UTILIZING REINFORCEMENT LEARNING

    SHANKAR MEGHANA / RAJPUT SAJEEV | European Patent Office | 2022

    Free access