Safety limits the application of traditional reinforcement learning (RL) methods to autonomous driving. To address the challenge of safe exploration in autonomous driving tasks, a novel safe RL method called Twin Delayed Deep Deterministic Policy Gradient based on Approximate Safe Action (TD3-ASA) is proposed in this paper. In TD3-ASA, the action output by the current policy during the exploration process is modified to obtain an approximate safe action, and then the approximate safe action is utilized to train a safe policy for deployment. TD3-ASA offers several advantages: 1) TD3-ASA is sample efficient and does not need any prior knowledge; 2) TD3-ASA enhances safety both during training and deployment; 3) TD3-ASA introduces an adjustable safety correction factor that enables a tradeoff between exploration and safety. Experimental results conducted on both the MetaDrive and SpeedLimit autonomous driving test platforms demonstrate the effectiveness of TD3-ASA. TD3-ASA exhibits more than triple safety during training on MetaDrive compared to the current state-of-the-art RL method, achieving a high success rate and low deployment risk.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Autonomous Driving Based on Approximate Safe Action


    Contributors:
    Wang, Xuesong (author) / Zhang, Jiazhi (author) / Hou, Diyuan (author) / Cheng, Yuhu (author)

    Published in:

    Publication date :

    2023-12-01


    Size :

    1228671 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Safe driving operations for autonomous vehicles

    BROWN ROBERT PAUL / SKINNER TODD B | European Patent Office | 2022

    Free access

    SAFE DRIVING OPERATIONS OF AUTONOMOUS VEHICLES

    BROWN ROBERT PATRICK / SKINNER TODD B | European Patent Office | 2022

    Free access

    Autonomous driving - safe motoring - for everyone?

    Loewenberg,K. / Homberger,M. / Consulting4Drive,DE | Automotive engineering | 2015


    Safe driving operations of autonomous vehicles

    BROWN ROBERT P / SKINNER TODD B | European Patent Office | 2022

    Free access

    Safe driving method for autonomous vehicle

    WANG DONGMEI / SUN KAI / ZHANG YUXIN | European Patent Office | 2020

    Free access