Safe and efficient behavior are the key guiding principles for autonomous vehicles. Manually designed rule-based systems need to act very conservatively to ensure a safe operation. This limits their applicability to real-world systems. On the other hand, more advanced behaviors, i.e., policies, learned through means of reinforcement learning (RL) suffer from non-interpretability as they are usually expressed by deep neural networks that are hard to explain. Even worse, there are no formal safety guarantees for their operation. In this paper we introduce a novel pipeline that builds on recent advances in imitation learning and that can generate safe and efficient behavior policies. We combine a reinforcement learning step that solves for safe behavior through the introduction of safety distances with a subsequent innovative safe extraction of decision tree policies. The resulting decision tree is not only easy to interpret, it is also safer than the neural network policy trained for safety. Additionally, we formally prove the safety of trained RL agents for linearized system dynamics, showing that the learned and extracted policy successfully avoids all catastrophic events.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Can You Trust Your Autonomous Car? Interpretable and Verifiably Safe Reinforcement Learning


    Contributors:


    Publication date :

    2021-07-11


    Size :

    474330 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    CAN YOU TRUST YOUR AUTONOMOUS CAR? INTERPRETABLE AND VERIFIABLY SAFE REINFORCEMENT LEARNING

    Schmidt, Lukas M. / Kontes, Georgios / Plinge, Axel et al. | British Library Conference Proceedings | 2021


    MLNav: Verifiably Safe, ML-Assisted Path Planning

    Ono, Hiro / Abcouwer, Neil / Daftry, Shreyansh | NTRS | 2022


    Interpretable Autonomous Driving Model Based on Cognitive Reinforcement Learning

    Li, Yijia / Qi, Hao / Zhu, Fenghua et al. | IEEE | 2024


    Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning

    Chen, Jianyu / Li, Shengbo Eben / Tomizuka, Masayoshi | IEEE | 2022


    Safe Reinforcement Learning with Policy-Guided Planning for Autonomous Driving

    Rong, Jikun / Luan, Nan | British Library Conference Proceedings | 2020