Failures in autonomous driving caused by complex traffic situations or model inaccuracies remain inevitable in the near future. While much research is focused on how to prevent such failures, comparatively little research has been done on predicting them. An early failure prediction would allow for more time to take actions to resolve challenging situations. In this work, we propose an introspective approach to predict future disengagements of the car by learning from previous disengagement sequences. Our method is designed to detect failures as early as possible by using sensor data from up to ten seconds before each disengagement. The car itself is treated as a black box, with only its state data and the number of detected objects being required. Since no model-specific knowledge is needed, our method is applicable to any self-driving system. Currently, no public data of real-life disengagements is available. To test our approach, we therefore use autonomous driving data provided by BMW that was collected with BMW research vehicles over multiple months. We show that an LSTM classifier trained with sequences of state data can predict failures up to seven seconds in advance with an accuracy of more than 80%. This is two seconds earlier than comparable approaches from the literature.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Introspective Black Box Failure Prediction for Autonomous Driving


    Contributors:


    Publication date :

    2020-10-19


    Size :

    409876 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Introspective Failure Prediction for Autonomous Driving Using Late Fusion of State and Camera Information

    Kuhn, Christopher B. / Hofbauer, Markus / Petrovic, Goran et al. | IEEE | 2022


    Introspective Failure Prediction for Semantic Image Segmentation

    Kuhn, Christopher B. / Hofbauer, Markus / Lee, Sungkyu et al. | IEEE | 2020


    Introspective autonomous vehicle operational management

    SVEGLIATO JUSTIN / WITWICKI STEFAN / WRAY KYLE HOLLINS et al. | European Patent Office | 2020

    Free access

    Introspective Autonomous Vehicle Operational Management

    SVEGLIATO JUSTIN / WITWICKI STEFAN / WRAY KYLE HOLLINS et al. | European Patent Office | 2020

    Free access

    Failure Prediction for Autonomous Driving

    Hecker, Simon / Dai, Dengxin / Van Gool, Luc | IEEE | 2018