Failures in autonomous driving caused by complex traffic situations or model inaccuracies remain inevitable in the near future. While much research is focused on how to prevent such failures, comparatively little research has been done on predicting them. An early failure prediction would allow for more time to take actions to resolve challenging situations. In this work, we propose an introspective approach to predict future disengagements of the car by learning from previous disengagement sequences. Our method is designed to detect failures as early as possible by using sensor data from up to ten seconds before each disengagement. The car itself is treated as a black box, with only its state data and the number of detected objects being required. Since no model-specific knowledge is needed, our method is applicable to any self-driving system. Currently, no public data of real-life disengagements is available. To test our approach, we therefore use autonomous driving data provided by BMW that was collected with BMW research vehicles over multiple months. We show that an LSTM classifier trained with sequences of state data can predict failures up to seven seconds in advance with an accuracy of more than 80%. This is two seconds earlier than comparable approaches from the literature.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Introspective Black Box Failure Prediction for Autonomous Driving


    Beteiligte:


    Erscheinungsdatum :

    19.10.2020


    Format / Umfang :

    409876 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    INTROSPECTIVE BLACK BOX FAILURE PREDICTION FOR AUTONOMOUS DRIVING

    Kuhn, Christopher B. / Hofbauer, Markus / Petrovic, Goran et al. | British Library Conference Proceedings | 2020


    Introspective Failure Prediction for Autonomous Driving Using Late Fusion of State and Camera Information

    Kuhn, Christopher B. / Hofbauer, Markus / Petrovic, Goran et al. | IEEE | 2022


    Introspective Failure Prediction for Semantic Image Segmentation

    Kuhn, Christopher B. / Hofbauer, Markus / Lee, Sungkyu et al. | IEEE | 2020


    Introspective autonomous vehicle operational management

    SVEGLIATO JUSTIN / WITWICKI STEFAN / WRAY KYLE HOLLINS et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Introspective Autonomous Vehicle Operational Management

    SVEGLIATO JUSTIN / WITWICKI STEFAN / WRAY KYLE HOLLINS et al. | Europäisches Patentamt | 2020

    Freier Zugriff