Automated driving requires reliable perception of the environment to ensure the safety of the driving task. One common perception task is 3D object detection, which aims at perceiving location and attributes of dynamic objects. This task is typically evaluated on different benchmark datasets, which each propose different metrics. However, these different metrics generally lack consistency and bear no relation to safety. Most notably, there is a lack of consistent definitions of pass/fail criteria for any given detection metric. In this work, the issue is addressed by systematically considering safety and human performance across different aspects of the object detection task. This approach yields interpretable detection metrics as well as thresholds for pass/fail criteria. Furthermore, a validation approach leveraging a prediction network is introduced and successfully applied to the requirements. A comparison of existing detectors shows that current perception algorithms exhibit failures for a majority of objects on the nuScenes dataset. Therefore, the results indicate the necessity of explicit safety consideration in the development of perception algorithms for the automated driving task.
SHARD: Safety and Human Performance Analysis for Requirements in Detection
IEEE Transactions on Intelligent Vehicles ; 9 , 1 ; 3010-3021
2024-01-01
851665 byte
Article (Journal)
Electronic Resource
English
Shard electric kick-board system and method for safety driving
European Patent Office | 2022
|Aircraft Performance Requirements And Flight Safety
British Library Conference Proceedings | 1997
|Safety Requirements for Human Rated Space Systems
British Library Conference Proceedings | 2010
|Performance Safety Requirements for Civil Supersonic Transports
SAE Technical Papers | 1963
|Automatic detection of incomplete and inconsistent safety requirements
Automotive engineering | 2015
|