To enable safe autonomous vehicle (AV) operations, it is critical that an AV’s obstacle detection module can reliably detect obstacles that pose a safety threat (i.e., are safety-critical). It is therefore desirable that the evaluation metric for the perception system captures the safety-criticality of objects. Unfortunately, existing perception evaluation metrics tend to make strong assumptions about the objects and ignore the dynamic interactions between agents, and thus do not accurately capture the safety risks in reality. To address these shortcomings, we introduce an interaction-dynamics-aware obstacle detection evaluation metric by accounting for closed-loop dynamic interactions between an ego vehicle and obstacles in the scene. By borrowing existing theory from optimal control theory, namely Hamilton-Jacobi reachability, we present a computationally tractable method for constructing a “safety zone a region in state space that defines where safety-critical obstacles lie for the purpose of defining safety metrics. Our proposed safety zone is mathematically complete, and can be easily computed to reflect a variety of safety requirements. Using an off-the-shelf detection algorithm from the nuScenes detection challenge leaderboard, we demonstrate that our approach is computationally lightweight, and can better capture safety-critical perception errors than a baseline approach.
Interaction-Dynamics-Aware Perception Zones for Obstacle Detection Safety Evaluation
2022 IEEE Intelligent Vehicles Symposium (IV) ; 1201-1210
2022-06-05
2769311 byte
Conference paper
Electronic Resource
English
Perception Tasks: Obstacle Detection
Springer Verlag | 2012
|Context-aware obstacle detection for navigation by visually impaired
British Library Online Contents | 2017
|Obstacle detection systems for vehicle safety
Automotive engineering | 2004
|Obstacle Detection Systems for Vehicle Safety
British Library Conference Proceedings | 2004
|