The ability to identify important objects in a complex and dynamic driving environment is essential for autonomous driving agents to make safe and efficient driving decisions. It also helps assistive driving systems decide when to alert drivers. We tackle object importance estimation in a data-driven fashion and introduce HOIST - Human-annotated Object Importance in Simulated Traffic. HOIST contains driving scenarios with human-annotated importance labels for vehicles and pedestrians. We additionally propose a novel approach that relies on counterfactual reasoning to estimate an object's importance. We generate counterfactual scenarios by modifying the motion of objects and ascribe importance based on how the modifications affect the ego vehicle's driving. Our approach outperforms strong baselines for the task of object importance estimation on HOIST. We also perform ablation studies to justify our design choices and show the significance of the different components of our proposed approach.
Object Importance Estimation using Counterfactual Reasoning for Intelligent Driving
2023
IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3648-3655, April 2024
Preprint
Electronic Resource
English
SAFETY MEASUREMENT FOR A COUNTERFACTUAL RISK IN AUTONOMOUS VEHICLE DRIVING
European Patent Office | 2023
|Intelligent agent importance prediction for autonomous driving
European Patent Office | 2024
|Counterfactual quantum computation
IEEE | 2005
|