The ability to identify important objects in a complex and dynamic driving environment is essential for autonomous driving agents to make safe and efficient driving decisions. It also helps assistive driving systems decide when to alert drivers. We tackle object importance estimation in a data-driven fashion and introduce HOIST - Human-annotated Object Importance in Simulated Traffic. HOIST contains driving scenarios with human-annotated importance labels for vehicles and pedestrians. We additionally propose a novel approach that relies on counterfactual reasoning to estimate an object's importance. We generate counterfactual scenarios by modifying the motion of objects and ascribe importance based on how the modifications affect the ego vehicle's driving. Our approach outperforms strong baselines for the task of object importance estimation on HOIST. We also perform ablation studies to justify our design choices and show the significance of the different components of our proposed approach.


    Access

    Download


    Export, share and cite



    Title :

    Object Importance Estimation using Counterfactual Reasoning for Intelligent Driving


    Contributors:

    Publication date :

    2023


    Remarks:

    IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3648-3655, April 2024



    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English





    SAFETY MEASUREMENT FOR A COUNTERFACTUAL RISK IN AUTONOMOUS VEHICLE DRIVING

    CHI-JOHNSTON GEOFFREY LOUIS / FREEMAN LAURA ATHENA / ROLAND CHRISTOPHER BRIAN et al. | European Patent Office | 2023

    Free access

    Intelligent agent importance prediction for autonomous driving

    HAZZARD CHRISTIAN / BHAGAT ASHISH / FODOLOJU BRENT R et al. | European Patent Office | 2024

    Free access

    Counterfactual quantum computation

    Hosten, O. / Rakher, M.T. / Barreiro, J.T. et al. | IEEE | 2005


    SAFE: Saliency-Aware Counterfactual Explanations for DNN-based Automated Driving Systems

    Samadi, Amir / Shirian, Amir / Koufos, Konstantinos et al. | IEEE | 2023