Systems and methods for generating performance metrics for autonomous vehicle systems are provided. The performance metrics include two complementary metrics that evaluate a machine-learning object prediction model relative to a number of potential trajectories of an autonomous vehicle. The performance metrics include an avoidance metric that quantifies a probability that a region occupied by a real-world or simulated object is reached by the autonomous vehicle, the region is not blocked by another object, and the region is not blocked by a prediction output by the machine-learning object prediction model. The performance metrics also include an availability metric that quantifies a probability that a simulated or real-world object is not located within a region, the region is not blocked by another simulated or real-world object, and the autonomous vehicle is unnecessarily blocked by the prediction output before the autonomous vehicle reaches the particular footprint.


    Access

    Download


    Export, share and cite



    Title :

    Metrics for Evaluating Autonomous Vehicle Performance


    Contributors:

    Publication date :

    2022-04-07


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    METRICS FOR EVALUATING AUTONOMOUS VEHICLE PERFORMANCE

    HAYNES GALEN CLARK / TRAFT NEIL / SHRIDHAR SKANDA et al. | European Patent Office | 2022

    Free access

    Drive Scenario Generation Based on Metrics for Evaluating an Autonomous Vehicle Controller

    Tamilarasan, Santhosh / Jung, Daniel / Guvenc, Levent | British Library Conference Proceedings | 2018


    Drive Scenario Generation Based on Metrics for Evaluating an Autonomous Vehicle Controller

    Jung, Daniel / Guvenc, Levent / Tamilarasan, Santhosh | SAE Technical Papers | 2018


    Evaluating algorithm performance metrics tailored for prognostics

    Saxena, Abhinav / Celaya, Jose / Saha, Bhaskar et al. | IEEE | 2009


    Performance-based metrics for evaluating system quality

    SCHLEEDE PETER SCOTT | European Patent Office | 2024

    Free access