Systems and methods for generating performance metrics for autonomous vehicle systems are provided. The performance metrics include two complementary metrics that evaluate a machine-learning object prediction model relative to a number of potential trajectories of an autonomous vehicle. The performance metrics include an avoidance metric that quantifies a probability that a region occupied by a real-world or simulated object is reached by the autonomous vehicle, the region is not blocked by another object, and the region is not blocked by a prediction output by the machine-learning object prediction model. The performance metrics also include an availability metric that quantifies a probability that a simulated or real-world object is not located within a region, the region is not blocked by another simulated or real-world object, and the autonomous vehicle is unnecessarily blocked by the prediction output before the autonomous vehicle reaches the particular footprint.
Metrics for Evaluating Autonomous Vehicle Performance
07.04.2022
Patent
Elektronische Ressource
Englisch
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen |
METRICS FOR EVALUATING AUTONOMOUS VEHICLE PERFORMANCE
Europäisches Patentamt | 2022
|Drive Scenario Generation Based on Metrics for Evaluating an Autonomous Vehicle Controller
British Library Conference Proceedings | 2018
|Drive Scenario Generation Based on Metrics for Evaluating an Autonomous Vehicle Controller
SAE Technical Papers | 2018
|