Systems and methods for assessing the performance of an automated autonomous driving evaluator are disclosed herein. One embodiment receives a driving log including at least one of raw vehicle sensor data and information derived from the raw vehicle sensor data correlated with a time index; receives ground-truth data associated with the driving log, wherein the ground-truth data includes at least one of human-initiated disengagements of an autonomous driving system and human-entered annotations indicating mistakes made by the autonomous driving system; analyzes the driving log using an automated autonomous driving evaluator to generate a report; automatically compares the report with the ground-truth data to generate a performance assessment for the automated autonomous driving evaluator; and provides the performance assessment to a development process in which the automated autonomous driving evaluator is modified based, at least in part, on the performance assessment to improve the performance of the automated autonomous driving evaluator.
SYSTEMS AND METHODS FOR ASSESSING THE PERFORMANCE OF AN AUTOMATED AUTONOMOUS DRIVING EVALUATOR
2023-12-21
Patent
Electronic Resource
English
IPC: | G07C TIME OR ATTENDANCE REGISTERS , Zeit- oder Anwesenheitskontrollgeräte / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen |
E2E LEARNING-BASED EVALUATOR FOR AN AUTONOMOUS DRIVING VEHICLE
European Patent Office | 2023
|E2E LEARNING-BASED EVALUATOR FOR AN AUTONOMOUS DRIVING VEHICLE
European Patent Office | 2023
|Receiver performance evaluator
NTRS | 1977
|NTRS | 1976
|Engineering Index Backfile | 1940
|