Techniques for evaluating and validating progress of training machine-learned models may include storing, in a database, metric data associated with outputs from machine-learned models based on sensor data inputs. For instance, the metric data may include first metric data associated with a first bounding box output by a machine-learned model and second metric data associated with a second bounding box output by an updated version of the machine-learned model. The techniques also include a graphical user interface (GUI) for presenting visualizations of the metric data that improve the ability to evaluate the performance of a machine-learned model. In some examples, an indication of a request to evaluate the updated version of the machine-learned model may be received via the GUI. Based on the indication, the GUI may cause presentation of visualization(s) of difference(s) between first metric(s) of the first metric data and second metric(s) of the second metric data.


    Access

    Download


    Export, share and cite



    Title :

    METRIC VISUALIZATION SYSTEM FOR MODEL EVALUATION


    Contributors:

    Publication date :

    2025-01-23


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    Metric visualization system for model evaluation

    BESSON CLEMENT / PURDY SCOTT M / RAGHAVAN BHARADWAJ | European Patent Office | 2024

    Free access

    Objective Metric x Subjetive Evaluation

    Nuti, Angelo Cesar | SAE Technical Papers | 2003


    Objective Metric x Subjective Evaluation

    Nuti, A. C. / Society of Automotive Engineers | British Library Conference Proceedings | 2003


    Evaluation of visualization algorithms for CommSense system

    Jana, Sandip / Mishra, Amit Kumar / Khan, Mohammed Zafar Ali | IEEE | 2022


    Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems

    Weng, Bowen / Rao, Sughosh J. / Deosthale, Eeshan et al. | IEEE | 2020