Techniques for evaluating and validating progress of training machine-learned models are described herein. The techniques may include storing, in a database, metric data associated with outputs from machine-learned models based on sensor data inputs. For instance, the metric data may include first metric data associated with a first bounding box output by a machine-learned model and second metric data associated with a second bounding box output by an updated version of the machine-learned model. The techniques also include a graphical user interface (GUI) for presenting visualizations of the metric data that improve the ability to evaluate the performance of a machine-learned model. In some examples, an indication of a request to evaluate the updated version of the machine-learned model may be received via the GUI. Based on the indication, the GUI may cause presentation of visualization(s) of difference(s) between first metric(s) of the first metric data and second metric(s) of the second metric data.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Metric visualization system for model evaluation


    Beteiligte:
    BESSON CLEMENT (Autor:in) / PURDY SCOTT M (Autor:in) / RAGHAVAN BHARADWAJ (Autor:in)

    Erscheinungsdatum :

    05.11.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    METRIC VISUALIZATION SYSTEM FOR MODEL EVALUATION

    BESSON CLEMENT / PURDY SCOTT M / RAGHAVAN BHARADWAJ | Europäisches Patentamt | 2025

    Freier Zugriff

    Objective Metric x Subjetive Evaluation

    Nuti, Angelo Cesar | SAE Technical Papers | 2003


    Objective Metric x Subjective Evaluation

    Nuti, A. C. / Society of Automotive Engineers | British Library Conference Proceedings | 2003


    Evaluation of visualization algorithms for CommSense system

    Jana, Sandip / Mishra, Amit Kumar / Khan, Mohammed Zafar Ali | IEEE | 2022


    Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems

    Weng, Bowen / Rao, Sughosh J. / Deosthale, Eeshan et al. | IEEE | 2020