An apparatus includes an interface and a processor. The interface may be configured to receive pixel data corresponding to an area outside of a vehicle and sensor data from said vehicle. The processor may be configured to generate one or more outputs in response to the sensor data based upon dynamic set-points for the vehicle and one or more inferences made by executing a first trained neural network model. The processor may be configured to process the pixel data arranged as video frames. The trained neural network model may have been trained by processing the pixel data arranged as video frames, performing computer vision operations to detect features in the video frames, determining the dynamic set-points for the vehicle by applying visual odometry operations on the features detected in the video frames, and modifying a plurality of weights of an untrained neural network model based on the dynamic set-points, the sensor data, and a training dataset comprising the dynamic set-points and corresponding actuator values that are representative of one or more desired inferences.


    Access

    Download


    Export, share and cite



    Title :

    Dynamic actuation map using a neural network fed by visual odometry


    Contributors:

    Publication date :

    2024-07-16


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    Dynamic actuation map using neural network fed by visual odometry

    BACCHIANI GIULIO | European Patent Office | 2025

    Free access

    Visual Odometry

    Nister, D. / Naroditsky, O. / Bergen, J. et al. | British Library Conference Proceedings | 2004


    Visual odometry

    Nister, D. / Naroditsky, O. / Bergen, J. | IEEE | 2004


    AUTONOMOUS NAVIGATION USING VISUAL ODOMETRY

    LIAO MIAO / LI MING / HONG SOONHAC | European Patent Office | 2017

    Free access

    Automotive visual odometry

    Buczko, Martin / Shaker Verlag | TIBKAT | 2018