System, methods, and other embodiments described herein relate to training a depth model for joint depth completion and prediction. In one arrangement, a method includes generating depth features from sparse depth data according to a sparse auxiliary network (SAN) of a depth model. The method includes generating a first depth map from a monocular image and a second depth map from the monocular image and the depth features using the depth model. The method includes generating a depth loss from the second depth map and the sparse depth data and an image loss from the first depth map and the sparse depth data. The method includes updating the depth model including the SAN using the depth loss and the image loss.


    Access

    Download


    Export, share and cite



    Title :

    Training of joint depth prediction and completion


    Contributors:

    Publication date :

    2023-01-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G01B MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS , Messen der Länge, der Dicke oder ähnlicher linearer Abmessungen / G01C Messen von Entfernungen, Höhen, Neigungen oder Richtungen , MEASURING DISTANCES, LEVELS OR BEARINGS / G01S RADIO DIRECTION-FINDING , Funkpeilung / G06V



    Network architecture for the joint learning of monocular depth prediction and completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2023

    Free access

    NETWORK ARCHITECTURE FOR THE JOINT LEARNING OF MONOCULAR DEPTH PREDICTION AND COMPLETION

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2022

    Free access

    Deterministic Guided LiDAR Depth Map Completion

    Krauss, Bryan / Schroeder, Gregory / Gustke, Marko et al. | IEEE | 2021


    Sparse Auxiliary Network for Depth Completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2022

    Free access

    Sparse auxiliary network for depth completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2023

    Free access