A method for scale-aware depth estimation using multi-camera projection loss is described. The method includes determining a multi-camera photometric loss associated with a multi-camera rig of an ego vehicle. The method also includes training a scale-aware depth estimation model and an ego-motion estimation model according to the multi-camera photometric loss. The method further includes predicting a 360° point cloud of a scene surrounding the ego vehicle according to the scale-aware depth estimation model and the ego-motion estimation model. The method also includes planning a vehicle control action of the ego vehicle according to the 360° point cloud of the scene surrounding the ego vehicle.


    Access

    Download


    Export, share and cite



    Title :

    Scale-aware depth estimation using multi-camera projection loss



    Publication date :

    2024-07-09


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    SCALE-AWARE DEPTH ESTIMATION USING MULTI-CAMERA PROJECTION LOSS

    GUIZILINI VITOR / AMBRUS RARES ANDREI / VASILJEVIC IGOR et al. | European Patent Office | 2024

    Free access

    SCALE-AWARE DEPTH ESTIMATION USING MULTI-CAMERA PROJECTION LOSS

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | European Patent Office | 2022

    Free access

    Unsupervised Learning of Depth Estimation and Camera Pose With Multi-Scale GANs

    Xu, Yufan / Wang, Yan / Huang, Rui et al. | IEEE | 2022


    Pedestrian Orientation Estimation Using CNN and Depth Camera

    Abughalieh, Karam / Alawneh, Shadi | SAE Technical Papers | 2020


    Local Scene Depth Estimation Using Rotating Monocular Camera

    Thomas, Sonu / Kutty, Krishnan / Senthamilarasu, Vinuchackravarthy | British Library Conference Proceedings | 2015