Single-image depth estimation represents a longstanding challenge in computer vision and although it is an ill-posed problem, deep learning enabled astonishing results leveraging both supervised and self-supervised training paradigms. State-of-the-art solutions achieve remarkably accurate depth estimation from a single image deploying huge deep architectures, requiring powerful dedicated hardware to run in a reasonable amount of time. This overly demanding complexity makes them unsuited for a broad category of applications requiring devices with constrained resources or memory consumption. To tackle this issue, in this paper a family of compact, yet effective CNNs for monocular depth estimation is proposed, by leveraging self-supervision from a binocular stereo rig. Our lightweight architectures, namely PyD-Net and PyD-Net2, compared to complex state-of-the-art trade a small drop in accuracy to drastically reduce the runtime and memory requirements by a factor ranging from $2\times $ to $100\times $ . Moreover, our networks can run real-time monocular depth estimation on a broad set of embedded or consumer devices, even not equipped with a GPU, by early stopping the inference with negligible (or no) loss in accuracy, making it ideally suited for real applications with strict constraints on hardware resources or power consumption.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Real-Time Self-Supervised Monocular Depth Estimation Without GPU


    Beteiligte:
    Poggi, Matteo (Autor:in) / Tosi, Fabio (Autor:in) / Aleotti, Filippo (Autor:in) / Mattoccia, Stefano (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-10-01


    Format / Umfang :

    3316900 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity

    Liu, Jierui / Cao, Zhiqiang / Liu, Xilong et al. | IEEE | 2023


    A Self-Supervised Monocular Depth Estimation Approach Based on UAV Aerial Images

    Zhang, Yuhang / Yu, Qing / Low, Kin Huat et al. | IEEE | 2022


    Self-occlusion masks to improve self-supervised monocular depth estimation in multi-camera settings

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    SELF-OCCLUSION MASKS TO IMPROVE SELF-SUPERVISED MONOCULAR DEPTH ESTIMATION IN MULTI-CAMERA SETTINGS

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Monocular depth estimation

    Europäisches Patentamt | 2021

    Freier Zugriff