The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene understanding and visual odometry, which are key components in autonomous and robotic systems. Approaches based on the state of the art vision transformer architectures are extremely deep and complex not suitable for real-time inference operations on edge and autonomous systems equipped with low resources (i.e. robot indoor navigation and surveillance). This paper presents SPEED, a Separable Pyramidal pooling EncodEr-Decoder architecture designed to achieve real-time frequency performances on multiple hardware platforms. The proposed model is a fast-throughput deep architecture for MDE able to obtain depth estimations with high accuracy from low resolution images using minimum hardware resources (i.e. edge devices). Our encoder-decoder model exploits two depthwise separable pyramidal pooling layers, which allow to increase the inference frequency while reducing the overall computational complexity. The proposed method performs better than other fast-throughput architectures in terms of both accuracy and frame rates, achieving real-time performances over cloud CPU, TPU and the NVIDIA Jetson TX1 on two indoor benchmarks: the NYU Depth v2 and the DIML Kinect v2 datasets.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    SPEED: Separable Pyramidal Pooling EncodEr-Decoder for Real-Time Monocular Depth Estimation on Low-Resource Settings



    Erscheinungsdatum :

    2022-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Real Time Speed Estimation From Monocular Video

    Temiz, M. S. / Kulur, S. / Dogan, S. | BASE | 2012

    Freier Zugriff

    Real-Time Self-Supervised Monocular Depth Estimation Without GPU

    Poggi, Matteo / Tosi, Fabio / Aleotti, Filippo et al. | IEEE | 2022


    Monocular depth estimation

    Europäisches Patentamt | 2021

    Freier Zugriff

    Towards Real-Time Monocular Depth Estimation for Robotics: A Survey

    Dong, Xingshuai / Garratt, Matthew A. / Anavatti, Sreenatha G. et al. | IEEE | 2022


    Self-occlusion masks to improve self-supervised monocular depth estimation in multi-camera settings

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | Europäisches Patentamt | 2024

    Freier Zugriff