Self-supervised monocular depth estimation has gained popularity due to its convenience of training network without dense ground truth depth annotation. Specifically, the multi-frame monocular depth estimation achieves promising results in virtue of temporal information. However, existing multi-frame solutions ignore the different impacts of pixels of input frame on depth estimation and the geometric information is still insufficiently explored. In this paper, a self-supervised monocular depth estimation framework with geometric prior and pixel-level sensitivity is proposed. Geometric constraint is involved through a geometric pose estimator with prior depth predictor and optical flow predictor. Further, an alternative learning strategy is designed to improve the learning of prior depth predictor by decoupling it with the ego-motion from the geometric pose estimator. On this basis, prior feature consistency regularization is introduced into the depth encoder. By taking the dense prior cost volume based on optical flow map and ego-motion as the supervising signal for feature consistency learning, the cost volume is obtained with more reasonable feature matching. To deal with the pixel-level difference of sensitivity in input frame, a sensitivity-adaptive depth decoder is built by flexibly adding a shorter path from cost volume to the final depth prediction. In this way, the back propagation of gradient to cost volume is adaptively adjusted, and an accurate depth map is decoded. The effectiveness of the proposed method is verified on public datasets.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity


    Beteiligte:
    Liu, Jierui (Autor:in) / Cao, Zhiqiang (Autor:in) / Liu, Xilong (Autor:in) / Wang, Shuo (Autor:in) / Yu, Junzhi (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-03-01


    Format / Umfang :

    8480650 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Real-Time Self-Supervised Monocular Depth Estimation Without GPU

    Poggi, Matteo / Tosi, Fabio / Aleotti, Filippo et al. | IEEE | 2022


    A Self-Supervised Monocular Depth Estimation Approach Based on UAV Aerial Images

    Zhang, Yuhang / Yu, Qing / Low, Kin Huat et al. | IEEE | 2022


    Self-occlusion masks to improve self-supervised monocular depth estimation in multi-camera settings

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    SELF-OCCLUSION MASKS TO IMPROVE SELF-SUPERVISED MONOCULAR DEPTH ESTIMATION IN MULTI-CAMERA SETTINGS

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Monocular depth estimation

    Europäisches Patentamt | 2021

    Freier Zugriff