Self-supervised monocular depth estimation has gained popularity due to its convenience of training network without dense ground truth depth annotation. Specifically, the multi-frame monocular depth estimation achieves promising results in virtue of temporal information. However, existing multi-frame solutions ignore the different impacts of pixels of input frame on depth estimation and the geometric information is still insufficiently explored. In this paper, a self-supervised monocular depth estimation framework with geometric prior and pixel-level sensitivity is proposed. Geometric constraint is involved through a geometric pose estimator with prior depth predictor and optical flow predictor. Further, an alternative learning strategy is designed to improve the learning of prior depth predictor by decoupling it with the ego-motion from the geometric pose estimator. On this basis, prior feature consistency regularization is introduced into the depth encoder. By taking the dense prior cost volume based on optical flow map and ego-motion as the supervising signal for feature consistency learning, the cost volume is obtained with more reasonable feature matching. To deal with the pixel-level difference of sensitivity in input frame, a sensitivity-adaptive depth decoder is built by flexibly adding a shorter path from cost volume to the final depth prediction. In this way, the back propagation of gradient to cost volume is adaptively adjusted, and an accurate depth map is decoded. The effectiveness of the proposed method is verified on public datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Self-Supervised Monocular Depth Estimation With Geometric Prior and Pixel-Level Sensitivity


    Contributors:
    Liu, Jierui (author) / Cao, Zhiqiang (author) / Liu, Xilong (author) / Wang, Shuo (author) / Yu, Junzhi (author)

    Published in:

    Publication date :

    2023-03-01


    Size :

    8480650 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Real-Time Self-Supervised Monocular Depth Estimation Without GPU

    Poggi, Matteo / Tosi, Fabio / Aleotti, Filippo et al. | IEEE | 2022


    A Self-Supervised Monocular Depth Estimation Approach Based on UAV Aerial Images

    Zhang, Yuhang / Yu, Qing / Low, Kin Huat et al. | IEEE | 2022


    SELF-OCCLUSION MASKS TO IMPROVE SELF-SUPERVISED MONOCULAR DEPTH ESTIMATION IN MULTI-CAMERA SETTINGS

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | European Patent Office | 2022

    Free access

    Self-occlusion masks to improve self-supervised monocular depth estimation in multi-camera settings

    GUIZILINI VITOR / AMBRUS RARES ANDREI / GAIDON ADRIEN DAVID et al. | European Patent Office | 2024

    Free access

    Monocular depth estimation

    European Patent Office | 2021

    Free access