Monocular depth estimation (MDE) in aerial scenarios presents a significant challenge due to various factors such as varying altitudes, perspective distortions, and occlusions. Leveraging scene priors, like surfaces, can preserve structural integrity, with semantic segmentation serving as a valuable tool for attaining this objective. This work introduces a novel approach to depth estimation in aerial scenarios by integrating semantic information with depth features. Thus, we propose a novel learnable module, called semBins, that combines semantics with depth features at the depth discretization level in the MDE network. To maximize the effectiveness of this technique, a novel pseudo-random semantic-based query-response training procedure is proposed, which extracts image patches and predicts depth distributions of local neighborhoods for each pixel. This approach ensures that the semantic labels guide the patch extraction process, narrowing down the bin distribution search space. We show that semBins can achieve top performance on both synthetic and real-life aerial-based datasets.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    SemBins: Semantic Bins for Monocular Depth Estimation in Aerial Scenarios


    Beteiligte:


    Erscheinungsdatum :

    24.09.2024


    Format / Umfang :

    10460928 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Mono-LSDE: Lightweight Semantic-CNN for Depth Estimation from Monocular Aerial Images*

    Astudillo, Armando / Al-Kaff, Abdulla / Madridano, Angel et al. | IEEE | 2020


    A Self-Supervised Monocular Depth Estimation Approach Based on UAV Aerial Images

    Zhang, Yuhang / Yu, Qing / Low, Kin Huat et al. | IEEE | 2022


    Sparse Pseudo-LiDAR Depth Assisted Monocular Depth Estimation

    Shao, Shuwei / Pei, Zhongcai / Chen, Weihai et al. | IEEE | 2024


    Monocular Depth Estimation Using Information Exchange Network

    Su, Wen / Zhang, Haifeng / Zhou, Quan et al. | IEEE | 2021