In this paper we propose a convolutional neural network that is designed to upsample a series of sparse range measurements based on the contextual cues gleaned from a high resolution intensity image. Our approach draws inspiration from related work on super-resolution and in-painting. We propose a novel architecture that seeks to pull contextual cues separately from the intensity image and the depth features and then fuse them later in the network. We argue that this approach effectively exploits the relationship between the two modalities and produces accurate results while respecting salient image structures. We present experimental results to demonstrate that our approach is comparable with state of the art methods and generalizes well across multiple datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    DFuseNet: Deep Fusion of RGB and Sparse Depth Information for Image Guided Dense Depth Completion


    Contributors:


    Publication date :

    2019-10-01


    Size :

    2643910 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Sparse Auxiliary Network for Depth Completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2022

    Free access

    Sparse auxiliary network for depth completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2023

    Free access

    Deterministic Guided LiDAR Depth Map Completion

    Krauss, Bryan / Schroeder, Gregory / Gustke, Marko et al. | IEEE | 2021


    Spacecraft Depth Completion Based on the Gray Image and the Sparse Depth Map

    Liu, Xiang / Wang, Hongyuan / Yan, Zhiqiang et al. | IEEE | 2023


    Non-Guided Depth Completion with Adversarial Networks

    Tsuji, Yuki / Chishiro, Hiroyuki / Kato, Shinpei | IEEE | 2018