Perceiving the 3D structure of the spacecraft is a prerequisite for successfully executing many on-orbit space missions, and it can provide critical input for many downstream vision algorithms. In this paper, we propose to sense the 3D structure of spacecraft using light detection and ranging sensor (LIDAR) and a monocular camera. To this end, Spacecraft Depth Completion Network (SDCNet) is proposed to recover the dense depth map based on gray image and sparse depth map. Specifically, SDCNet decomposes the spacecraft depth completion task into foreground segmentation subtask and foreground depth completion subtask, which segments the spacecraft region first and then performs depth completion on the segmented foreground area. In this way, the background interference to foreground spacecraft depth completion is effectively avoided. Moreover, an attention-based feature fusion module is also proposed to aggregate the complementary information between different inputs, which deduces the correlation between different features along the channel and the spatial dimension sequentially. Besides, four metrics are also proposed to evaluate object-level depth completion performance. Finally, a large-scale satellite depth completion dataset is constructed for training and testing spacecraft depth completion algorithms. Empirical experiments on the dataset demonstrate the effectiveness of the proposed SDCNet, which achieves 0.225 m mean absolute error of interest and 0.778 m mean absolute truncation error, surpassing state-of-the-art methods by a large margin. The pose estimation experiment is also conducted based on the depth completion results, and the experimental results indicate that the predicted dense depth map could meet the needs of downstream vision tasks.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Spacecraft Depth Completion Based on the Gray Image and the Sparse Depth Map


    Contributors:
    Liu, Xiang (author) / Wang, Hongyuan (author) / Yan, Zhiqiang (author) / Chen, Yu (author) / Chen, Xinlong (author) / Chen, Weichun (author)


    Publication date :

    2023-10-01


    Size :

    9209536 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Sparse Auxiliary Network for Depth Completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2022

    Free access

    Sparse auxiliary network for depth completion

    GUIZILINI VITOR / AMBRUS RARES A / GAIDON ADRIEN DAVID | European Patent Office | 2023

    Free access

    DFuseNet: Deep Fusion of RGB and Sparse Depth Information for Image Guided Dense Depth Completion

    Shivakumar, Shreyas S. / Nguyen, Ty / Miller, Ian D. et al. | IEEE | 2019


    Filtering and regret network for spacecraft component segmentation based on gray images and depth maps

    LIU, Xiang / WANG, Hongyuan / WANG, Zijian et al. | Elsevier | 2024

    Free access

    Sparse Pseudo-LiDAR Depth Assisted Monocular Depth Estimation

    Shao, Shuwei / Pei, Zhongcai / Chen, Weihai et al. | IEEE | 2024