Estimating position and stereographic geometry information of noncooperative spacecraft through three-dimensional (3-D) reconstruction techniques is of great significance. Depth information acquisition is an important component of 3-D reconstruction. Monocular cameras are cheaper and more widely used than depth sensors. The relative positions of noncooperative spacecraft and our spacecraft can be calculated from depth maps of monocular depth estimation and the camera parameters, providing data support for subsequent tracking and capture missions. This paper proposes a monocular depth estimation network combining the convolutional neural network (CNN) and a vision transformer (VIT) to improve the prediction accuracy of few-shot samples. We extract detail features and global features from the CNN and VIT encoders, respectively, and then fuse deep features and shallow features by a skip-connected upsampling decoder. Compared with the representative depth estimation algorithms in recent years on the NYU-Depth V2 dataset, the proposed network structure combines the advantages of the CNN and VIT as well as estimates the global depth of the scene more accurately while maintaining details. To solve the lack of spacecraft data collection, a new dataset is made from 3-D simulation models. Experiments on the self-made dataset demonstrate the feasibility of this method in aerospace engineering.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Monocular Depth Estimation of Noncooperative Spacecraft Based on Deep Learning


    Contributors:
    Zhao, Erxun (author) / Zhang, Yang (author) / Gao, Jingmin (author)

    Published in:

    Publication date :

    2023-03-10


    Size :

    9 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Robust Model-Based Monocular Pose Initialization for Noncooperative Spacecraft Rendezvous

    Sharma, Sumant / Ventura, Jacopo / D’Amico, Simone | AIAA | 2018


    Pose Estimation of a Noncooperative Target Based on Monocular Visual SLAM

    Ting Lei / Xiao-Feng Liu / Guo-Ping Cai et al. | DOAJ | 2019

    Free access


    Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft (AAS 19-840)

    Park, Tae Ha / Sharma, Sumant / D'Amico, Simone | TIBKAT | 2020


    Monocular depth estimation

    European Patent Office | 2021

    Free access