Deep learning shows good performance in monocular pose estimation and has been used by some space researchers to solve the monocular pose estimation problem of uncooperative spacecraft. However, existing deep-learning-based methods are mostly trained with keypoint regression errors unnecessarily reflecting actual pose errors, limiting their learning performance. In this article, an end-to-end pose estimation network based on the convolutional neural network is proposed for the uncooperative spacecraft. First, we design a keypoint regression subnetwork based on the multibranch structure to regress the two-dimensional (2-D) keypoint locations. Then, we propose a pose estimation subnetwork to estimate the pose of the target spacecraft from the predicted 2-D keypoints and the corresponding 3-D keypoints of the target model, which allows the end-to-end training of the overall pose estimation network with actual pose error. The experimental results on two public datasets demonstrate that the proposed method can accurately estimate the target spacecraft pose in the presence of scale variance and dynamic Earth background and has better pose estimation accuracy than the current state-of-the-art methods. In addition, the proposed method shows good generalization performance and near real-time efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    End-to-End Monocular Pose Estimation for Uncooperative Spacecraft Based on Direct Regression Network


    Contributors:
    Huang, Haoran (author) / Song, Bin (author) / Zhao, Gaopeng (author) / Bo, Yuming (author)


    Publication date :

    2023-10-01


    Size :

    2851490 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    POSE ESTIMATION OF UNCOOPERATIVE SPACECRAFT FROM MONOCULAR IMAGES USING NEURAL NETWORK BASED KEYPOINTS

    Harvard, Alexei / Capuano, Vincenzo / Shao, Eugene Y. et al. | TIBKAT | 2020


    Monocular-based pose determination of uncooperative space objects

    Capuano, Vincenzo / Kim, Kyunam / Harvard, Alexei et al. | Elsevier | 2019


    Monocular Relative Pose Estimation Pipeline for Uncooperative Resident Space Objects

    Piazza, Massimo / Maestrini, Michele / Di Lizia, Pierluigi | AIAA | 2022


    Uncooperative Spacecraft Pose Estimation Using an Infrared Camera During Proximity Operations

    Shi, Jian-Feng / Ulrich, Steve / Ruel, Stephane et al. | AIAA | 2015