Abstract This work presents Spacecraft Pose Network v2 (SPNv2), a Convolutional Neural Network (CNN) for pose estimation of noncooperative spacecraft across domain gap. SPNv2 is a multi-scale, multi-task CNN which consists of a shared multi-scale feature encoder and multiple prediction heads that perform different tasks on a shared feature output. These tasks are all related to detection and pose estimation of a target spacecraft from an image, such as prediction of pre-defined satellite keypoints, direct pose regression, and binary segmentation of the satellite foreground. It is shown that by jointly training on different yet related tasks with extensive data augmentations on synthetic images only, the shared encoder learns features that are common across image domains that have fundamentally different visual characteristics compared to synthetic images. This work also introduces Online Domain Refinement (ODR) which refines the parameters of the normalization layers of SPNv2 on the target domain images online at deployment. Specifically, ODR performs self-supervised entropy minimization of the predicted satellite foreground, thereby improving the CNN’s performance on the target domain images without their pose labels and with minimal computational efforts. The GitHub repository for SPNv2 is available at https://github.com/tpark94/spnv2.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Robust multi-task learning and online refinement for spacecraft pose estimation across domain gap


    Beteiligte:
    Park, Tae Ha (Autor:in) / D’Amico, Simone (Autor:in)

    Erschienen in:

    Advances in Space Research ; 73 , 11 ; 5726-5740


    Erscheinungsdatum :

    2023-03-21


    Format / Umfang :

    15 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap

    Park, Tae Ha / Martens, Marcus / Lecuyer, Gurvan et al. | IEEE | 2022


    Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft (AAS 19-840)

    Park, Tae Ha / Sharma, Sumant / D'Amico, Simone | TIBKAT | 2020


    Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

    Becktor, Jonathan / Seto, William / Deole, Aditya et al. | IEEE | 2022


    Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

    Becktor, Jonathan Binner / Seto, William / Deole, Aditya et al. | BASE | 2022

    Freier Zugriff

    Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

    Rahmani, Amir / Mesbahi, Mehran / Talebi, Shahriar et al. | NTRS | 2022