This article presents an innovative deep learning pipeline, which estimates the relative pose of a spacecraft by incorporating the temporal information from a rendezvous sequence. It leverages the performance of long short-term memory units in modeling sequences of data for the processing of features extracted by a convolutional neural network (CNN) backbone. Three distinct training strategies, which follow a coarse-to-fine funneled approach, are combined to facilitate feature learning and improve end-to-end pose estimation by regression. The capability of CNNs to autonomously ascertain feature representations from images is exploited to fuse thermal infrared data with electrooptical red–green–blue inputs, thus mitigating the effects of artifacts from imaging space objects in the visible wavelength. Each contribution of the proposed framework, dubbed ChiNet, is demonstrated on a synthetic dataset, and the complete pipeline is validated on experimental data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation


    Contributors:


    Publication date :

    2023-04-01


    Size :

    6682442 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Pose estimation for non-cooperative spacecraft rendezvous using convolutional neural networks

    Sharma, Sumant / Beierle, Connor / D'Amico, Simone | IEEE | 2018


    Heterogeneous Multi-task Learning for Human Pose Estimation with Deep Convolutional Neural Network

    Li, S. / Liu, Z. Q. / Chan, A. B. | British Library Online Contents | 2015