Abstract Autonomous and accurate recognition of satellite components is crucial for space tasks such as rendezvous, docking, maintenance, and refueling. Over the decades, the great advancement of deep learning has made us see the possibility of applying semantic segmentation to spacecraft intelligence recognition. However, the lack of training datasets required for deep learning is an insurmountable difficulty. Based on the needs of space missions and current challenges, this paper builds the space target dataset for satellite component recognition. Based on Unreal Engine 4, we establish a space simulation environment that can generate photorealistic images with earth backgrounds. After collecting and modifying 33 different high-quality satellite models, we import them into the environment and generate 10,000 satellite images with various attitudes and diverse backgrounds. Unlike existing datasets, our dataset, named UESD, has five distinctive components: solar panel, antenna, thruster, instrument, and optical payload. Furthermore, UESD constructs the earth background as much as possible to avoid the shortcomings of relevant simulation images. After building the dataset, we use a series of state-of-the-art semantic segmentation models to test their performances on our dataset. Using ConvNeXt-Base as the backbone, we propose a new decoder module named LUperNet. Our method achieves 84.6% mIoU and shows satisfactory accuracy compared with all baselines. More experiments are carried out to test the generalization ability. Results show that even on new satellite targets, a totally different dataset URSO, and real satellite images, our method can still recognize the components and maintain high accuracy. Experiments prove the effectiveness of applying our dataset and method to spacecraft component recognition. Our dataset, satellite models, and codes are available at https://github.com/zhaoyunpeng57/BUAA-UESD33.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Intelligent recognition of spacecraft components from photorealistic images based on Unreal Engine 4


    Contributors:
    Zhao, Yunpeng (author) / Zhong, Rui (author) / Cui, Linyan (author)

    Published in:

    Advances in Space Research ; 71 , 9 ; 3761-3774


    Publication date :

    2022-09-19


    Size :

    14 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Unreal Engine 4 for Automation

    Pukki, Evgeny | BASE | 2021

    Free access


    Hybrid Reality at NASA with Unreal Engine

    Noyes, Matthew | NTRS | 2016



    NASA Lunar Terrain Visualization in Unreal Engine 5

    L. Bingham / J. Kincaid | NTIS | 2022