Abstract This work creates a framework for solving highly non-linear satellite formation control problems by using model-free policy optimisation deep reinforcement learning (DRL) methods. This work considers, believed to be for the first time, DRL methods, such as advantage actor-critic method (A2C) and proximal policy optimisation (PPO), to solve the example satellite formation problem of propellantless planar phasing of multiple satellites. Three degree-of-freedom simulations, including a novel surrogate propagation model, are used to train the deep reinforcement learning agents. During training, the agents actuated their motion through cross-sectional area changes which altered the environmental accelerations acting on them. The DRL framework designed in this work successfully coordinated three spacecraft to achieve a propellantless planar phasing manoeuvre. This work has created a DRL framework that can be used to solve complex satellite formation flying problems, such as planar phasing of multiple satellites and in doing so provides key insights into achieving optimal and robust formation control using reinforcement learning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Propulsionless planar phasing of multiple satellites using deep reinforcement learning


    Contributors:

    Published in:

    Advances in Space Research ; 67 , 11 ; 3667-3682


    Publication date :

    2020-09-13


    Size :

    16 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Constellation Phasing with Differential Drag on Planet Labs Satellites

    Foster, Cyrus / Mason, James / Vittaldev, Vivek et al. | AIAA | 2017





    Deep Reinforcement Learning for Continuous Power Allocation in Flexible High Throughput Satellites

    Luis, Juan Jose Garau / Guerster, Markus / del Portillo, Inigo et al. | IEEE | 2019