Abstract This paper focuses on the application of meta-reinforcement learning to the robust design of low-thrust interplanetary trajectories in the presence of multiple uncertainties. A closed-loop control policy is used to optimally steer the spacecraft to a final target state despite the considered perturbations. The control policy is approximated by a deep recurrent neural network, trained by policy-gradient reinforcement learning on a collection of environments featuring mixed sources of uncertainty, namely dynamic uncertainty and control execution errors. The recurrent network is able to build an internal representation of the distribution of environments, thus better adapting the control to the different stochastic scenarios. The results in terms of optimality, constraint handling, and robustness on a fuel-optimal low-thrust transfer between Earth and Mars are compared with those obtained via a traditional reinforcement learning approach based on a feed-forward neural network.

    Highlights In interplanetary space missions, the spacecraft trajectory is affected by multiple uncertainties. Meta-reinforcement learning can be applied seamlessly to any uncertainty and dynamic model. A recurrent neural network is used as a history-dependent closed-loop control policy. The network is trained on a low-thrust transfer featuring dynamic uncertainties and control execution errors. Meta-reinforcement learning shows improved performance and robustness compared to standard reinforcement learning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Robust interplanetary trajectory design under multiple uncertainties via meta-reinforcement learning


    Contributors:

    Published in:

    Acta Astronautica ; 214 ; 147-158


    Publication date :

    2023-10-12


    Size :

    12 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Reinforcement learning for robust trajectory design of interplanetary missions

    Zavoli, Alessandro / Federici, Lorenzo | BASE | 2021

    Free access


    NEUROEVOLUTIONARY HEBBIAN-LEARNING FOR INTERPLANETARY TRAJECTORY DESIGN

    Navukkarasan, Abishek / Ravichandran, Srinath / Khadri, Syed Peer Mohamed Shah | TIBKAT | 2020


    Cassini Interplanetary Trajectory Design

    Peralta, Fernando / Flanagan, Steve | NTRS | 1995


    MISR Interplanetary Trajectory Design

    Wagner, L. A. / Munk, M. M. / American Astronautical Society et al. | British Library Conference Proceedings | 1996