Abstract This paper focuses on the application of meta-reinforcement learning to the robust design of low-thrust interplanetary trajectories in the presence of multiple uncertainties. A closed-loop control policy is used to optimally steer the spacecraft to a final target state despite the considered perturbations. The control policy is approximated by a deep recurrent neural network, trained by policy-gradient reinforcement learning on a collection of environments featuring mixed sources of uncertainty, namely dynamic uncertainty and control execution errors. The recurrent network is able to build an internal representation of the distribution of environments, thus better adapting the control to the different stochastic scenarios. The results in terms of optimality, constraint handling, and robustness on a fuel-optimal low-thrust transfer between Earth and Mars are compared with those obtained via a traditional reinforcement learning approach based on a feed-forward neural network.

    Highlights In interplanetary space missions, the spacecraft trajectory is affected by multiple uncertainties. Meta-reinforcement learning can be applied seamlessly to any uncertainty and dynamic model. A recurrent neural network is used as a history-dependent closed-loop control policy. The network is trained on a low-thrust transfer featuring dynamic uncertainties and control execution errors. Meta-reinforcement learning shows improved performance and robustness compared to standard reinforcement learning.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Robust interplanetary trajectory design under multiple uncertainties via meta-reinforcement learning


    Beteiligte:

    Erschienen in:

    Acta Astronautica ; 214 ; 147-158


    Erscheinungsdatum :

    2023-10-12


    Format / Umfang :

    12 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Reinforcement learning for robust trajectory design of interplanetary missions

    Zavoli, Alessandro / Federici, Lorenzo | BASE | 2021

    Freier Zugriff


    NEUROEVOLUTIONARY HEBBIAN-LEARNING FOR INTERPLANETARY TRAJECTORY DESIGN

    Navukkarasan, Abishek / Ravichandran, Srinath / Khadri, Syed Peer Mohamed Shah | TIBKAT | 2020


    Cassini Interplanetary Trajectory Design

    Peralta, Fernando / Flanagan, Steve | NTRS | 1995


    MISR Interplanetary Trajectory Design

    Wagner, L. A. / Munk, M. M. / American Astronautical Society et al. | British Library Conference Proceedings | 1996