Abstract This paper focuses on the application of meta-reinforcement learning to the robust design of low-thrust interplanetary trajectories in the presence of multiple uncertainties. A closed-loop control policy is used to optimally steer the spacecraft to a final target state despite the considered perturbations. The control policy is approximated by a deep recurrent neural network, trained by policy-gradient reinforcement learning on a collection of environments featuring mixed sources of uncertainty, namely dynamic uncertainty and control execution errors. The recurrent network is able to build an internal representation of the distribution of environments, thus better adapting the control to the different stochastic scenarios. The results in terms of optimality, constraint handling, and robustness on a fuel-optimal low-thrust transfer between Earth and Mars are compared with those obtained via a traditional reinforcement learning approach based on a feed-forward neural network.
Highlights In interplanetary space missions, the spacecraft trajectory is affected by multiple uncertainties. Meta-reinforcement learning can be applied seamlessly to any uncertainty and dynamic model. A recurrent neural network is used as a history-dependent closed-loop control policy. The network is trained on a low-thrust transfer featuring dynamic uncertainties and control execution errors. Meta-reinforcement learning shows improved performance and robustness compared to standard reinforcement learning.
Robust interplanetary trajectory design under multiple uncertainties via meta-reinforcement learning
Acta Astronautica ; 214 ; 147-158
2023-10-12
12 pages
Article (Journal)
Electronic Resource
English
Reinforcement learning for robust trajectory design of interplanetary missions
BASE | 2021
|Cassini Interplanetary Trajectory Design
NTRS | 1995
|MISR Interplanetary Trajectory Design
British Library Conference Proceedings | 1996
|