Abstract In this paper, a meta-reinforcement learning approach is investigated to design an adaptive guidance algorithm capable of carrying out multiple rendezvous space missions. Specifically, both a standard fully-connected network and a recurrent neural network are trained by proximal policy optimization on a wide distribution of finite-thrust rendezvous transfers between circular co-planar orbits. The recurrent network is also provided with the control and reward at the previous simulation step, thus allowing it to build, thanks to its history-dependent state, an internal representation of the considered task distribution. The ultimate goal is to generate a model which could adapt to unseen tasks and produce a nearly-optimal guidance law along any transfer leg of a multi-target mission. As a first step towards the solution of a complete multi-target problem, a sensitivity analysis on the single rendezvous leg is carried out in this paper, by varying the radius either of the initial or the final orbit, the transfer time, and the initial phasing between the chaser and the target. Numerical results show that the recurrent-network-based meta-reinforcement learning approach is able to better reconstruct the optimal control in almost all the analyzed scenarios, and, at the same time, to meet, with greater accuracy, the terminal rendezvous condition, even when considering problem instances that fall outside the original training domain.

    Highlights In multi-target missions, spacecraft need enhanced decision-making autonomy. Reinforcement learning is a flexible way to create an autonomous guidance algorithm. Meta-reinforcement learning increases the guidance adaptability to multiple transfers. Meta-learning is realized with an action-reward-aware recurrent neural network. The recurrent network shows improved performance and generalization capabilities.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Meta-reinforcement learning for adaptive spacecraft guidance during finite-thrust rendezvous missions


    Beteiligte:

    Erschienen in:

    Acta Astronautica ; 201 ; 129-141


    Erscheinungsdatum :

    2022-08-28


    Format / Umfang :

    13 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    META-REINFORCEMENT LEARNING FOR ADAPTIVE SPACECRAFT GUIDANCE DURING MULTI-TARGET MISSIONS

    Federici, Lorenzo / Scorsoglio, Andrea / Zavoli, Alessandro et al. | TIBKAT | 2022



    Spacecraft autonomous rendezvous and docking guidance strategy generation method based on reinforcement learning

    YANG ZHIBIN / XING LINQUAN / XIAO YINGMIN et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Rendezvous Missions to Comets with Electrical Spacecraft

    E. Stuhlinger / W. Dittberner | NTIS | 1978