Abstract This paper presents a feedback guidance algorithm for proximity operation in cislunar environment based on actor-critic reinforcement learning. The algorithm is lightweight, closed-loop, and capable of taking path constraints into account. The method relies on reinforcement learning to make the well known Zero-Effort-Miss/Zero-Effort-Velocity guidance state dependent and allow for path constraints to be directly embedded. The algorithm is tested in the circular restricted three-body problem (CRTBP) framework for Near Rectilinear Orbits (NRO) in the Earth-Moon system. It shows promising results in terminal guidance error and satisfies path constraints in constraint scenarios comprising spherical constraints and keep-out-spheres with approach corridors. Furthermore, this approach indicates that reinforcement learning can be effectively used to solve constrained relative spacecraft guidance problems in complex environments and thus can be effective for autonomous relative motion operations in the Earth-Moon dynamical environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Relative motion guidance for near-rectilinear lunar orbits with path constraints via actor-critic reinforcement learning


    Contributors:

    Published in:

    Advances in Space Research ; 71 , 1 ; 316-335


    Publication date :

    2022-08-02


    Size :

    20 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Actor-Critic Reinforcement Learning Approach to Relative Motion Guidance in Near-Rectilinear Orbit

    Scorsoglio, Andrea / Furfaro, Roberto / Linares, Richard et al. | TIBKAT | 2019




    Actor-Critic Reinforcement Learning for Control With Stability Guarantee

    Han, M / Zhang, L / Wang, J et al. | BASE | 2020

    Free access

    Heliocentric Escape and Lunar Impact from Near Rectilinear Halo Orbits

    Davis, Diane C. / Boudad, Kenza K. / Power, Rolfe J. et al. | NTRS | 2019