Abstract This work develops a deep reinforcement learning based approach for Six Degree-of-Freedom (DOF) planetary powered descent and landing. Future Mars missions will require advanced guidance, navigation, and control algorithms for the powered descent phase to target specific surface locations and achieve pinpoint accuracy (landing error ellipse <5 m radius). This requires both a navigation system capable of estimating the lander’s state in real-time and a guidance and control system that can map the estimated lander state to a commanded thrust for each lander engine. In this paper, we present a novel integrated guidance and control algorithm designed by applying the principles of reinforcement learning theory. The latter is used to learn a policy mapping the lander’s estimated state directly to a commanded thrust for each engine, resulting in accurate and almost fuel-optimal trajectories over a realistic deployment ellipse. Specifically, we use proximal policy optimization, a policy gradient method, to learn the policy. Another contribution of this paper is the use of different discount rates for terminal and shaping rewards, which significantly enhances optimization performance. We present simulation results demonstrating the guidance and control system’s performance in a 6-DOF simulation environment and demonstrate robustness to noise and system parameter uncertainty.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep reinforcement learning for six degree-of-freedom planetary landing


    Contributors:

    Published in:

    Advances in Space Research ; 65 , 7 ; 1723-1741


    Publication date :

    2019-12-27


    Size :

    19 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    FUEL-EFFICIENT DEEP REINFORCEMENT LEARNING FOR PLANETARY LANDING

    Linares, Richard / Gaudet, Brian / Furfaro, Roberto | TIBKAT | 2020


    LEARNING TRANSFERABLE POLICIES FOR AUTONOMOUS PLANETARY LANDING VIA DEEP REINFORCEMENT LEARNING

    Ciabatti, Giulia / Daftry, Shreyansh / Capobianco, Roberto | TIBKAT | 2021


    Learning Transferable Policies for Autonomous Planetary Landing via Deep Reinforcement Learning

    Ciabatti, Giulia / Daftry, Shreyansh / Capobianco, Roberto | AIAA | 2021



    Adaptive generalized ZEM-ZEV feedback guidance for planetary landing via a deep reinforcement learning approach

    Furfaro, Roberto / Scorsoglio, Andrea / Linares, Richard et al. | Elsevier | 2020