Traditional guidance algorithms for hypersonic glide vehicles face the challenge of real-time requirements and robustness to multiple deviations or tasks. In this paper, an intelligent online multiconstrained reentry guidance is proposed to strikingly reduce computational burden and enhance the effectiveness with multiple constraints. First, the simulation environment of reentry including dynamics, multiconstraints, and control variables is built. Different from traditional decoupling methods, the bank angle command including its magnitude and sign is designed as the sole guidance variable. Secondly, a policy neural network is designed to output end-to-end guidance commands. By transforming the reentry process into a Markov Decision Process (MDP), the policy network can be trained by deep reinforcement learning (DRL). To address the sparse reward issue caused by multiconstraints, the improved Hindsight Experience Replay (HER) method is adaptively combined with Deep Deterministic Policy Gradient (DDPG) algorithm by transforming multiconstraints into multigoals. As a result, the novel training algorithm can realize higher utilization of failed data and improve the rate of convergence. Finally, simulations for typical scenes show that the policy network in the proposed guidance can output effective commands in much less time than the traditional method. The guidance is robust to initial bias, different targets, and online aerodynamic deviation.


    Access

    Download


    Export, share and cite



    Title :

    Intelligent Online Multiconstrained Reentry Guidance Based on Hindsight Experience Replay


    Contributors:
    Qingji Jiang (author) / Xiaogang Wang (author) / Yuliang Bai (author) / Yu Li (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Failed Goal Aware Hindsight Experience Replay

    Kim, Taeyoung / Jeong, Haechan / Har, Dongsoo | Springer Verlag | 2024


    Multiconstrained Real-Time Entry Guidance Using Deep Neural Networks

    Cheng, Lin / Jiang, Fanghua / Wang, Zhenbo et al. | IEEE | 2021