A two-loop acceleration autopilot is designed using the twin-delayed deep deterministic policy gradient (TD3) strategy to avoid the tedious design process of conventional tactical missile acceleration autopilots and the difficulty of meeting the performance requirements of the full flight envelope. First, a deep reinforcement learning model for the two-loop autopilot is developed. The flight state information serves as the state, the to-be-designed autopilot control parameters serve as the action, and a reward mechanism based on the stability margin index is designed. The TD3 strategy is subsequently used to offline learn the control parameters for the entire flight envelope. An autopilot control parameter fitting model that can be directly applied to the guidance loop is obtained. Finally, the obtained fitting model is combined with the impact angle constraint in the guidance system and verified online. The simulation results demonstrate that the autopilot based on the TD3 strategy can self-adjust the control parameters online based on the real-time flight state, ensuring system stability and achieving accurate acceleration command tracking.


    Access

    Download


    Export, share and cite



    Title :

    Two-Loop Acceleration Autopilot Design and Analysis Based on TD3 Strategy


    Contributors:
    Junfang Fan (author) / Denghui Dou (author) / Yi Ji (author) / Ning Liu (author) / Shiwei Chen (author) / Huajie Yan (author) / Junxian Li (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Control Limitations on Static Unstable Airframe Using Two-Loop Acceleration Autopilot

    Wang, Jiang ;Lin, De Fu ;Fan, Jun Fang | Trans Tech Publications | 2011


    Three-loop autopilot of spinning missiles

    Li, Keyong / Yang, Shuxing / Zhao, Liangyu | SAGE Publications | 2014


    Three-loop autopilot of spinning missiles

    Li, Keyong | Online Contents | 2014


    Sequential Loop Closure Based Adaptive Autopilot Design for a Hypersonic Vehicle

    Wiese, Daniel P. / Annaswamy, Anuradha M. / Muse, Jonathan A. et al. | AIAA | 2016