A two-loop acceleration autopilot is designed using the twin-delayed deep deterministic policy gradient (TD3) strategy to avoid the tedious design process of conventional tactical missile acceleration autopilots and the difficulty of meeting the performance requirements of the full flight envelope. First, a deep reinforcement learning model for the two-loop autopilot is developed. The flight state information serves as the state, the to-be-designed autopilot control parameters serve as the action, and a reward mechanism based on the stability margin index is designed. The TD3 strategy is subsequently used to offline learn the control parameters for the entire flight envelope. An autopilot control parameter fitting model that can be directly applied to the guidance loop is obtained. Finally, the obtained fitting model is combined with the impact angle constraint in the guidance system and verified online. The simulation results demonstrate that the autopilot based on the TD3 strategy can self-adjust the control parameters online based on the real-time flight state, ensuring system stability and achieving accurate acceleration command tracking.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Two-Loop Acceleration Autopilot Design and Analysis Based on TD3 Strategy


    Beteiligte:
    Junfang Fan (Autor:in) / Denghui Dou (Autor:in) / Yi Ji (Autor:in) / Ning Liu (Autor:in) / Shiwei Chen (Autor:in) / Huajie Yan (Autor:in) / Junxian Li (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Control Limitations on Static Unstable Airframe Using Two-Loop Acceleration Autopilot

    Wang, Jiang ;Lin, De Fu ;Fan, Jun Fang | Trans Tech Publications | 2011


    Three-loop autopilot of spinning missiles

    Li, Keyong / Yang, Shuxing / Zhao, Liangyu | SAGE Publications | 2014


    Three-loop autopilot of spinning missiles

    Li, Keyong | Online Contents | 2014


    Sequential Loop Closure Based Adaptive Autopilot Design for a Hypersonic Vehicle

    Wiese, Daniel P. / Annaswamy, Anuradha M. / Muse, Jonathan A. et al. | AIAA | 2016