In this paper, a novel guidance law based on a reinforcement learning (RL) algorithm is presented to deal with the maneuvering target interception problem using a deep deterministic policy gradient descent neural network. We take the missile’s line-of-sight (LOS) rate as the observation of the RL algorithm and propose a novel reward function, which is constructed with the miss distance and LOS rate to train the neural network off-line. In the guidance process, the trained neural network has the capacity of mapping the missile’s LOS rate to the normal acceleration of the missile directly, so as to generate guidance commands in real time. Under the actor-critic (AC) framework, we adopt the twin-delayed deep deterministic policy gradient (TD3) algorithm by taking the minimum value between a pair of critics to reduce overestimation. Simulation results show that the proposed TD3-based RL guidance law outperforms the current state of the RL guidance law, has better performance to cope with continuous action and state space, and also has a faster convergence speed and higher reward. Furthermore, the proposed RL guidance law has better accuracy and robustness when intercepting a maneuvering target, and the LOS rate is converged.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Intercept Guidance of Maneuvering Targets with Deep Reinforcement Learning


    Beteiligte:
    Zhe Hu (Autor:in) / Liang Xiao (Autor:in) / Jun Guan (Autor:in) / Wenjun Yi (Autor:in) / Hongqiao Yin (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Optimal Intercept of Maneuvering Targets

    R. E. Dickson | NTIS | 1969


    Optimal Effort Intercept against Two Maneuvering Targets

    Weiss, Martin / Shima, Tal | British Library Conference Proceedings | 2018


    Deep Reinforcement Learning-based Optimal Time-constrained Intercept Guidance

    Sinha, Abhinav / White, Devin / Cao, Yongcan | AIAA | 2024


    Relative impact angle control guidance law to intercept maneuvering target

    Kim, Hyun-Seung / Park, Sang-Sup / Ryoo, Chang-Kyung | IEEE | 2015


    High-dynamic intelligent maneuvering guidance strategy via deep reinforcement learning

    Zhao, Sibo / Zhu, Jianwen / Bao, Weimin et al. | SAGE Publications | 2023