This paper investigates the active defense guidance problem for hypersonic vehicles in a target-interceptor-defender scenario. In this engagement, a target hypersonic vehicle with active defense attempts to evade the interceptor. Considering practical application scenarios, there always exist the observation noise, incomplete observation information, and uncertain interceptor’s guidance strategies simultaneously for the target hypersonic vehicle. These noises and uncertainties need to be handled by the active defense guidance. By regarding the active defense scenario as a partially observable Markov decision process, this paper proposes a novel guidance method with an adaptive dueling double deep Q-network (AD3QN) reinforcement learning algorithm. The AD3QN algorithm leverages a novel network fusion structure comprising a convolutional neural network (CNN) and a gated recurrent unit (GRU) network. Moreover, an incomplete information processing mechanism is proposed to deal with the noise and uncertainties in practical application scenarios. By utilizing CNN to extract features from the stacked data and integrating GRU, the AD3QN-based guidance enhances its ability for estimation and identification with incomplete time series information. Finally, numerical experiments are introduced to demonstrate the effectiveness and performance of the proposed active defense guidance.
Adaptive Active Defense Guidance for Hypersonic Vehicle with Incomplete Information Based on Reinforcement Learning
Lect. Notes Electrical Eng.
International Conference on Guidance, Navigation and Control ; 2024 ; Changsha, China August 09, 2024 - August 11, 2024
04.03.2025
11 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch