This paper proposes a ballistic missile maneuver strategy based on proximal policy optimization (PPO) reinforcement learning algorithm, which enables the ballistic missile to evade the interceptor in the midcourse. Firstly, the extra-atmospheric engagement process was modeled into a Markov Decision Process. The thrust of the ballistic missile is regarded as the action of the agent, and the energy consumption is regarded as the reward of the agent. Importantly, the observations only consist of the seeker angle and their rate of change with no range, velocity, and acceleration estimation, making it possible to applying to the passive seekers outside the atmosphere. Simulation shows that the ballistic missile agent based on PPO algorithm could evade the interceptor with a 100% success rate. Compared with traditional differential game methods, reinforcement learning-based methods could map the observations to the divert thruster command, which greatly reduces the time of real-time computation.
Ballistic Missile Midcourse Intelligent Maneuver Strategy Based on PPO Algorithm
Lect. Notes Electrical Eng.
International Conference on Guidance, Navigation and Control ; 2022 ; Harbin, China August 05, 2022 - August 07, 2022
2023-01-31
10 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch