This paper proposes a method to study unmanned aerial vehicles (UAV) maneuvering decision in air combat based on deterministic policy gradient. Aiming at the problem of decision space continuity, based on reinforcement learning theory, the Deep Deterministic Policy Gradient (DDPG) algorithm architecture is used to overcome the dimensional catastrophe caused by the discretization of decision variables and achieve air combat decisions in a continuous decision space for the problem of continuous decision space. In the design of the reward function, based on the traditional distance and angle evaluation factors, the energy function is added to improve the accuracy of the reward function for air combat situation description. Through autonomous reinforcement learning training, UAV gradually learns to acquire strategies for air combat decision making without the priori knowledge, which enables UAV to gain maneuver dominance advantage in air combat. Simulation experiments show that based on the algorithm model proposed in this paper, UAV can conduct the autonomous learning process, complete the air combat maneuver decision and obtain the dominance advantage according to the air combat maneuver decision-making environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Maneuver decision of UAV in air combat based on deterministic policy gradient *


    Contributors:
    Guo, Junxiao (author) / Wang, Zihan (author) / Lan, Jun (author) / Dong, Bingchen (author) / Li, Ran (author) / Yang, Qiming (author) / Zhang, Jiandong (author)


    Publication date :

    2022-06-27


    Size :

    1249121 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Research on MAV-UAV cooperative air combat maneuver decision

    LIU Bo / WEI Xiaolong / QU Hong et al. | DOAJ | 2023

    Free access


    Path-Game Hybrid Decision Strategy for UAV Air Combat Maneuver

    Jiaqi, Yang / Xusheng, Gan / Chenglong, Wu et al. | IEEE | 2023



    Maneuver Decision of Cooperative Air Combat within Visual Range Based on MATD3

    Zhang Dong, Tang Junlin, Xiong Wei, Ren Zhi, Yang Shuheng | DOAJ | 2023

    Free access