Facing the future combat scenario with manned and unmanned aerial vehicle cooperation, real-time and accurate air combat decision-making is the basis of winning. The complex air environment, transient situation data, and multiple cumbersome combat tasks make coordinated combat with unmanned aerial vehicles a trend in future air combat, replacing single machine combat. However, multi-agent modeling and training processes face difficulties in reward allocation and network convergence. Air combat scenarios for 5v5 manned and unmanned aerial vehicle cooperation, the characteristic model of single agent is abstracted in this paper, and an algorithm based on proximal policy optimization is proposed to obtain the air combat decision sequence by using reward and punishment incentive in the real-time interaction with the environment. The simulation results show that the algorithm proposed in this paper can adapt to the complex battlefield situation and get a stable and reasonable decision-making strategy in continuous action space after training and learning.


    Access

    Download


    Export, share and cite



    Title :

    Research on air combat decision algorithm based on proximal policy optimization


    Contributors:
    ZHANG Bochao (author) / WEN Xiaoling (author) / LIU Lu (author) / ZHANG Yaqian (author) / WANG Hongguang (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Research on UAV Air Combat Maneuver Decision Based on Decision Tree CART Algorithm

    Liu, Haotian / Jin, Jiangfeng / Liu, Kun et al. | Springer Verlag | 2023


    Intelligent Air Combat Maneuvering Decision Based on TD3 Algorithm

    Xiaoyu, Zhou / Jiangtao, Huang / Zhe, Zhu et al. | Springer Verlag | 2023


    Reentry Trajectory Planning Based on Proximal Policy Optimization

    Shi, Xinyu / Deng, Honbin | Springer Verlag | 2024



    Maneuver decision of UAV in air combat based on deterministic policy gradient *

    Guo, Junxiao / Wang, Zihan / Lan, Jun et al. | IEEE | 2022