With the development of intelligent airforce combat, deep reinforcement learning (DRL) has been widely applied in various combat systems. Among these systems, the hybrid system of the manned aerial vehicle (MAV) and unmanned aerial vehicle (UAV) with cooperative combat mode shows bright foreground. However, the heterogeneity and dynamics in the formation pose challenges to the cooperative combat planning algorithm. To this end, this paper proposes an intelligent MAV-UAV cooperative combat planning method based on discretized proximal policy optimization (PPO). A 5×5 rule-based action space is constructed based on the knowledge of air combat. The state space and the corresponding reward function are introduced to stably train the policy. In contrast to other continuous DRL methods and multi-agent DRL, the proposed method is easier to be reproduced and be trained, and the defined rule-based formation actions can be expanded to suit other scenes. The feasibility and effectiveness of the proposed planning method are validated by numerical experiments based on the XSimStudio.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    An Intelligent MAV-UAV Cooperative Combat Planning Method Based on Deep Reinforcement Learning


    Beteiligte:
    Hu, Tingchun (Autor:in) / Li, Peng (Autor:in) / Yuan, Honghao (Autor:in) / Han, Yangnanbing (Autor:in) / Wang, Xiaohan (Autor:in) / Xie, Kunyu (Autor:in)


    Erscheinungsdatum :

    09.12.2022


    Format / Umfang :

    1141201 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-UAV Cooperative Offensive Combat Intelligent Planning Based on Deep Reinforcement Learning

    LI Junsheng / YUE Longfei / ZUO Jialiang et al. | DOAJ | 2022

    Freier Zugriff

    Deep Reinforcement Learning-based Intelligent Agent for Autonomous Air Combat

    Yoo, Jaewoong / Seong, Hyunki / Shim, David Hyunchul et al. | IEEE | 2022


    Research on intelligent combat decision making based on deep reinforcement learning

    Wang, Yao / Chen, Qijie / Ma, Haiqiang et al. | SPIE | 2023


    Cooperative Planning for an Unmanned Combat Aerial Vehicle Fleet Using Reinforcement Learning

    Yuksek, Burak / Umut Demirezen, Mustafa / Inalhan, Gokhan et al. | AIAA | 2021

    Freier Zugriff