Communication is the cornerstone of UAV swarms to transmit information and achieve cooperation. However, artificially designed communication protocols usually rely on prior expert knowledge and lack flexibility and adaptability, which may limit the communication ability between UAVs and is not conducive to swarm cooperation. This paper adopts a new data-driven approach to study how reinforcement learning can be utilized to jointly learn the cooperative communication and action policies for UAV swarms. Firstly, the communication policy of a UAV is defined, so that the UAV can autonomously decide the content of the message sent out according to its real-time status. Secondly, neural networks are designed to approximate the communication and action policies of the UAV, and their policy gradient optimization procedures are deduced, respectively. Then, a reinforcement learning algorithm is proposed to jointly learn the communication and action policies of UAV swarms. Numerical simulation results verify that the policies learned by the proposed algorithm are superior to the existing benchmark algorithms in terms of multi-target tracking performance, scalability in different scenarios, and robustness under communication failures.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Joint Communication and Action Learning in Multi-Target Tracking of UAV Swarms with Deep Reinforcement Learning


    Beteiligte:
    Wenhong Zhou (Autor:in) / Jie Li (Autor:in) / Qingjie Zhang (Autor:in)


    Erscheinungsdatum :

    2022




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    Task Assignment of UAV Swarms Based on Deep Reinforcement Learning

    Bo Liu / Shulei Wang / Qinghua Li et al. | DOAJ | 2023

    Freier Zugriff


    Target Tracking Control of UAV Through Deep Reinforcement Learning

    Ma, Bodi / Liu, Zhenbao / Zhao, Wen et al. | IEEE | 2023


    Reinforcement Learning-Based Countermeasures Against Attacking UAV Swarms

    Simonjan, Jennifer / Harshina, Kseniia / Schranz, Melanie | IEEE | 2023