Flocking with multiple unmanned aerial vehicles (UAVs) offers significant potential for diverse applications due to its enhanced maneuverability, improved efficiency, and increased robustness. Collision avoidance is a critical and challenging issue for distributed flocking control with a UAV fleet, especially in dynamic environments with varying numbers of non-cooperative intruders. However, existing reinforcement learning based methods mainly focus on flocking with collision avoidance tasks with static obstacles and a fixed number of UAVs. In this article, we propose a scalable multi-agent reinforcement learning based method to solve the distributed flocking with collision avoidance problem for a scalable fleet of fixed-wing UAVs in dynamic environments. Specifically, we cast this problem in a decentralized partially observable Markov decision process framework and propose a scalable multi-agent reinforcement learning algorithm called spatial-temporal attention multi-agent actor-critic (STAAC). In this algorithm, we design a spatial-temporal attention based population-invariant network architecture to facilitate the representation learning of dynamic dimensional observations. By integrating the local spatial attention and global temporal attention mechanisms, STAAC is able to adapt to the changes in the scale of UAV fleets and the number of intruders. Finally, we empirically demonstrate the effectiveness, scalability, and adaptability of the proposed approach in numerical simulations and hardware-in-the-loop experiments.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-Agent Reinforcement Learning With Spatial–Temporal Attention for Flocking With Collision Avoidance of a Scalable Fixed-Wing UAV Fleet


    Beteiligte:
    Yan, Chao (Autor:in) / Wang, Chang (Autor:in) / Zhou, Han (Autor:in) / Xiang, Xiaojia (Autor:in) / Wang, Xiangke (Autor:in) / Shen, Lincheng (Autor:in)


    Erscheinungsdatum :

    01.02.2025


    Format / Umfang :

    3333564 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Rear-End Collision Avoidance Using Multi-Agent Deep Reinforcement Learning

    Perera, Ranuja / Arawwala, Surith / Harshamali, Shalika et al. | IEEE | 2024


    Inter-UAV Collision Avoidance using Deep-Q-Learning in Flocking Environment

    Raja, Gunasekaran / Anbalagan, Sudha / Narayanan, Vikraman Sathiya et al. | IEEE | 2019


    Hybrid Flocking Control Algorithm for Fixed-Wing Aircraft

    Sun, Dawei / Kwon, Cheolhyeon / Hwang, Inseok | AIAA | 2019