Abstract Cooperative pursuit with multiple pursuers is critical in swarm missions. For example, in order to capture a faster-moving evader, it becomes necessary to deploy multiple unmanned aerial vehicles to form an encirclement and approach the evader. In this paper, a cooperative pursuit strategy is developed by utilizing reinforcement learning techniques and pursuit-evasion games. Firstly, we propose a novel surrounding algorithm to form a complete encirclement based on the dynamics of pursuit-evasion games. Based on this surrounding algorithm, we employ reinforcement learning techniques to train cooperative pursuit strategies to capture the evader by surrounding and approaching the evader. In pursuit-evasion games and other non-cooperative games, it is assumed that the opponent can model the others' behaviors, adapt its adversarial strategies, and exploit the others' weaknesses. The cooperative pursuit strategy needs to consider the adversarial strategies taken by the evader and counteract them. To address this issue, we employ a Deep Minimax Q-learning algorithm to simultaneously learn the evader's adversarial strategy and the cooperative pursuit strategy that cannot be exploited by the evader. Finally, we present extensive numerical simulations to evaluate the performance of the proposed learning-based cooperative pursuit strategy in various scenarios.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Cooperative pursuit with multiple pursuers based on Deep Minimax Q-learning


    Beteiligte:
    Ji, Mengda (Autor:in) / Xu, Genjiu (Autor:in) / Duan, Zekun (Autor:in) / Wang, Liying (Autor:in) / Li, Zesheng (Autor:in) / Ge, Jianjun (Autor:in) / Li, Mingqiang (Autor:in)


    Erscheinungsdatum :

    2024-01-23




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Cooperative Pursuit by Multiple Pursuers of a Single Evader

    Pachter, Meir / Moll, Alexander Von / Garcia, Eloy et al. | AIAA | 2020


    Robust Cooperative Pursuit-Evasion Problem for Multiple Evaders and Pursuers with Measuring Noise

    Shi, Weixiang / Wang, Chunyan / Wang, Jianan et al. | Springer Verlag | 2021


    Pursuit-evasion of an Evader by Multiple Pursuers

    Von Moll, Alexander / Casbeer, David W. / Garcia, Eloy et al. | IEEE | 2018