Deep reinforcement learning has been applied to the control of flocking tasks for fixed-wing Unmanned Aerial Vehicles (UAVs) with successful results. However, previous research has given less attention to the design of flocking rewards, and the underlying mechanism of these rewards remains unclear. In this paper, we analyze the underlying mechanism of the flocking reward, and propose the leader-guided C-S reward to guide the fixed-wing UAV flock in a leader-follower structure, and prove that it is bounded when time is limited, which can avoid the gradient exploding problem. Additionally, we propose a collision-free fixed-wing UAV flocking system that uses multi-agent deep deterministic policy gradient to alleviate the non-stationary environment. The proposed system is simulate in 3 and 6 follower scenarios, and the results validate that it effectively controls UAV flocking.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Collision-Free UAV Flocking System with Leader-Guided Cucker-Smale Reward Based on Reinforcement Learning


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Qu, Yi (Herausgeber:in) / Gu, Mancang (Herausgeber:in) / Niu, Yifeng (Herausgeber:in) / Fu, Wenxing (Herausgeber:in) / Guo, Yunxiao (Autor:in) / Xu, Dan (Autor:in) / Wang, Chang (Autor:in) / Tan, Letian (Autor:in) / Shi, Shufeng (Autor:in) / Zhang, Wanchao (Autor:in)

    Kongress:

    International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023



    Erscheinungsdatum :

    23.04.2024


    Format / Umfang :

    14 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Extension of the Cucker-Smale Control Law to Space Flight Formations

    Perea, Laura / Gómez, Gerard / Elosegui, Pedro | AIAA | 2009



    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | AIAA | 2023


    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis et al. | ArXiv | 2022

    Freier Zugriff

    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | TIBKAT | 2023