Deep reinforcement learning has been applied to the control of flocking tasks for fixed-wing Unmanned Aerial Vehicles (UAVs) with successful results. However, previous research has given less attention to the design of flocking rewards, and the underlying mechanism of these rewards remains unclear. In this paper, we analyze the underlying mechanism of the flocking reward, and propose the leader-guided C-S reward to guide the fixed-wing UAV flock in a leader-follower structure, and prove that it is bounded when time is limited, which can avoid the gradient exploding problem. Additionally, we propose a collision-free fixed-wing UAV flocking system that uses multi-agent deep deterministic policy gradient to alleviate the non-stationary environment. The proposed system is simulate in 3 and 6 follower scenarios, and the results validate that it effectively controls UAV flocking.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Collision-Free UAV Flocking System with Leader-Guided Cucker-Smale Reward Based on Reinforcement Learning


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Qu, Yi (editor) / Gu, Mancang (editor) / Niu, Yifeng (editor) / Fu, Wenxing (editor) / Guo, Yunxiao (author) / Xu, Dan (author) / Wang, Chang (author) / Tan, Letian (author) / Shi, Shufeng (author) / Zhang, Wanchao (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023



    Publication date :

    2024-04-23


    Size :

    14 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Extension of the Cucker-Smale Control Law to Space Flight Formations

    Perea, Laura / Gómez, Gerard / Elosegui, Pedro | AIAA | 2009



    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | AIAA | 2023


    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis et al. | ArXiv | 2022

    Free access

    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | TIBKAT | 2023