Deep reinforcement learning has been applied to the control of flocking tasks for fixed-wing Unmanned Aerial Vehicles (UAVs) with successful results. However, previous research has given less attention to the design of flocking rewards, and the underlying mechanism of these rewards remains unclear. In this paper, we analyze the underlying mechanism of the flocking reward, and propose the leader-guided C-S reward to guide the fixed-wing UAV flock in a leader-follower structure, and prove that it is bounded when time is limited, which can avoid the gradient exploding problem. Additionally, we propose a collision-free fixed-wing UAV flocking system that uses multi-agent deep deterministic policy gradient to alleviate the non-stationary environment. The proposed system is simulate in 3 and 6 follower scenarios, and the results validate that it effectively controls UAV flocking.
Collision-Free UAV Flocking System with Leader-Guided Cucker-Smale Reward Based on Reinforcement Learning
Lect. Notes Electrical Eng.
International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023
Proceedings of 3rd 2023 International Conference on Autonomous Unmanned Systems (3rd ICAUS 2023) ; Kapitel : 1 ; 1-14
23.04.2024
14 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Extension of the Cucker — Smale Control Law to Space Flight Formations
Online Contents | 2009
|Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System
ArXiv | 2022
|