Deep Reinforcement Learning (DRL) has been widely attempted for solving real-time intelligent aerial transportation vehicle motion planning tasks recently. When interacting with environment, DRL-driven aerial vehicles inevitably switch the steering actions in high frequency during both exploration and execution phase, resulting in the well known flight trajectory oscillation issue, which makes flight dynamics unstable, and even endangers flight safety in serious cases. Unfortunately, there is hardly any literature about achieving flight trajectory smoothness in DRL-based motion planning. In view of this, we originally formalize the practical flight trajectory smoothen problem as a three-level Nested pArameterized Smooth Trajectory Optimization (NASTO) form. On this basis, a novel Stable Auxiliary Gradient (SAG) algorithm is proposed, which significantly smoothens the DRL-generated flight motions by constructing two independent optimization aspects: the major gradient, and the stable auxiliary gradient. Experimental result reveals that the proposed SAG algorithm outperforms baseline DRL-based intelligent aerial transportation vehicle motion planning algorithms in terms of both learning efficiency and flight motion smoothness.
Learning Smooth Motion Planning for Intelligent Aerial Transportation Vehicles by Stable Auxiliary Gradient
IEEE Transactions on Intelligent Transportation Systems ; 23 , 12 ; 24464-24473
2022-12-01
2839542 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Motion Planning for a Slung Load Transportation System Using Rotary-Wing Aerial Vehicles
British Library Conference Proceedings | 2017
|Smooth Path Planning for Unmanned Aerial Vehicles with Airspace Restrictions
Online Contents | 2017
|Smooth Path Planning for Unmanned Aerial Vehicles with Airspace Restrictions
Online Contents | 2017
|Smooth Path Planning for Unmanned Aerial Vehicles with Airspace Restrictions
Online Contents | 2017
|