Ducted-fan tail-sitter unmanned aerial vehicles (UAVs) provide versatility and unique benefits, attracting significant attention in various applications. This study focuses on developing a safe reinforcement learning method for back-transition control between level flight mode and hover mode for ducted-fan tail-sitter UAVs. Our method enables transition control with a minimal altitude change and transition time while adhering to the velocity constraint. We employ the Trust Region Policy Optimization, Proximal Policy Optimization with Lagrangian, and Constrained Policy Optimization (CPO) algorithms for controller training, showcasing the superiority of the CPO algorithm and the necessity of the velocity constraint. The transition trajectory achieved using the CPO algorithm closely resembles the optimal trajectory obtained via the well-known GPOPS-II software with the SNOPT solver. Meanwhile, the CPO algorithm also exhibits strong robustness under unknown perturbations of UAV model parameters and wind disturbance.


    Access

    Download


    Export, share and cite



    Title :

    Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs


    Contributors:
    Yanbo Fu (author) / Wenjie Zhao (author) / Liu Liu (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Parameter Identification and Attitude Control of Ducted Fan UAVs

    Nan, Yi ;Wang, Chang Hong ;Yi, Guo Xing | Trans Tech Publications | 2014


    Improving Control System Effectiveness for Ducted Fan VTOL UAVs Operating in Crosswinds

    Fleming, Jonathan / Jones, Troy / Ng, Wing et al. | AIAA | 2003


    IMPROVING CONTROL SYSTEM EFFECTIVENESS FOR DUCTED FAN VTOL UAVS OPERATING IN CROSSWINDS

    Fleming, J. / Jones, T. / Ng, W. et al. | British Library Conference Proceedings | 2003


    Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs

    Zhen, Yan / Hao, Mingrui / Sun, Wendi | IEEE | 2020