Autonomous flight control is a key technology for Unmanned Aerial Vehicles (UAVs). The model-based controller design approaches usually aim at concrete vehicles, and the controllers developed lack universality. Reinforcement learning provides a general controller design paradigm that is adaptive, optimal, model-free and widely applicable. It is a promising way to realize the intelligent control, allowing for easy automation of the controller design. Compared with the 3 Degree-of-Freedom (DOF) flight, the 6 DOF model accurately characterizes the real flight of aircrafts while the implementation of intelligent control is more difficult. Based on the Deep Reinforcement Learning (DRL) for the multi-dimensional continuous state inputs and continuous action outputs problems, this paper summarizes the 6 DOF reinforcement learning controller design for two typical aircrafts of multi-rotor and fixed-wing, including the hovering maneuver control and forward flight control for the quadrotor, and the cruise control and the Cobra post-stall maneuver control for the fixed-wing aircraft. It is shown that the intelligent controllers learn the control law of specific tasks without the model information, and they perform well with desired flexibility and robustness. The resulting end-to-end intelligent controller may realize the integrated optimal control, avoiding the traditional dual-loop structure regarding the trajectory and attitude control. This is advantageous to the exploitation of the nonlinear effects including the inertia coupling and the aerodynamics.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    6-DOF Reinforcement Learning Control for Multi-rotor and Fixed-Wing Aircrafts


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Fu, Wenxing (editor) / Gu, Mancang (editor) / Niu, Yifeng (editor) / Sheng, Zhang (author) / Pan, Zhou (author) / Jiale, Quan (author) / Yang, He (author) / Jiangtao, Huang (author) / Weijun, Hu (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2022 ; Xi'an, China September 23, 2022 - September 25, 2022



    Publication date :

    2023-03-10


    Size :

    16 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Multi-rotor aircrafts

    ZHANG RUI | European Patent Office | 2022

    Free access

    AIRFOILS FOR ROTOR BLADES OF ROTARY WING AIRCRAFTS

    KLEIN ALEXANDER / ILLG JONAS / LUTZ THORSTEN et al. | European Patent Office | 2017

    Free access

    Airfoils for rotor blades of rotary wing aircrafts

    KLEIN ALEXANDER / GUDE JONAS / LUTZ THORSTEN et al. | European Patent Office | 2018

    Free access

    AIRFOILS FOR ROTOR BLADES OF ROTARY WING AIRCRAFTS

    KLEIN ALEXANDER / ILLG JONAS / LUTZ THORSTEN et al. | European Patent Office | 2017

    Free access

    AIRFOILS FOR ROTOR BLADES OF ROTARY WING AIRCRAFTS

    KLEIN ALEXANDER / ILLG JONAS / LUTZ THORSTEN et al. | European Patent Office | 2017

    Free access