In this study, a fault tolerant controller is designed for a hexacopter with actuator faults using reinforcement learning method and extended state observer. The control system consists of an outer-loop controller, which is designed to track the horizontal position using a reinforcement learning scheme, and an inner-loop controller, which is designed to track the altitude and attitude using extended state observer and the baseline controller based on nonlinear dynamic inversion. Using integral reinforcement learning based on value iteration, the optimal control problem is solved for a partially known system model, with an assumption initial stabilizing control is not required. The disturbances due to the actuator faults are estimated by an extended state observer so that the generalized forces, the virtual controller, may be designed. An optimization-based constrained control allocation method is adopted to allocate the desired generalized forces to six rotors considering the saturation of the actuators. Numerical simulation is performed to demonstrate the effectiveness of the proposed controller for a 6-Degrees of Freedom hexacopter system.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Fault Tolerant Controller for Hexacopter Using Reinforcement Learning and Extended State Observer


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Lee, Sangchul (Herausgeber:in) / Han, Cheolheui (Herausgeber:in) / Choi, Jeong-Yeol (Herausgeber:in) / Kim, Seungkeun (Herausgeber:in) / Kim, Jeong Ho (Herausgeber:in) / Lee, Hanna (Autor:in) / Kim, Jinrae (Autor:in) / Kim, Seong-hun (Autor:in) / Kim, Miae (Autor:in) / Kim, Youdan (Autor:in)

    Kongress:

    Asia-Pacific International Symposium on Aerospace Technology ; 2021 ; Korea (Republic of) November 15, 2021 - November 17, 2021



    Erscheinungsdatum :

    2022-09-30


    Format / Umfang :

    14 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Hexacopter outdoor flight test results of an Extended State Observer based controller

    Heise, Christian D. / Falconi, Guillermo P. / Holzapfel, Florian | IEEE | 2014


    Hexacopter fault tolerant actuator allocation analysis for optimal thrust

    Pose, Claudio D. / Giribet, Juan I. / Ghersin, Alejandro S. | IEEE | 2017


    Control Allocation Switching Scheme for Fault Tolerant Control of Hexacopter

    Kim, Jinrae / Lee, Hanna / Kim, Seong-hun et al. | Springer Verlag | 2022


    Fault-Tolerant Control of a Hexacopter UAV based on Self-Scheduled Control Allocation

    Nguyen, Duc-Tien / Saussie, David / Saydy, Lahcen | IEEE | 2018


    Robust Waypoint Guidance of a Hexacopter on Mars using Meta-Reinforcement Learning

    Federici, Lorenzo / Furfaro, Roberto / Zavoli, Alessandro et al. | AIAA | 2023