The control of helicopters, especially full-scaled helicopters, is widely regarded as a challenging problem because of its highly nonlinear dynamics. This paper describes a trial to hover the full-scaled helicopter via the deep reinforcement learning (DRL) method. Unlike previous related works, we train the controller in a model-free way. First, a nonlinear six degrees-of-freedom (DOF) dynamics model of the full-scaled UH-60 Black Hawk helicopter is established with mechanism modeling and flight experimental data. With the dynamics model, we build a numeric simulation environment for training. Then, the interactions between the controller and the environment, including the observation, the reward function, and the action space are designed. The Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is applied to train the hovering controller, which takes around 6000 episodes to converge. Finally, the trained controller is tested by hovering experiments and further, a trajectory tracking task is carried out to validate the position control performance.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Hovering Control of Full-Scaled Helicopter Based on Deep Reinforcement Learning


    Beteiligte:
    Chen, Yushen (Autor:in) / Zhang, Bifeng (Autor:in) / Yin, Dengyu (Autor:in) / Bai, Chengchao (Autor:in) / Zheng, Hongxing (Autor:in) / Guo, Jifeng (Autor:in)


    Erscheinungsdatum :

    13.10.2023


    Format / Umfang :

    1264180 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    DEEP REINFORCEMENT LEARNING FOR EVTOL HOVERING CONTROL

    Alarcon, D. S. / Bidinotto, J. H. | British Library Conference Proceedings | 2022


    Helicopter hovering performance

    Britland, C.M. | Engineering Index Backfile | 1949


    Helicopter control and stability in hovering flight

    Miller, R.H. | Engineering Index Backfile | 1948


    Helicopter stability in hovering flight

    Payne, P.R. | Engineering Index Backfile | 1955


    Hovering model helicopter rotor testing

    Piziali, R. A. / Felker, F. F., III | NTRS | 1984