The control of helicopters, especially full-scaled helicopters, is widely regarded as a challenging problem because of its highly nonlinear dynamics. This paper describes a trial to hover the full-scaled helicopter via the deep reinforcement learning (DRL) method. Unlike previous related works, we train the controller in a model-free way. First, a nonlinear six degrees-of-freedom (DOF) dynamics model of the full-scaled UH-60 Black Hawk helicopter is established with mechanism modeling and flight experimental data. With the dynamics model, we build a numeric simulation environment for training. Then, the interactions between the controller and the environment, including the observation, the reward function, and the action space are designed. The Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is applied to train the hovering controller, which takes around 6000 episodes to converge. Finally, the trained controller is tested by hovering experiments and further, a trajectory tracking task is carried out to validate the position control performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Hovering Control of Full-Scaled Helicopter Based on Deep Reinforcement Learning


    Contributors:
    Chen, Yushen (author) / Zhang, Bifeng (author) / Yin, Dengyu (author) / Bai, Chengchao (author) / Zheng, Hongxing (author) / Guo, Jifeng (author)


    Publication date :

    2023-10-13


    Size :

    1264180 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    DEEP REINFORCEMENT LEARNING FOR EVTOL HOVERING CONTROL

    Alarcon, D. S. / Bidinotto, J. H. | British Library Conference Proceedings | 2022


    Helicopter hovering performance

    Britland, C.M. | Engineering Index Backfile | 1949


    Helicopter control and stability in hovering flight

    Miller, R.H. | Engineering Index Backfile | 1948


    Helicopter stability in hovering flight

    Payne, P.R. | Engineering Index Backfile | 1955


    Hovering model helicopter rotor testing

    Piziali, R. A. / Felker, F. F., III | NTRS | 1984