This study presents an innovative reinforcement-learning-based control algorithm for a vertical take-off and landing (VTOL) aircraft under wind disturbances. In our approach, the tracking control problem of the VTOL aircraft is formulated as a Markov decision process, and the appropriate system state, reward function, and soft update method are presented. To improve the control accuracy under wind disturbances, three kinds of wind fields were added in the learning environment to expand the exploration space and simulate the effect of wind disturbances on the flight control. Moreover, to ensure the tracking accuracy and the practical implementation, a quantum-inspired experience replay strategy was developed based on quantum computation theory. In this strategy, the preparation operation scheme was designed to encourage the exploration and speed up the convergence. The depreciation operation method was developed to enrich the sample diversity, which increased the robustness of the controller and allowed the control strategy learned in the numerical simulations to be directly transferred into real-world environments. Numerical simulations, hardware-in-the-loop experiments, and real-world flight experiments were conducted to evaluate the performance and merits of the proposed method. The results demonstrated high accuracy and effectiveness and good robustness of the proposed control algorithm in terms of standoff target tracking control and flight stability.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Target Tracking Control of UAV Through Deep Reinforcement Learning


    Contributors:
    Ma, Bodi (author) / Liu, Zhenbao (author) / Zhao, Wen (author) / Yuan, Jinbiao (author) / Long, Hao (author) / Wang, Xiao (author) / Yuan, Zhirong (author)


    Publication date :

    2023-06-01


    Size :

    3117819 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Deep-Reinforcement-Learning-Based Radar Parameter Adaptation for Multiple-Target Tracking

    Huang, Yongbing / Guo, Rui / Zhang, Yue et al. | IEEE | 2024


    Deep Reinforcement Learning Controller for Autonomous Tracking of Evasive Ground Target

    Wijk, David Van / Eves, Kameron J. / Valasek, John | TIBKAT | 2023


    Deep Reinforcement Learning Controller for Autonomous Tracking of Evasive Ground Target

    van Wijk, David / Eves, Kameron J. / Valasek, John | AIAA | 2023


    Deep Reinforcement Learning Based Tractor-Trailer Tracking Control

    Kang, Qi / Hartmannsgruber, Andreas / Tan, Sze-Hui et al. | IEEE | 2024