This paper explores a methodology that integrates the proportional integral derivative (PID) method with deep reinforcement learning (DRL). Constructing a compensatory controller using DRL to enhance the control performance of a PID controller. The proposed method is utilized in developing a fixed-wing unmanned aerial vehicle (UAV) flight controller to achieve longitudinal flight control. The compensatory controller is constructed using the Deep Deterministic Policy Gradient (DDPG) algorithm, tailored with a state-action space selection specifically designed for UAV dynamics and tracking targets. Meanwhile, the penalty term for tracking error and the sparse reward for completing the goal are introduced, and the construction scheme of the reward function is given. Simulation results demonstrate that the DRL-based compensatory controller can improve control performance when PID controller parameters are not optimally tuned to some extent, effectively eliminating pitch angle tracking overshoot and reducing setting time.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Longitudinal Control and Optimization of Fixed-Wing UAV Based on Deep Reinforcement Learning


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Yan, Liang (editor) / Duan, Haibin (editor) / Deng, Yimin (editor) / He, Haiyang (author) / Zhao, Zhengen (author) / Kong, Fei (author)

    Conference:

    International Conference on Guidance, Navigation and Control ; 2024 ; Changsha, China August 09, 2024 - August 11, 2024



    Publication date :

    2025-03-04


    Size :

    11 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    ONLINE REINFORCEMENT LEARNING FOR FIXED-WING AIRCRAFT LONGITUDINAL CONTROL

    Lee, Jun H. / Kampen, Erik-Jan Van | TIBKAT | 2021




    Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs

    Zhen, Yan / Hao, Mingrui / Sun, Wendi | IEEE | 2020


    Fixed-Wing Stalled Maneuver Control Technology Based on Deep Reinforcement Learning

    Hu, Weijun / Gao, Zhiqiang / Quan, Jiale et al. | IEEE | 2022