The aircraft deep-stall phenomenon is caused by an angle of attack (AOA) that stabilizes at an equilibrium point of high AOA. This excessive AOA leads to a reduction in the lift, as well as a decrease in the elevator efficiency, making it difficult to recover the aircraft out of this very dangerous flight condition. Reinforcement learning (RL) methods offer a design approach for such complex nonlinear control problems. However, during deep-stall recovery tasks, the nonlinearity of the aircraft model is high, and the control efficiency is substantially reduced, hence limiting the application of direct RL methods. To address this problem, we conduct bifurcation and phase plane analyses on the deep-stall model of the aircraft, and use the results as domain knowledge to construct the reward function. Then, we apply the proximal policy optimization algorithm to the deep-stall strategy. Finally, in the simulation, we compare the method with feedback shaping with the RL method without feedback shaping. The simulation results indicate that although the former method recovers the aircraft at the AOA, its uncontrollable state renders this an unsuccessful recovery. Meanwhile, the proposed method stably performs deep-stall recovery tasks through a loop maneuver.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Application of Reinforcement Learning in Deep-Stall Recovery


    Contributors:
    Ming, Ruichen (author) / Liu, Xiaoxiong (author) / Xu, Xinlong (author) / Li, Yu (author) / Zhang, Weiguo (author)

    Published in:

    Publication date :

    2025-08-01


    Size :

    3020820 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Optimal Stall Recovery via Deep Reinforcement Learning for a General Aviation Aircraft

    Grillo, Agustin / Torre, Gabriel / Bunge, Roberto | AIAA | 2024


    Automated Aircraft Stall Recovery using Reinforcement Learning and Supervised Learning Techniques

    Singh Tomar, Dheerenrda / Gauci, Jason / Dingli, Alexiei et al. | IEEE | 2021


    Aircraft deep stall analysis and recovery

    GOUSMAN, K. / LOSCHKE, R. / ROONEY, R. et al. | AIAA | 1991


    Stall recovery

    Canaday, Henry | Online Contents | 2017


    STALL RECOVERY

    Henry Canaday | Online Contents | 2017