In this paper, the conventional aero-engine acceleration control task is formulated into a Markov Decision Process (MDP) problem. Then, a novel phase-based reward function is proposed to enhance the performance of deep reinforcement learning (DRL) in solving feedback control tasks. With that reward function, an aero-engine controller based on Trust Region Policy Optimization (TRPO) is developed to improve the aero-engine acceleration performance. Four comparison simulations were conducted to verify the effectiveness of the proposed methods. The simulation results show that the phase-based reward function helps to eliminate the oscillation problem of the aero-engine control system, which is caused by the traditional goal-based reward function when DRL is applied to the aero-engine control. And the TRPO controller outperforms deep Q-learning (DQN) and the proportional-integral-derivative (PID) in the aero-engine acceleration control task. Compared to DQN and PID controller, the acceleration time of aero-engine is decreased by 0.6 and 2.58 s, respectively, and the aero-engine acceleration performance is improved by 16.8 and 46.4% each.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Aero-engine acceleration control using deep reinforcement learning with phase-based reward function


    Beteiligte:
    Hu, Qian-Kun (Autor:in) / Zhao, Yong-Ping (Autor:in)


    Erscheinungsdatum :

    2022-07-01


    Format / Umfang :

    17 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Blade sequencing optimization of aero-engine based on deep reinforcement learning

    Sun, Chuanzhi / Wu, Huilin / Lu, Qing et al. | Elsevier | 2023


    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | AIAA | 2023


    Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System

    Cone, Cooper / Owen, Michael / Alvarez, Luis E. et al. | TIBKAT | 2023


    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | IET | 2021

    Freier Zugriff

    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | Wiley | 2020

    Freier Zugriff