In this article, by employing a modular strategy and hybrid action reinforcement learning (RL), an intelligent 3-D entry trajectory planning approach is proposed to achieve online autonomous trajectory generation for any initial location and target within a large reachable area. To reduce training difficulty and enhance task adaptability, the modular design approach decomposes the entry trajectory problem into the bank and angle of attack (AOA) modules. The environment, with complete 3-D state space and entry dynamics, is established to train both modules, in which additional performance requirements are incorporated in the reward design, such as suppressing long-period oscillations and reducing reversal numbers. In the bank module, discrete-continuous hybrid action space is adopted to formulate the bank angle decision problem, which determines the sign and amplitude of the bank angle simultaneously, effectively avoiding the tradeoff between RL exploration difficulties and trajectory accuracy. Specifically, dueling hybrid twin delayed deep deterministic policy gradient algorithm is proposed to address the hybrid action problem and hence to train the 3-D bank module. Subsequently, the AOA module is trained to adjust the AOA profile to meet flight capability requirements. The simulations highlight the ability of our proposed algorithm to achieve autonomous robust trajectory planning in expansive reachable areas.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    3-D Autonomous Entry Trajectory Planning via Hybrid Action Reinforcement Learning


    Beteiligte:
    Peng, Gaoxiang (Autor:in) / Wang, Bo (Autor:in) / Liu, Lei (Autor:in) / Fan, Huijin (Autor:in)


    Erscheinungsdatum :

    01.02.2025


    Format / Umfang :

    6740265 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

    Naveed, Kaleb Ben / Qiao, Zhiqian / Dolan, John M. | IEEE | 2021




    Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces

    Williams, Kyle R. / Schlossman, Rachel / Whitten, Daniel et al. | IEEE | 2023