In this research, Koopman operator theory is employed to achieve faster training time and improved performance of a reinforcement learning (RL) based linear quadratic controller (LQ). The proposed methodology, called K-RLLQ, is implemented for the trajectory tracking problem of a quadrotor UAV. Using the evolution of analytically derived Koopman generalized eigenfunctions allows for the embedding of quadrotor nonlinear dynamics into a quasi-linear model. Specifically, the resulting Koopman based quadrotor dynamics has linear state matrix and state dependent control matrix. Additionally, the obtained formulation is fully actuated, hence, compared to traditional model based hierarchical control the advantages are twofold: i) the controller can be formulated using linear control strategies in Koopman formulation which will result in a nonlinear control law in the original state space; ii) the trajectory tracking task can be achieved through a single control loop. Using this formulation, an RL agent is trained to estimate the controller parameters of a linear quadratic control law. Notably, it is shown that, using a reward function and observation space based on Koopman generalized eigenfunctions over the state space, leads to a considerably faster training time and improved overall performances.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Koopman-Based Reinforcement Learning for LQ Control Gains Estimation of Quadrotors


    Beteiligte:


    Erscheinungsdatum :

    14.05.2025


    Format / Umfang :

    2918080 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Koopman-Based Model Predictive Control of Quadrotors

    Martini, Simone / Todde, Edoardo / Stefanovic, Margareta et al. | IEEE | 2025


    Koopman-Based Reduced Order Controller Design for Quadrotors

    Martini, Simone / Valavanis, Kimon P. / Stefanovic, Margareta et al. | IEEE | 2024


    Payload Transporting With Two Quadrotors by Centralized Reinforcement Learning Method

    Lin, Dasheng / Han, Jianda / Li, Kun et al. | IEEE | 2024



    Vision-Based Position Estimation with Markers For Quadrotors

    UZUNOGLU, Mucteba / SAHIN, Recep Behlul / MERCIMEK, Muharrem | IEEE | 2022