Robust and performant controllers are essential for industrial applications. However, deriving controller parameters for complex and nonlinear systems is challenging and time-consuming. To facilitate automatic controller parametrization, this work presents a novel approach using deep reinforcement learning (DRL) with N-dimensional B-spline geometries (BSGs). We focus on the control of parameter-variant systems, a class of systems with complex behavior which depends on the operating conditions. For this system class, gain-scheduling control structures are widely used in applications across industries due to well-known design principles. Facilitating the expensive controller parametrization task regarding these control structures, we deploy an DRL agent. Based on control system observations, the agent autonomously decides how to adapt the controller parameters. We make the adaptation process more efficient by introducing BSGs to map the controller parameters which may depend on numerous operating conditions. To preprocess time-series data and extract a fixed-length feature vector, we use a long short-term memory (LSTM) neural networks. Furthermore, this work contributes actor regularizations that are relevant to real-world environments which differ from training. Accordingly, we apply dropout layer normalization to the actor and critic networks of the truncated quantile critic (TQC) algorithm. To show our approach's working principle and effectiveness, we train and evaluate the DRL agent on the parametrization task of an industrial control structure with parameter lookup tables.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    ReACT: Reinforcement Learning for Controller Parametrization Using B-Spline Geometries


    Beteiligte:
    Rudolf, Thomas (Autor:in) / Flögel, Daniel (Autor:in) / Schürmann, Tobias (Autor:in) / Süß, Simon (Autor:in) / Schwab, Stefan (Autor:in) / Hohmann, Sören (Autor:in)

    Erscheinungsdatum :

    2024-02-11


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    620 / 629




    A Configurable B-Spline Parametrization Method for Structural Optimization of Wing Boxes

    Yu, T. / Martins, J. / American Institute of Aeronautics and Astronautics | British Library Conference Proceedings | 2008


    Adaptive neural controller based on convex parametrization

    Patkar, Abhishek. | BASE | 2020

    Freier Zugriff

    Splunk + React =

    Mysore, Aprameya | NTRS | 2021


    Robust Controller Design Using Parametrization of Stabilizing State Feedback Gains

    Ohara, A. / Masubuchi, I. / Suda, N. | British Library Online Contents | 1994