Solving optimal control problems serves as the basic demand of industrial control tasks. Existing methods like model predictive control often suffer from heavy online computational burdens. Reinforcement learning has shown promise in computer and board games but has yet to be widely adopted in industrial applications due to a lack of accessible, high-accuracy solvers. Current Reinforcement learning (RL) solvers are often developed for academic research and require a significant amount of theoretical knowledge and programming skills. Besides, many of them only support Python-based environments and limit to model-free algorithms. To address this gap, this paper develops General Optimal control Problems Solver (GOPS), an easy-to-use RL solver package that aims to build real-time and high-performance controllers in industrial fields. GOPS is built with a highly modular structure that retains a flexible framework for secondary development. Considering the diversity of industrial control tasks, GOPS also includes a conversion tool that allows for the use of Matlab/Simulink to support environment construction, controller design, and performance validation. To handle large-scale problems, GOPS can automatically create various serial and parallel trainers by flexibly combining embedded buffers and samplers. It offers a variety of common approximate functions for policy and value functions, including polynomial, multilayer perceptron, convolutional neural network, etc. Additionally, constrained and robust algorithms for special industrial control systems with state constraints and model uncertainties are also integrated into GOPS. Several examples, including linear quadratic control, inverted double pendulum, vehicle tracking, humanoid robot, obstacle avoidance, and active suspension control, are tested to verify the performances of GOPS.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    GOPS: A general optimal control problem solver for autonomous driving and industrial control applications


    Beteiligte:
    Wenxuan Wang (Autor:in) / Yuhang Zhang (Autor:in) / Jiaxin Gao (Autor:in) / Yuxuan Jiang (Autor:in) / Yujie Yang (Autor:in) / Zhilong Zheng (Autor:in) / Wenjun Zou (Autor:in) / Jie Li (Autor:in) / Congsheng Zhang (Autor:in) / Wenhan Cao (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    A 100 GOPS vision platform for intelligent vehicles

    Techmer, A. / Bruls, N. / Hachmann, U. et al. | IEEE | 2003


    AUTONOMOUS DRIVING CONTROL DEVICE, AUTONOMOUS DRIVING CONTROL SYSTEM, AND AUTONOMOUS DRIVING CONTROL METHOD

    AKARI NARIHIRO / NAKAMURA MASAHIDE / WATANABE MAKI et al. | Europäisches Patentamt | 2023

    Freier Zugriff



    Autonomous Driving Control Apparatus and Autonomous Driving Control Method

    TAKAHAMA TAKU | Europäisches Patentamt | 2019

    Freier Zugriff