Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this article. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following


    Beteiligte:
    Ma, Dongfang (Autor:in) / Chen, Xi (Autor:in) / Ma, Weihao (Autor:in) / Zheng, Huarong (Autor:in) / Qu, Fengzhong (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-01-01


    Format / Umfang :

    5238858 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Deep Reinforcement Learning for Concentric Tube Robot Path Following

    Iyengar, Keshav / Spurgeon, Sarah / Stoyanov, Danail | BASE | 2023

    Freier Zugriff

    Three-Dimensional Path-Following Control of a Robotic Airship with Reinforcement Learning

    Chunyu Nie / Zewei Zheng / Ming Zhu | DOAJ | 2019

    Freier Zugriff

    Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning

    Xiaoru Zhao / Rennong Yang / Liangsheng Zhong et al. | DOAJ | 2024

    Freier Zugriff


    Reinforcement Learning-based Path Following Control for a Vehicle with Variable Delay in the Drivetrain

    Ultsch, Johannes / Mirwald, Jonas / Brembeck, Jonathan et al. | IEEE | 2020