Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this article. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.
Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following
IEEE Transactions on Intelligent Vehicles ; 9 , 1 ; 893-904
2024-01-01
5238858 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Three-Dimensional Path-Following Control of a Robotic Airship with Reinforcement Learning
DOAJ | 2019
|Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
DOAJ | 2024
|