This paper addresses the challenge of docking an Autonomous Underwater Vehicle (AUV) under realistic conditions. Traditional model-based controllers are often constrained by the complexity and variability of the ocean environment. To overcome these limitations, we propose a Deep Reinforcement Learning (DRL) approach to manage the homing and docking maneuver. First, we define the proposed docking task in terms of its observations, actions, and reward function, aiming to bridge the gap between theoretical DRL research and docking algorithms tested on real vehicles. Additionally, we introduce a novel observation space that combines raw noisy observations with filtered data obtained using an Extended Kalman Filter (EKF). We demonstrate the effectiveness of this approach through simulations with various DRL algorithms, showing that the proposed observations can produce stable policies in fewer learning steps, outperforming not only traditional control methods but also policies obtained by the same DRL algorithms in noise-free environments.


    Access

    Download


    Export, share and cite



    Title :

    Autonomous Underwater Vehicle Docking Under Realistic Assumptions Using Deep Reinforcement Learning


    Contributors:


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning

    Anderlini, E / Parker, GG / Thomas, G | BASE | 2019

    Free access

    Autonomous Underwater Vehicle Docking

    Bellingham, James G. | Springer Verlag | 2016


    Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

    Patil, Mihir / Wehbe, Bilal / Valdenegro-Toro, Matias | ArXiv | 2021

    Free access

    UNDERWATER DOCKING SYSTEM FOR AUTONOMOUS UNDERWATER VEHICLE

    SAKAUE HIROSHI / MUKAIDA MINEHIKO / OKAYA NORIYUKI et al. | European Patent Office | 2018

    Free access

    AUV (Autonomous Underwater Vehicle) underwater docking device

    SHUI / LIU YUN / MOU CHUNXIAO et al. | European Patent Office | 2024

    Free access