This paper addresses the challenge of docking an Autonomous Underwater Vehicle (AUV) under realistic conditions. Traditional model-based controllers are often constrained by the complexity and variability of the ocean environment. To overcome these limitations, we propose a Deep Reinforcement Learning (DRL) approach to manage the homing and docking maneuver. First, we define the proposed docking task in terms of its observations, actions, and reward function, aiming to bridge the gap between theoretical DRL research and docking algorithms tested on real vehicles. Additionally, we introduce a novel observation space that combines raw noisy observations with filtered data obtained using an Extended Kalman Filter (EKF). We demonstrate the effectiveness of this approach through simulations with various DRL algorithms, showing that the proposed observations can produce stable policies in fewer learning steps, outperforming not only traditional control methods but also policies obtained by the same DRL algorithms in noise-free environments.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Autonomous Underwater Vehicle Docking Under Realistic Assumptions Using Deep Reinforcement Learning


    Beteiligte:
    Narcís Palomeras (Autor:in) / Pere Ridao (Autor:in)


    Erscheinungsdatum :

    2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning

    Anderlini, E / Parker, GG / Thomas, G | BASE | 2019

    Freier Zugriff

    Autonomous Underwater Vehicle Docking

    Bellingham, James G. | Springer Verlag | 2016


    UNDERWATER DOCKING SYSTEM FOR AUTONOMOUS UNDERWATER VEHICLE

    SAKAUE HIROSHI / MUKAIDA MINEHIKO / OKAYA NORIYUKI et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

    Patil, Mihir / Wehbe, Bilal / Valdenegro-Toro, Matias | ArXiv | 2021

    Freier Zugriff

    AUV (Autonomous Underwater Vehicle) underwater docking device

    SHUI / LIU YUN / MOU CHUNXIAO et al. | Europäisches Patentamt | 2024

    Freier Zugriff