Underwater ROVs (Remotely Operated Vehicles) are unmanned submersible vehicles designed for exploring and operating in the depths of the ocean. Despite using high-end cameras, typical teleoperation engines based on first-person (egocentric) views limit a surface operator's ability to maneuver the ROV in complex deep-water missions. In this paper, we present an interactive teleoperation interface that enhances the operational capabilities via increased situational awareness. This is accomplished by (i) offering on-demand "third"-person (exocentric) visuals from past egocentric views, and (ii) facilitating enhanced peripheral information with augmented ROV pose information in real-time. We achieve this by integrating a 3D geometry-based Ego-to-Exo view synthesis algorithm into a monocular SLAM system for accurate trajectory estimation. The proposed closed-form solution only uses past egocentric views from the ROV and a SLAM backbone for pose estimation, which makes it portable to existing ROV platforms. Unlike data-driven solutions, it is invariant to applications and waterbody-specific scenes. We validate the geometric accuracy of the proposed framework through extensive experiments of 2-DOF indoor navigation and 6-DOF underwater cave exploration in challenging low-light conditions. A subjective evaluation on 15 human teleoperators further confirms the effectiveness of the integrated features for improved teleoperation. We demonstrate the benefits of dynamic Ego-to-Exo view generation and real-time pose rendering for remote ROV teleoperation by following navigation guides such as cavelines inside underwater caves. This new way of interactive ROV teleoperation opens up promising opportunities for future research in subsea telerobotics.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Ego-to-Exo: Interfacing Third Person Visuals from Egocentric Views in Real-time for Improved ROV Teleoperation


    Beteiligte:
    Abdullah, Adnan (Autor:in) / Chen, Ruo (Autor:in) / Rekleitis, Ioannis (Autor:in) / Islam, Md Jahidul (Autor:in)

    Erscheinungsdatum :

    2024


    Anmerkungen:

    V3, 9 pages


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    COSTLESS FOUR-WHEELED ROBOT TO CAPTURE REAL TIME VISUALS FOR MONITORING

    Alaiahgari Bramaiah, Sreeramdas / Gayaz, S.K. | BASE | 2017

    Freier Zugriff

    Teleoperation real-time following system and teleoperation real-time following method

    ZHANG FEI / HU BUQING / WANG JUN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Real-Time Egocentric Navigation Using 3D Sensing

    Smith, Justin S. / Feng, Shiyu / Lyu, Fanzhe et al. | Springer Verlag | 2019


    Advanced Visuals in Mission Simulators

    D. A. Cowdrey | NTIS | 1986