Underwater ROVs (Remotely Operated Vehicles) are unmanned submersible vehicles designed for exploring and operating in the depths of the ocean. Despite using high-end cameras, typical teleoperation engines based on first-person (egocentric) views limit a surface operator's ability to maneuver the ROV in complex deep-water missions. In this paper, we present an interactive teleoperation interface that enhances the operational capabilities via increased situational awareness. This is accomplished by (i) offering on-demand "third"-person (exocentric) visuals from past egocentric views, and (ii) facilitating enhanced peripheral information with augmented ROV pose information in real-time. We achieve this by integrating a 3D geometry-based Ego-to-Exo view synthesis algorithm into a monocular SLAM system for accurate trajectory estimation. The proposed closed-form solution only uses past egocentric views from the ROV and a SLAM backbone for pose estimation, which makes it portable to existing ROV platforms. Unlike data-driven solutions, it is invariant to applications and waterbody-specific scenes. We validate the geometric accuracy of the proposed framework through extensive experiments of 2-DOF indoor navigation and 6-DOF underwater cave exploration in challenging low-light conditions. A subjective evaluation on 15 human teleoperators further confirms the effectiveness of the integrated features for improved teleoperation. We demonstrate the benefits of dynamic Ego-to-Exo view generation and real-time pose rendering for remote ROV teleoperation by following navigation guides such as cavelines inside underwater caves. This new way of interactive ROV teleoperation opens up promising opportunities for future research in subsea telerobotics.


    Access

    Download


    Export, share and cite



    Title :

    Ego-to-Exo: Interfacing Third Person Visuals from Egocentric Views in Real-time for Improved ROV Teleoperation


    Contributors:

    Publication date :

    2024


    Remarks:

    V3, 9 pages


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    COSTLESS FOUR-WHEELED ROBOT TO CAPTURE REAL TIME VISUALS FOR MONITORING

    Alaiahgari Bramaiah, Sreeramdas / Gayaz, S.K. | BASE | 2017

    Free access

    Teleoperation real-time following system and teleoperation real-time following method

    ZHANG FEI / HU BUQING / WANG JUN et al. | European Patent Office | 2023

    Free access

    Real-Time Egocentric Navigation Using 3D Sensing

    Smith, Justin S. / Feng, Shiyu / Lyu, Fanzhe et al. | Springer Verlag | 2019


    Advanced Visuals in Mission Simulators

    D. A. Cowdrey | NTIS | 1986