This paper proposes a new method for robotic teleoperation scenarios with significant time delay utilizing Extended Reality (XR) technologies, specifically for Lunar base assembly and maintenance. Traditional teleoperation interfaces interpret commands sent through a desktop computer screen and are limited in providing spatial awareness cues. Additionally, the software often has difficulty in accounting for a time delay or providing intuitive techniques for human-robot interaction (HRI). This paper presents a new XR interface for robotic teleoperation using a predictive 3D simulated virtual environment developed using the SpaceCRAFT platform. SpaceCRAFT is a multiuser Virtual Reality (VR) and Augmented Reality (AR) systems engineering toolbox software that allows for worldwide collaboration on design and test of space systems. SpaceCRAFT provides the operator a virtual interface to the robot represented through three different states, a Virtual Command State (VCS), Predicted Current State (PCS), and Time Delayed State (TDS). To improve situational awareness and the PCS representation of the robot, SpaceCRAFT processes LIDAR and RGB camera data to create a constantly updating 3D point cloud representation of the remote environment. An experiment involving teleoperation of a 3D printed robotic manipulator was run, with a simulated time delay similar to that between the Earth and the Moon. Results demonstrate that the predictive approach provides an effective and flexible method of robot teleoperation that helps achieve successful task completion, even with a large time delay.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Predictive XR Telepresence for Robotic Operations in Space


    Contributors:


    Publication date :

    2021-03-06


    Size :

    12958644 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Symmetric telepresence using robotic humanoid surrogates

    Nagendran, A / Steed, A / Kelly, B et al. | BASE | 2015

    Free access

    Telepresence Enabling Human and Robotic Space Exploration and Discovery: Antarctic Lessons Learned

    Ardanuy, Philip / Otto, Christian / Head, James et al. | AIAA | 2005


    Satellite Servicing through Space Telepresence

    Spencer, Richard A. / Depkovich, Thomas | SAE Technical Papers | 1982


    UNDERWATER SWARM OF ROBOTIC FISH FOR MONITORING AND TELEPRESENCE

    DE MASI GIULIA / STEFANINI CESARE / RENDA FEDERICO et al. | European Patent Office | 2025

    Free access

    UNDERWATER SWARM OF ROBOTIC FISH FOR MONITORING AND TELEPRESENCE

    DE MASI GIULIA / STEFANINI CESARE / RENDA FEDERICO et al. | European Patent Office | 2025

    Free access