In this work, a Mixed Reality (MR) system is evaluated to assess whether it can be efficiently used in teleoperation tasks that require an accurate control of the robot end-effector. The robot and its local environment are captured using multiple RGB-D cameras, and a remote user controls the robot arm motion through Virtual Reality (VR) controllers. The captured data is streamed through the network and reconstructed in 3D, allowing the remote user to monitor the state of execution in real time through a VR headset. We compared our method with two other interfaces: i) teleoperation in pure VR, with the robot model rendered with the real joint states, and ii) teleoperation in MR, with the rendered model of the robot superimposed on the actual point cloud data. Preliminary results indicate that the virtual robot visualization is better than the pure point cloud for accurate teleoperation of a robot arm.


    Access

    Download


    Export, share and cite



    Title :

    Assessing the Suitability and Effectiveness of Mixed Reality Interfaces for Accurate Robot Teleoperation



    Publication date :

    2020-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Exploring Robot Teleoperation in Virtual Reality

    BUKEIKHAN, OMARALI | BASE | 2023

    Free access

    Intuitive Robot Teleoperation through Multi-Sensor Informed Mixed Reality Visual Aids

    Livatino, Salvatore / Guastella, Dario C. / Muscato, Giovanni et al. | BASE | 2021

    Free access

    Design and Mixed-Reality Teleoperation of a Quadruped-Manipulator Robot for SAR Tasks

    Ulloa, Christyan Cruz / Domínguez, David / Barrientos, Antonio et al. | Springer Verlag | 2022


    Vehicle Teleoperation Interfaces

    Fong, T. / Thorpe, C. | British Library Online Contents | 2001


    Design of a Hyper-Redundant Robot and Teleoperation Using Mixed Reality for Inspection Tasks

    Martín-Barrio, Andrés / Roldán-Gómez, Juan Jesús / Rodríguez, Iván et al. | BASE | 2020

    Free access