This thesis presents research on VR-based robot teleoperation with a focus on remote environment visualisation in virtual reality, the effects of remote environment reconstruction scale in virtual reality on the human-operator's ability to control the robot and human-operator's visual attention patterns when teleoperating a robot from virtual reality. A VR-based robot teleoperation framework was developed, it is compatible with various robotic systems and cameras, allowing for teleoperation and supervised control with any ROS-compatible robot and visualisation of the environment through any ROS-compatible RGB and RGBD cameras. The framework includes mapping, segmentation, tactile exploration, and non-physically demanding VR interface navigation and controls through any Unity-compatible VR headset and controllers or haptic devices. Point clouds are a common way to visualise remote environments in 3D, but they often have distortions and occlusions, making it difficult to accurately represent objects' textures. This can lead to poor decision-making during teleoperation if objects are inaccurately represented in the VR reconstruction. A study using an end-effector-mounted RGBD camera with OctoMap mapping of the remote environment was conducted to explore the remote environment with fewer point cloud distortions and occlusions while using a relatively small bandwidth. Additionally, a tactile exploration study proposed a novel method for visually presenting information about objects' materials in the VR interface, to improve the operator's decision-making and address the challenges of point cloud visualisation. Two studies have been conducted to understand the effect of virtual world dynamic scaling on teleoperation flow. The first study investigated the use of rate mode control with constant and variable mapping of the operator's joystick position to the speed (rate) of the robot's end-effector, depending on the virtual world scale. The results showed that variable mapping allowed participants to teleoperate the ...


    Access

    Download


    Export, share and cite



    Title :

    Exploring Robot Teleoperation in Virtual Reality



    Publication date :

    2023-03-24


    Remarks:

    doi:10.15167/bukeikhan-omarali_phd2023-03-24



    Type of media :

    Theses


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Virtual reality extensions into surgical training and teleoperation

    Barnes, B. / Menon, A.S. / Mills, R. et al. | Tema Archive | 2003


    Motion control in virtual reality based teleoperation system

    Abut, Tayfun / Soyguder, Servet | IEEE | 2015


    Virtual Reality Interface Tools for Teleoperation of Unmanned Ground Vehicles

    Adams, S. K. / Association for Unmanned Vehicle Systems | British Library Conference Proceedings | 1993


    ETS-7 Space Robot Teleoperation Through Virtual Force Reflection

    Pein, L. F. / Matsumoto, K. / Wakabayashi, S. et al. | British Library Conference Proceedings | 1999


    A Virtual Reality Planning Environment for High-Risk, High-Latency Teleoperation

    Will Pryor / Liam Wang / Arko Chatterjee et al. | NTRS