This paper investigates the use of a heterogeneous stereo-vision system to mitigate the effects of time delays in a drone-based visual interface presented to a human operator. Time delays in the display for a telerobotic interface refer to the time difference between the operator’s input action and the corresponding visible outcome. In human/machine interfaces, time delays can arise due to computation, telecommunication, and mechanical limitations. These delays can degrade the performance of the human/machine system. A heterogeneous stereo-vision predictive algorithm is presented that can reduce the negative effects of time delays in the operator’s display. The heterogeneous stereo-vision system consists of an omnidirectional camera and a pan/tilt/zoom camera. Two predictive display setups were developed that modify the delayed video imagery that would otherwise be presented to the operator in a way that provides an almost immediate visual response to the operator’s control actions. The usability of the system is determined through human performance testing with and without the predictive algorithms. The results indicate that the predictive algorithm allows more efficient, accurate, and user-friendly operation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Time Delay Mitigation in Aerial Telerobotic Operations Using Heterogeneous Stereo-Vision Systems


    Contributors:

    Published in:

    Publication date :

    2023-09-01




    Type of media :

    Conference paper , Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Telerobotic Operations with Time Delay, Results from the ISECG GAP Assesment Team

    Wedler, Armin / Metcalfe, Laurie / Alfano, David et al. | German Aerospace Center (DLR) | 2018

    Free access

    RobOps - Services for Telerobotic System Operations

    Flentge, Felix / Brunner, Bernhard / Jaekel, Steffen et al. | AIAA | 2014



    Robotics architectures for telerobotic flight operations

    Akin, David / Churchill, Philip | AIAA | 1993


    A vision-based telerobotic control station

    Tillotson, Brian | NTRS | 1990