Provided are methods and systems for remotely controlling of robotic platforms in confined spaces or other like spaces not suitable for direct human operation. The control is achieved using multi-modal sensory data, which includes at least two sensory response types, such as a binocular stereoscopic vision type, a binaural stereophonic audio type, a force-reflecting haptic manipulation type, a tactile type, and the like. The multi-modal sensory data is obtained by a robotic platform positioned in a confined space and transmitted to a remote control station outside of the confined space, where it is used to generate a representation of the confined space. The multi-modal sensory data may be used to provide multi-sensory high-fidelity telepresence for an operator of the remote control station and allow the operator to provide more accurate user input. This input may be transmitted to the robotic platform to perform various operations within the confined space.


    Access

    Download


    Export, share and cite



    Title :

    Remotely controlling robotic platforms based on multi-modal sensory data


    Contributors:

    Publication date :

    2020-09-16


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / B64F GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT , Boden- oder Flugzeugträgerdeckeinrichtungen besonders ausgebildet für die Verwendung in Verbindung mit Luftfahrzeugen / B25J Manipulatoren , MANIPULATORS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    REMOTELY CONTROLLED ROBOTIC VEHICLE

    SALLEN ROSELLÓ CÉSAR | European Patent Office | 2018

    Free access

    Remotely Operated Robotic Firefighter

    C. Cox / R. Beard / S. Gates | NTIS | 1988


    Multi-sensory and Multi-modal Fusion for Sentient Computing

    Town, C. | British Library Online Contents | 2007