Large display environments supporting fluid user interactions are commonly supported in living lab environments such as situation rooms and industrial lobby spaces. However, conventional input mechanisms such as mouse and keyboard are poorly suited to interacting with such spaces due to their potentially huge spatial extent. In this context, we propose a novel technique for manipulating screen elements in large display environments. The method combines a wrist-mounted Leap Motion controller with user tracking from an array of ceiling-mounted Kinects. The overhead Kinects provide tracking coordinates in a global coordinate system along with the body orientation of the user, creating a dynamic and directed interaction screen space. The Leap Motion controller determines the location of the hand, and interprets it in the context of a large, wrap-around screen. We demonstrate the system in the CRAIVE-Lab, a large immersive environment (10m x 12m floor plan, with a 4.3m high, 40m long, 360 degree display wall).


    Access

    Download


    Export, share and cite



    Title :

    Manipulating Screen Elements in an Immersive Environment with a Wrist-Mounted Device and Free Body Movement


    Contributors:

    Publication date :

    2018-04-22



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Movement control method, movement manipulation apparatus, and method for manipulating movement of moving body

    YAMAGUCHI FUJIOKI / OGAWA KOUJI | European Patent Office | 2016

    Free access

    Underwater propeller simulating cuttlefish wrist movement

    GUO YANTAO / XIA FUZHONG / FU JIANGFAN et al. | European Patent Office | 2023

    Free access

    Movable-screen vehicle-mounted screen device

    KIM JONG-CHAN | European Patent Office | 2023

    Free access


    The Effects of a Weighted Wrist Mounted Device on Marksmanship

    Ysebaert, S. / Finomore, V.S. / Burnett, G. et al. | British Library Conference Proceedings | 2012