Hand gesture recognition is a key aspect to make interaction of virtual reality more convenient. A good way to make users’ idea understood by computers including characters input plays an important role in interaction. Current methods of hand gesture and character input are too limited to make full use of powerful capacity that computers have nowadays. In this paper, we propose a natural 3D input method based on stereo cameras as an interface of human and machine. We segment the hand out based on skin-color detection and train a neural network based on Hu moments to recognize valid and invalid gestures defined in our paper. For valid gestures, we implement stereo matching and 3D coordinate calculation and line them up to formulate characters. Our method can robustly recognize 3D gestures in different directions and make users’ input more free compared with traditional ways.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Interaction with Three-Dimensional Gesture and Character Input in Virtual Reality Recognizing gestures in different directions and improving user input


    Beteiligte:
    Yang, J (Autor:in) / Wang, Y (Autor:in) / Lv, Z (Autor:in) / Jiang, N (Autor:in) / Steed, A (Autor:in)

    Erscheinungsdatum :

    2018-03-01


    Anmerkungen:

    IEEE Consumer Electronics Magazine , 7 (2) pp. 64-72. (2018)


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    004 / 629



    GESTURE INPUT SYSTEM AND GESTURE INPUT METHOD

    WAKUDA DAISUKE / EZAKI KENICHI / MATSUMOTO GEN | Europäisches Patentamt | 2017

    Freier Zugriff

    GESTURE INPUT DEVICE

    OYA YOSHIYUKI | Europäisches Patentamt | 2017

    Freier Zugriff

    GESTURE INPUT APPARATUS

    TSUDA YOSHIYUKI / HATANAKA SHINJI / KONISHI TOSHIYUKI | Europäisches Patentamt | 2019

    Freier Zugriff

    GESTURE INPUT SYSTEM

    TANIZAWA YUSUKE | Europäisches Patentamt | 2018

    Freier Zugriff

    GESTURE INPUT APPARATUS

    HAMADA KOJI / TOMARU TETSUYA | Europäisches Patentamt | 2015

    Freier Zugriff