Hand gesture recognition is a key aspect to make interaction of virtual reality more convenient. A good way to make users’ idea understood by computers including characters input plays an important role in interaction. Current methods of hand gesture and character input are too limited to make full use of powerful capacity that computers have nowadays. In this paper, we propose a natural 3D input method based on stereo cameras as an interface of human and machine. We segment the hand out based on skin-color detection and train a neural network based on Hu moments to recognize valid and invalid gestures defined in our paper. For valid gestures, we implement stereo matching and 3D coordinate calculation and line them up to formulate characters. Our method can robustly recognize 3D gestures in different directions and make users’ input more free compared with traditional ways.
Interaction with Three-Dimensional Gesture and Character Input in Virtual Reality Recognizing gestures in different directions and improving user input
2018-03-01
IEEE Consumer Electronics Magazine , 7 (2) pp. 64-72. (2018)
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch