In this work we explore Hidden Markov models as an approach for modeling and recognizing dynamic hand gestures for the interface of in-vehicle infotainment systems. We train the HMMs on more complex shape descriptors such as HOG and CNN features, unlike typical HMM based approaches. An analysis of the optimal hyperparameters of the HMM for the task has been carried out. Also, dimensionality reduction and data augmentation have been explored as methods for reducing overfitting of the HMMs. Finally we experiment with the CNN-HMM hybrid framework which uses a trained Convolutional Neural Network for estimating the emission probabilities of the HMM. We obtain a mean recognition accuracy of 57.50% on the VIVA hand gesture challenge, which while not the best result on the dataset, shows the feasibility of the approach.
In-vehicle Hand Gesture Recognition using Hidden Markov models
2016-11-01
269114 byte
Conference paper
Electronic Resource
English
Hand gesture recognition using a real-time tracking method and hidden Markov models
British Library Online Contents | 2003
|Gesture recognition using the multi-PDM method and hidden Markov model
British Library Online Contents | 2000
|Visual keyword recognition using hidden Markov models
IEEE | 1993
|