In this work we explore Hidden Markov models as an approach for modeling and recognizing dynamic hand gestures for the interface of in-vehicle infotainment systems. We train the HMMs on more complex shape descriptors such as HOG and CNN features, unlike typical HMM based approaches. An analysis of the optimal hyperparameters of the HMM for the task has been carried out. Also, dimensionality reduction and data augmentation have been explored as methods for reducing overfitting of the HMMs. Finally we experiment with the CNN-HMM hybrid framework which uses a trained Convolutional Neural Network for estimating the emission probabilities of the HMM. We obtain a mean recognition accuracy of 57.50% on the VIVA hand gesture challenge, which while not the best result on the dataset, shows the feasibility of the approach.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    In-vehicle Hand Gesture Recognition using Hidden Markov models


    Contributors:


    Publication date :

    2016-11-01


    Size :

    269114 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Hand gesture recognition using a real-time tracking method and hidden Markov models

    Chen, F. S. / Fu, C. M. / Huang, C. L. | British Library Online Contents | 2003


    Recursive identification of gesture inputs using hidden Markov models

    Schlenzig, J. / Hunter, E. / Jain, R. | IEEE | 1994


    Gesture recognition using the multi-PDM method and hidden Markov model

    Huang, C. L. / Wu, M. S. / Jeng, S. H. | British Library Online Contents | 2000


    Visual keyword recognition using hidden Markov models

    Kuo, S.S. / Agazzi, O.E. | IEEE | 1993