Speech reading, also known as lip reading, is aimed at extracting visual cues of lip and facial movements to aid in recognition of speech. The main hurdle for speech reading is that visual measurements of lip and facial motion lack information-rich features like the Mel frequency cepstral coefficients (MFCC), widely used in acoustic speech recognition. These MFCC are used with hidden Markov models (HMM) in most speech recognition systems at present. Speech reading could greatly benefit from automatic selection and formation of informative features from measurements in the visual domain. These new features can then be used with HMM to capture the dynamics of lip movement and eventual recognition of lip shapes. Towards this end, we use AdaBoost methods for automatic visual feature formation. Specifically, we design an asymmetric variant of AdaBoost M2 algorithm to deal with the ill-posed multi-class sample distribution inherent in our problem. Our experiments show that the boosted HMM approach outperforms conventional AdaBoost and HMM classifiers. Our primary contributions are in the design of (a) boosted HMM and (b) asymmetric multi-class boosting.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Asymmetrically boosted HMM for speech reading


    Beteiligte:
    Pei Yin, (Autor:in) / Essa, I. (Autor:in) / Rehg, J.M. (Autor:in)


    Erscheinungsdatum :

    2004-01-01


    Format / Umfang :

    366942 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Asymmetrically Boosted HMM for Speech Reading

    Yin, P. / Essa, I. / Rehg, J. et al. | British Library Conference Proceedings | 2004


    Boosted Audio-Visual HMM for Speech Reading

    Yin, P. / Essa, I. / Rehg, J. et al. | British Library Conference Proceedings | 2003


    Boosted audio-visual HMM for speech reading

    Pei Yin, / Essa, I. / Rehg, J.M. | IEEE | 2003


    Asymmetrically-shaped isolator

    SHANNON RYAN LEE | Europäisches Patentamt | 2023

    Freier Zugriff

    Asymmetrically-shaped isolator

    SHANNON RYAN LEE | Europäisches Patentamt | 2021

    Freier Zugriff