We present an alternative to the manipulative and semaphoric gesture recognition paradigms. Human multimodal communicative behaviors form a tightly integrated whole. We present a paradigm multimodal analysis in natural discourse based on a feature decompositive psycholinguistically derived model that permits us to access the underlying structure and intent of multimodal communicative discourse. We outline the psycholinguistics that drive our paradigm, the Catchment concept that facilitates our getting a computational handle on discourse entities, and summarize some approaches and results that realize the vision. We show examples of such discourse-structuring features as handedness, types of symmetry, gaze-at-interlocutor and hand 'origos'. Such analysis is an alternative to the 'recognition of one discrete gesture out of k stylized whole gesture models' paradigm.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A conversational paradigm for multimodal human interaction


    Contributors:
    Quek, F. (author)


    Publication date :

    2001-01-01


    Size :

    749908 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Conversational Paradigm for Multimodal Human Interaction

    Quek, F. | British Library Conference Proceedings | 2001


    A multimodal conversational interface for a concept vehicle

    Pieraccini, Roberto / Dayanidhi, Krishna / Bloom, Jonathan et al. | Tema Archive | 2003


    Multimodal human-computer interaction: A survey

    Jaimes, A. / Sebe, N. | British Library Online Contents | 2007


    Gesture cues for conversational interaction in monocular video

    Quek, F. / McNeill, D. / Ansari, R. et al. | IEEE | 1999


    Multimodal person recognition for human-vehicle interaction

    Erzin, E. / Yemez, Y. / Tekalp, A.M. et al. | Tema Archive | 2006