We present an alternative to the manipulative and semaphoric gesture recognition paradigms. Human multimodal communicative behaviors form a tightly integrated whole. We present a paradigm multimodal analysis in natural discourse based on a feature decompositive psycholinguistically derived model that permits us to access the underlying structure and intent of multimodal communicative discourse. We outline the psycholinguistics that drive our paradigm, the Catchment concept that facilitates our getting a computational handle on discourse entities, and summarize some approaches and results that realize the vision. We show examples of such discourse-structuring features as handedness, types of symmetry, gaze-at-interlocutor and hand 'origos'. Such analysis is an alternative to the 'recognition of one discrete gesture out of k stylized whole gesture models' paradigm.
A conversational paradigm for multimodal human interaction
2001-01-01
749908 byte
Conference paper
Electronic Resource
English
A Conversational Paradigm for Multimodal Human Interaction
British Library Conference Proceedings | 2001
|A multimodal conversational interface for a concept vehicle
Tema Archive | 2003
|Multimodal human-computer interaction: A survey
British Library Online Contents | 2007
|Multimodal person recognition for human-vehicle interaction
Tema Archive | 2006
|