This paper presents a multimodal crisis management system (XISM). It employs processing of natural gesture and speech commands elicited by a user to efficiently manage complex dynamic emergency scenarios on a large display. The developed prototype system demonstrates the means of incorporating unconstrained free-hand gestures and speech in a real-time interactive interface. This paper provides insights into the design aspects of the XISM system. In particular, it addresses the issues of extraction and fusion of gesture and speech modalities to allow more natural interactive behavior. Performance characteristics of the current prototype and considerations for future work are discussed. A series of studies indicated positive response with respect to ease of interacting with the current system.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multimodal human-computer interaction for crisis management systems


    Contributors:


    Publication date :

    2002-01-01


    Size :

    302319 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multimodal Human-Computer Interaction for Crisis Management Systems

    Krahnstoever, N. / Schapira, E. / Kettebekov, S. et al. | British Library Conference Proceedings | 2002


    Multimodal human-computer interaction: A survey

    Jaimes, A. / Sebe, N. | British Library Online Contents | 2007


    A Conversational Paradigm for Multimodal Human Interaction

    Quek, F. | British Library Conference Proceedings | 2001


    Multimodal human interaction analysis in vehicle cockpit

    Portes, Quentin / Pinquier, Julien / Lerasle, Frederic et al. | IEEE | 2021


    Multimodal person recognition for human-vehicle interaction

    Erzin, E. / Yemez, Y. / Tekalp, A.M. et al. | Tema Archive | 2006