We address the detection and analysis of gestural hand motion oscillation and symmetries in natural speech. First, we extract hand motion trajectory signals from video dataset. Second, we present our windowed correlation coefficient approach for gestural symmetry extraction. The signs and magnitudes of the correlation coefficients in the cardinal directions of the subject's torso characterize the symmetries. Third, we present a wavelet-based approach that extracts the time-frequency properties of hand motion oscillation. By analyzing these frequency properties durations of homogeneous gestural oscillations are detected. Finally, we apply our approach to a real video dataset captured in candid conversation. We relate the hand motion oscillatory gestures and symmetric gestures to the phases of speech and multimodal discourse analysis. We demonstrate the ability of our algorithm to extract gestural symmetries and oscillations and show how symmetric gestures and oscillatory gestures correspond to natural discourse structure.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Gestural Hand Motion Oscillation and Symmetries for Multimodal Discourse: Detection and Analysis


    Contributors:


    Publication date :

    2003-06-01


    Size :

    324478 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Hand Motion Gesture Frequency Properties and Multimodal Discourse Analysis

    Xiong, Y. / Quek, F. | British Library Online Contents | 2006


    Design and Implementation of Inertial Sensor Based Wearable Gestural Hand Motion Identification System

    Zhou, Qifan / Yu, Chunyang / Lari, Zahra et al. | British Library Conference Proceedings | 2016


    GESTURAL MANIPULATION SYSTEM, GESTURAL MANIPULATION METHOD, AND PROGRAM

    SHINOMURA YUJI / FUJIHARA NAOKI / HIRAI KATSUHISA et al. | European Patent Office | 2018

    Free access

    RADAR-BASED GESTURAL INTERFACE

    ROTHERA ALEXANDER HARRISON / LANGE SCOTT DANIEL | European Patent Office | 2021

    Free access

    Gestural Control of Robot End Effectors

    Friedman, Mark B. | SPIE | 1987