Action, gesture, and sign represent unique aspects of human communication that use form and movement to convey meaning. Researchers typically use manual coding of video data to characterize naturalistic, meaningful movements at various levels of description, but the availability of markerless motion-tracking technology allows for quantification of the kinematic features of gestures or any meaningful human movement. We present a novel protocol for extracting a set of kinematic features from movements recorded with Microsoft Kinect. Our protocol captures spatial and temporal features, such as height, velocity, submovements/strokes, and holds. This approach is based on studies of communicative actions and gestures and attempts to capture features that are consistently implicated as important kinematic aspects of communication. We provide open-source code for the protocol, a description of how the features are calculated, a validation of these features as quantified by our protocol versus manual coders, and a discussion of how the protocol can be applied. The protocol effectively quantifies kinematic features that are important in the production (e.g., characterizing different contexts) as well as the comprehension (e.g., used by addressees to understand intent and semantics) of manual acts. The protocol can also be integrated with qualitative analysis, allowing fast and objective demarcation of movement units, providing accurate coding even of complex movements. This can be useful to clinicians, as well as to researchers studying multimodal communication or human–robot interactions. By making this protocol available, we hope to provide a tool that can be applied to understanding meaningful movement characteristics in human communication.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Toward the markerless and automatic analysis of kinematic features: A toolkit for gesture and movement research


    Beteiligte:
    Trujillo, J. (Autor:in) / Vaitonyte, J. (Autor:in) / Simanova, I. (Autor:in) / Ozyurek, A. (Autor:in)

    Erscheinungsdatum :

    01.04.2019


    Anmerkungen:

    Behavior Research Methods


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629




    Markerless Kinematic Model and Motion Capture from Volume Sequences

    Chu, C.-W. / Jenkins, O. / Mataric, M. et al. | British Library Conference Proceedings | 2003


    Markerless kinematic model and motion capture from volume sequences

    Chi-Wei Chun, / Jenkins, O.C. / Mataric, M.J. | IEEE | 2003




    Markerless monocular motion capture using image features and physical constraints

    Yisheng Chen, / Lee, J. / Parent, R. et al. | IEEE | 2005