We present a computational model and a system for the automated recognition of emotions starting from full-body movement. Three-dimensional motion data of full-body movements are obtained either from professional optical motion-capture systems (Qualisys) or from low-cost RGB-D sensors (Kinect and Kinect2). A number of features are then automatically extracted at different levels, from kinematics of a single joint to more global expressive features inspired by psychology and humanistic theories (e.g., contraction index, fluidity, and impulsiveness). An abstraction layer based on dictionary learning further processes these movement features to increase the model generality and to deal with intraclass variability, noise, and incomplete information characterizing emotion expression in human movement. The resulting feature vector is the input for a classifier performing real-time automatic emotion recognition based on linear support vector machines. The recognition performance of the proposed model is presented and discussed, including the tradeoff between precision of the tracking measures (we compare the Kinect RGB-D sensor and the Qualisys motion-capture system) versus dimension of the training dataset. The resulting model and system have been successfully applied in the development of serious games for helping autistic children learn to recognize and express emotions by means of their full-body movement.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Adaptive Body Gesture Representation for Automatic Emotion Recognition



    Erscheinungsdatum :

    2016-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    GESTURE RECOGNITION DEVICE FOR MOVABLE BODY, GESTURE RECOGNITION METHOD FOR MOVABLE BODY AND GESTURE RECOGNITION PROGRAM FOR MOVABLE BODY

    MAKINO TADASHIGE / ISHIKAWA TERUKO / TAKAHASHI YUKI | Europäisches Patentamt | 2018

    Freier Zugriff

    Method and device for automatic gesture recognition

    SCHÖN TORSTEN / SCHLITTENBAUER MICHAEL / MORGOTT MICHAEL | Europäisches Patentamt | 2022

    Freier Zugriff


    METHOD AND DEVICE FOR AUTOMATIC GESTURE RECOGNITION

    SCHÖN TORSTEN / SCHLITTENBAUER MICHAEL / MORGOTT MICHAEL | Europäisches Patentamt | 2020

    Freier Zugriff

    GESTURE RECOGNITION DEVICE AND GESTURE RECOGNITION METHOD

    HIGUCHI DAIKI / OHASHI DAISUKE | Europäisches Patentamt | 2022

    Freier Zugriff