Background: Virtual reality (VR) enables the administration of realistic and dynamic stimuli within a social context for the assessment and training of emotion recognition. We tested a novel VR emotion recognition task by comparing emotion recognition across a VR, video and photo task, investigating covariates of recognition and exploring visual attention in VR. Methods: Healthy individuals (n = 100) completed three emotion recognition tasks; a photo, video and VR task. During the VR task, emotions of virtual characters (avatars) in a VR street environment were rated, and eye-tracking was recorded in VR. Results: Recognition accuracy in VR (overall 75%) was comparable to the photo and video task. However, there were some differences; disgust and happiness had lower accuracy rates in VR, and better accuracy was achieved for surprise and anger in VR compared to the video task. Participants spent more time identifying disgust, fear and sadness than surprise and happiness. In general, attention was directed longer to the eye and nose areas than the mouth. Discussion: Immersive VR tasks can be used for training and assessment of emotion recognition. VR enables easily controllable avatars within environments relevant for daily life. Validated emotional expressions and tasks will be of relevance for clinical applications.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Virtual reality facial emotion recognition in social environments:An eye-tracking study


    Beteiligte:
    Geraets, C.N.W. (Autor:in) / Klein Tuente, S. (Autor:in) / Lestestuiver, B.P. (Autor:in) / van Beilen, M. (Autor:in) / Nijman, S.A. (Autor:in) / Marsman, J.B.C. (Autor:in) / Veling, W. (Autor:in)

    Erscheinungsdatum :

    01.09.2021


    Anmerkungen:

    Geraets , C N W , Klein Tuente , S , Lestestuiver , B P , van Beilen , M , Nijman , S A , Marsman , J B C & Veling , W 2021 , ' Virtual reality facial emotion recognition in social environments : An eye-tracking study ' , Internet Interventions , vol. 25 , 100432 , pp. 100432 . https://doi.org/10.1016/j.invent.2021.100432



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    Pose-invariant descriptor for facial emotion recognition

    Shojaeilangari, S. / Yau, W. Y. / Teoh, E. K. | British Library Online Contents | 2016


    Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors

    Marín-Morales, Javier / Higuera-Trujillo, Juan Luis / Greco, Alberto et al. | BASE | 2018

    Freier Zugriff

    Eye tracking in virtual reality

    Clay, Viviane / König, Peter / König, Sabine U. | BASE | 2019

    Freier Zugriff

    Adaptive facial point detection and emotion recognition for a humanoid robot

    Zhang, Li / Mistry, Kamlesh / Jiang, Ming et al. | British Library Online Contents | 2015


    Artificial Intelligence based Facial Emotion Recognition with Deep Neural GAN Augmentation

    Menaka, D. / Priya, D. Karthika / Lenus, C. Reeda et al. | IEEE | 2024