Background: Virtual reality (VR) enables the administration of realistic and dynamic stimuli within a social context for the assessment and training of emotion recognition. We tested a novel VR emotion recognition task by comparing emotion recognition across a VR, video and photo task, investigating covariates of recognition and exploring visual attention in VR. Methods: Healthy individuals (n = 100) completed three emotion recognition tasks; a photo, video and VR task. During the VR task, emotions of virtual characters (avatars) in a VR street environment were rated, and eye-tracking was recorded in VR. Results: Recognition accuracy in VR (overall 75%) was comparable to the photo and video task. However, there were some differences; disgust and happiness had lower accuracy rates in VR, and better accuracy was achieved for surprise and anger in VR compared to the video task. Participants spent more time identifying disgust, fear and sadness than surprise and happiness. In general, attention was directed longer to the eye and nose areas than the mouth. Discussion: Immersive VR tasks can be used for training and assessment of emotion recognition. VR enables easily controllable avatars within environments relevant for daily life. Validated emotional expressions and tasks will be of relevance for clinical applications.


    Access

    Download


    Export, share and cite



    Title :

    Virtual reality facial emotion recognition in social environments:An eye-tracking study


    Contributors:

    Publication date :

    2021-09-01


    Remarks:

    Geraets , C N W , Klein Tuente , S , Lestestuiver , B P , van Beilen , M , Nijman , S A , Marsman , J B C & Veling , W 2021 , ' Virtual reality facial emotion recognition in social environments : An eye-tracking study ' , Internet Interventions , vol. 25 , 100432 , pp. 100432 . https://doi.org/10.1016/j.invent.2021.100432



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Pose-invariant descriptor for facial emotion recognition

    Shojaeilangari, S. / Yau, W. Y. / Teoh, E. K. | British Library Online Contents | 2016


    Eye tracking in virtual reality

    Clay, Viviane / König, Peter / König, Sabine U. | BASE | 2019

    Free access

    Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors

    Marín-Morales, Javier / Higuera-Trujillo, Juan Luis / Greco, Alberto et al. | BASE | 2018

    Free access

    Adaptive facial point detection and emotion recognition for a humanoid robot

    Zhang, Li / Mistry, Kamlesh / Jiang, Ming et al. | British Library Online Contents | 2015


    Adaptive facial point detection and emotion recognition for a humanoid robot

    Zhang, Li / Mistry, Kamlesh / Jiang, Ming et al. | British Library Online Contents | 2015