In this paper, we propose a novel, real-time driver emotion monitoring system “in the wild” based on face detection and racial expression analysis. A camera is placed inside the vehicle that continuously looks at the driver's face and monitors the driver's emotional state at regular time intervals. Camera based monitoring of the driver's attentiveness based on the driver's emotional state in naturalistic driving environments is a non-intrusive approach and an important part of an automated driver assistance system (ADAS). Our work employs a face detection model based on mixture of trees with shared pool of parts to robustly detect the drivers face in varied environmental conditions. We also extract racial landmark points, and use them to enhance our emotion recognition system. In our proposed work, we use convolution neural networks. In the first, we use VGG16 to extract appearance features from the detected face image and in the second VGG16 network, to extract geometrical features from the racial landmark points. We then combine these two features using an integration method to accurately recognize the emotions. Based on the recognized emotional state of the driver, the driver can be made aware of his emotional state in case necessary. Experimental results on publicly available driver and face expression datasets show that our system is robust and accurate for driver emotion detection.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Learning Based Real-Time Driver Emotion Monitoring


    Contributors:


    Publication date :

    2018-09-01


    Size :

    1127178 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Machine Learning Based Driver Emotion Monitoring for Vehicular IoT

    Xiao, Feng / Xu, Ze / Han, Yi et al. | IEEE | 2024


    Real-Time Emotion Recognition Using Deep Learning Algorithms

    Mettiti, Abderrahmane El / Oumsis, Mohammed / Chehri, Abdellah et al. | IEEE | 2022


    Real-Time Driver Alertness Monitoring with Optimized Deep Learning and Haar-Cascade Methods

    Rawat, Karan Singh / Kumar, Shubham / Kowsigan, M. et al. | IEEE | 2024



    Real-Time Bus Driver Monitoring System Using Machine Learning

    Kadu, Anil / Dharashive, Rajnandini / Nimje, Rachit et al. | IEEE | 2024