In this paper, we propose a novel, real-time driver emotion monitoring system “in the wild” based on face detection and racial expression analysis. A camera is placed inside the vehicle that continuously looks at the driver's face and monitors the driver's emotional state at regular time intervals. Camera based monitoring of the driver's attentiveness based on the driver's emotional state in naturalistic driving environments is a non-intrusive approach and an important part of an automated driver assistance system (ADAS). Our work employs a face detection model based on mixture of trees with shared pool of parts to robustly detect the drivers face in varied environmental conditions. We also extract racial landmark points, and use them to enhance our emotion recognition system. In our proposed work, we use convolution neural networks. In the first, we use VGG16 to extract appearance features from the detected face image and in the second VGG16 network, to extract geometrical features from the racial landmark points. We then combine these two features using an integration method to accurately recognize the emotions. Based on the recognized emotional state of the driver, the driver can be made aware of his emotional state in case necessary. Experimental results on publicly available driver and face expression datasets show that our system is robust and accurate for driver emotion detection.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Learning Based Real-Time Driver Emotion Monitoring


    Beteiligte:
    Verma, Bindu (Autor:in) / Choudhary, Ayesha (Autor:in)


    Erscheinungsdatum :

    01.09.2018


    Format / Umfang :

    1127178 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Machine Learning Based Driver Emotion Monitoring for Vehicular IoT

    Xiao, Feng / Xu, Ze / Han, Yi et al. | IEEE | 2024


    Real-Time Emotion Recognition Using Deep Learning Algorithms

    Mettiti, Abderrahmane El / Oumsis, Mohammed / Chehri, Abdellah et al. | IEEE | 2022


    Real-Time Driver Alertness Monitoring with Optimized Deep Learning and Haar-Cascade Methods

    Rawat, Karan Singh / Kumar, Shubham / Kowsigan, M. et al. | IEEE | 2024


    DRIVER EMOTION ESTIMATION DEVICE, DRIVER EMOTION ESTIMATION SYSTEM, DRIVER EMOTION ESTIMATION METHOD AND DRIVER EMOTION ESTIMATION PROGRAM

    WANG DANNI / TSUKAMOTO TETSUYA / SHIZUKA ERIKO | Europäisches Patentamt | 2021

    Freier Zugriff

    Real-Time Bus Driver Monitoring System Using Machine Learning

    Kadu, Anil / Dharashive, Rajnandini / Nimje, Rachit et al. | IEEE | 2024