Real-time recognition of driver emotions can greatly improve traffic safety. With the rapid development of communication technology, it becomes possible to process large amounts of video data and identify the driver’s emotions in real time. To effectively recognize driver’s emotions, this paper proposes a new deep learning framework called Convolution Bidirectional Long Short-term Memory Neural Network (CBLNN). This method predicts the driver’s emotion based on the geometric features extracted from facial skin information and the heart rate extracted from changes in RGB components. The facial geometry features obtained by using Convolutional Neural Network (CNN) are intermediate variables for the heart rate analysis of Bidirectional Long Short Term Memory (Bi-LSTM). Subsequently, the output of Bi-LSTM is used as input to the CNN module to extract the hear rate features. CBLNN uses Multi-modal factorized bilinear pooling (MFB) to fuse the extracted information and classifies it into five common emotions: happiness, anger, sadness, fear and neutrality. Our emotion recognition method was tested, proving that it can be used to quickly and steadily recognize emotions in real time.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Convolution Bidirectional Long Short-Term Memory Neural Network for Driver Emotion Recognition


    Beteiligte:
    Du, Guanglong (Autor:in) / Wang, Zhiyao (Autor:in) / Gao, Boyu (Autor:in) / Mumtaz, Shahid (Autor:in) / Abualnaja, Khamael M. (Autor:in) / Du, Cuifeng (Autor:in)


    Erscheinungsdatum :

    2021-07-01


    Format / Umfang :

    2795734 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    A modified bidirectional long short-term memory neural network for rail vehicle suspension fault detection

    Chen, Yuejian / Niu, Gang / Li, Yifan et al. | Taylor & Francis Verlag | 2023



    Automatic Human Emotion Recognition System using Facial Expressions with Convolution Neural Network

    MADUPU, RAM KUMAR / KOTHAPALLI, CHIRANJEEVI / YARRA, VASANTHI et al. | IEEE | 2020