Affective interaction between the intelligent cockpit and humans is becoming an emerging topic full of opportunities. Robust recognition of the driver's emotions is the first step for affective interaction, and the intelligent cockpit recognizes emotions through the driver's speech, which has a wide range of technical application potential. In this paper, we first proposed a multi-feature fusion parallel structure speech emotion recognition network, which complementarily fuses the global acoustic features and local spectral features of the entire speech. Second, we designed and conducted the speech data collection under the driver's emotion and established the driver's speech emotion (SpeechEmo) dataset in the dynamic driving environment including 40 participants. Finally, the proposed model was validated on the SpeechEmo and public datasets, and quantitative analysis was carried out. It was found that the proposed model achieved advanced recognition performance, and the ablation experiments verified the importance of different components of the model. The proposed model and dataset are beneficial to the realization of human-vehicle affective interaction in intelligent cockpits in the future toward a better human experience.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Global-Local-Feature-Fused Driver Speech Emotion Detection for Intelligent Cockpit in Automated Driving


    Contributors:
    Li, Wenbo (author) / Xue, Jiyong (author) / Tan, Ruichen (author) / Wang, Cong (author) / Deng, Zejian (author) / Li, Shen (author) / Guo, Gang (author) / Cao, Dongpu (author)

    Published in:

    Publication date :

    2023-04-01


    Size :

    8444172 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Intelligent cockpit driver fatigue visual auxiliary detection method

    CHEN CHIEN-HUA / XU XIHAI | European Patent Office | 2023

    Free access

    Cockpit Concept for Conditional Automated Driving

    Dipl.-Ing. Reilhac, Patrice / Dipl.-Ing. Moizard, Julien / Dipl.-Ing. (Fh) Kaiser, Frank et al. | Springer Verlag | 2016


    Speech-Based Driver Emotion Recognition

    Tan, Haiqiu / Zhang, Haodong / Shi, Jian et al. | TIBKAT | 2023


    Speech-Based Driver Emotion Recognition

    Tan, Haiqiu / Zhang, Haodong / Shi, Jian et al. | Springer Verlag | 2022


    The automated cockpit

    Lerner, E.J. | Tema Archive | 1983