Affective interaction between the intelligent cockpit and humans is becoming an emerging topic full of opportunities. Robust recognition of the driver's emotions is the first step for affective interaction, and the intelligent cockpit recognizes emotions through the driver's speech, which has a wide range of technical application potential. In this paper, we first proposed a multi-feature fusion parallel structure speech emotion recognition network, which complementarily fuses the global acoustic features and local spectral features of the entire speech. Second, we designed and conducted the speech data collection under the driver's emotion and established the driver's speech emotion (SpeechEmo) dataset in the dynamic driving environment including 40 participants. Finally, the proposed model was validated on the SpeechEmo and public datasets, and quantitative analysis was carried out. It was found that the proposed model achieved advanced recognition performance, and the ablation experiments verified the importance of different components of the model. The proposed model and dataset are beneficial to the realization of human-vehicle affective interaction in intelligent cockpits in the future toward a better human experience.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Global-Local-Feature-Fused Driver Speech Emotion Detection for Intelligent Cockpit in Automated Driving


    Beteiligte:
    Li, Wenbo (Autor:in) / Xue, Jiyong (Autor:in) / Tan, Ruichen (Autor:in) / Wang, Cong (Autor:in) / Deng, Zejian (Autor:in) / Li, Shen (Autor:in) / Guo, Gang (Autor:in) / Cao, Dongpu (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.04.2023


    Format / Umfang :

    8444172 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Intelligent cockpit driver fatigue visual auxiliary detection method

    CHEN CHIEN-HUA / XU XIHAI | Europäisches Patentamt | 2023

    Freier Zugriff

    Cockpit Concept for Conditional Automated Driving

    Dipl.-Ing. Reilhac, Patrice / Dipl.-Ing. Moizard, Julien / Dipl.-Ing. (Fh) Kaiser, Frank et al. | Springer Verlag | 2016


    Speech-Based Driver Emotion Recognition

    Tan, Haiqiu / Zhang, Haodong / Shi, Jian et al. | TIBKAT | 2023


    Speech-Based Driver Emotion Recognition

    Tan, Haiqiu / Zhang, Haodong / Shi, Jian et al. | Springer Verlag | 2022


    The automated cockpit

    Lerner, E.J. | Tema Archiv | 1983