The invention discloses an emotion recognition method and device when a user drives a vehicle, a storage medium and a terminal. The method comprises the steps of obtaining a facial expression in real time, performing data processing on the facial expression to extract facial feature data, and obtaining a facial information emotion state based on the facial feature data and a facial expression database; obtaining voice materials in real time, performing data processing on the voice materials to extract voice feature data, and obtaining a voice information emotional state based on the voice feature data and the voice expression database; detecting the heart rate and comparing the heart rate with a preset heart rate threshold value to obtain a heart rate information emotional state; and based on the facial information emotional state, the voice information emotional state and the heart rate information emotional state, judging the emotional state when the user drives the vehicle. According to the method, the judgment parameters of driver emotional state judgment are expanded, the emotional state judgment accuracy is improved, and car accidents caused by subjective factors such as poor emotional states in the driving process of a user are more effectively reduced.

    本发明公开了一种用户驾驶车辆时情绪识别方法及装置、存储介质和终端,其中方法包括:实时获取面部表情,将面部表情进行数据化处理提取面部特征数据,基于面部特征数据和面部表情数据库得到面部信息情绪状态;实时获取语音素材,将语音素材进行数据化处理提取语音特征数据,基于语音特征数据和语音表情数据库得到语音信息情绪状态;检测心率将其与预设心率阈值进行对比得到心率信息情绪状态;基于面部信息情绪状态、语音信息情绪状态和心率信息情绪状态判断用户驾驶车辆时的情绪状态。本发明拓展了驾驶员情绪状态判断的判定参数,提高了情绪状态判断正确率,更有效的减少了用户驾驶过程中因情绪状态不好等主观因素导致的车祸发生。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Emotion recognition method and device when user drives vehicle, storage medium and terminal


    Weitere Titelangaben:

    用户驾驶车辆时情绪识别方法及装置、存储介质和终端


    Beteiligte:
    YING ZHENKAI (Autor:in)

    Erscheinungsdatum :

    2021-05-11


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06K Erkennen von Daten , RECOGNITION OF DATA / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS



    User emotion adjustment method and device, vehicle and storage medium

    GAO RUSHAN / CAI SHIMIN / TAN MINGWEI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    METHOD FOR REGULATING USER EMOTION, DEVICE, AND READABLE STORAGE MEDIUM

    XIA DEGUO / ZHANG LIUHUI / HUANG JIZHOU | Europäisches Patentamt | 2023

    Freier Zugriff

    Vehicle driver emotion recognition method and device

    WANG FAN | Europäisches Patentamt | 2016

    Freier Zugriff

    Emotion adjustment method, device and equipment, vehicle and storage medium

    DONG RUITING / WEI LIKAI | Europäisches Patentamt | 2023

    Freier Zugriff

    Intelligent vehicle driving control method and system based on emotion recognition and storage medium

    WANG HONGGANG / PENG YONG / WANG XINGHUA et al. | Europäisches Patentamt | 2022

    Freier Zugriff