The invention discloses an emotion recognition method and device when a user drives a vehicle, a storage medium and a terminal. The method comprises the steps of obtaining a facial expression in real time, performing data processing on the facial expression to extract facial feature data, and obtaining a facial information emotion state based on the facial feature data and a facial expression database; obtaining voice materials in real time, performing data processing on the voice materials to extract voice feature data, and obtaining a voice information emotional state based on the voice feature data and the voice expression database; detecting the heart rate and comparing the heart rate with a preset heart rate threshold value to obtain a heart rate information emotional state; and based on the facial information emotional state, the voice information emotional state and the heart rate information emotional state, judging the emotional state when the user drives the vehicle. According to the method, the judgment parameters of driver emotional state judgment are expanded, the emotional state judgment accuracy is improved, and car accidents caused by subjective factors such as poor emotional states in the driving process of a user are more effectively reduced.
本发明公开了一种用户驾驶车辆时情绪识别方法及装置、存储介质和终端,其中方法包括:实时获取面部表情,将面部表情进行数据化处理提取面部特征数据,基于面部特征数据和面部表情数据库得到面部信息情绪状态;实时获取语音素材,将语音素材进行数据化处理提取语音特征数据,基于语音特征数据和语音表情数据库得到语音信息情绪状态;检测心率将其与预设心率阈值进行对比得到心率信息情绪状态;基于面部信息情绪状态、语音信息情绪状态和心率信息情绪状态判断用户驾驶车辆时的情绪状态。本发明拓展了驾驶员情绪状态判断的判定参数,提高了情绪状态判断正确率,更有效的减少了用户驾驶过程中因情绪状态不好等主观因素导致的车祸发生。
Emotion recognition method and device when user drives vehicle, storage medium and terminal
用户驾驶车辆时情绪识别方法及装置、存储介质和终端
2021-05-11
Patent
Electronic Resource
Chinese
User emotion adjustment method and device, vehicle and storage medium
European Patent Office | 2024
|METHOD FOR REGULATING USER EMOTION, DEVICE, AND READABLE STORAGE MEDIUM
European Patent Office | 2023
|Emotion adjustment method, device and equipment, vehicle and storage medium
European Patent Office | 2023
|European Patent Office | 2022
|