The invention discloses an intelligent cabin sun shield automatic adjusting system based on facial expression recognition, which is characterized in that a multi-task convolutional neural network and a lightweight network MobileNetV3 network are cooperatively used to form the intelligent cabin sun shield automatic adjusting system for facial expression recognition; the MTCNN is used for detecting and intercepting a human face area in real time, and marking five feature points including human eyes, a nose and mouth corners for human face alignment operation; the MobileNetV3 network is a lightweight network which can be applied to a vehicle and is used for identifying the facial expression of a driver. According to the method, the human face is detected in real time through the MTCNN model, the facial expression in the driving process is recognized through the MobileNetV3small model, the automobile sun shield is automatically adjusted in time, interference of strong light to a driver is relieved, and safe and intelligent driving is achieved.
本发明公开了一种基于人脸表情识别的智慧座舱遮阳板自动调节系统,包括将多任务卷积神经网络和轻量级网络MobileNetV3网络配合使用,组成用于人脸表情识别的智慧座舱遮阳板自动调节系统;MTCNN用于实时检测截取人脸区域,并标出人眼、鼻子和嘴角共五处特征点用于人脸对齐操作;MobileNetV3网络是一种可应用于车载的轻量级网络,用于识别驾驶员的面部表情。本发明通过MTCNN模型实时检测人脸,利用MobileNetV3_small模型识别行车过程中的面部表情,及时自动调整汽车遮阳板,缓解强光线对驾驶者的干扰,实现安全、智能驾驶。
Intelligent cabin sun shield automatic adjusting system based on facial expression recognition
一种基于人脸表情识别的智慧座舱遮阳板自动调节系统
2023-12-22
Patent
Elektronische Ressource
Chinesisch
IPC: | B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / B60J WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES , Fenster, Windschutzscheiben und bewegbare Dächer, Türen oder Ähnliches für Fahrzeuge / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V |
Cabin control method and device based on facial recognition, intelligent cabin and vehicle
Europäisches Patentamt | 2023
|Automatic cabin adjusting method, automatic cabin adjusting system and vehicle-mounted terminal
Europäisches Patentamt | 2021
|Automobile intelligent cabin adjusting method, device and system based on video recognition
Europäisches Patentamt | 2020
|Silkworm cocoon type cabin and intelligent adjusting system
Europäisches Patentamt | 2022
|