The invention belongs to the technical field of driving assistance systems, and discloses a multimode driving behavior prediction method based on eye movement records and camera monitoring, which is applied to an ADAS system for warning or reminding dangerous driving actions. In order to solve the use problem that a current driving behavior prediction task lacks eye movement information of a driver, a glasses type eye tracker is used for collecting eye movement data, the driving behavior is predicted, and dangerous driving behaviors are assisted to be warned or reminded. Therefore, a driver driving behavior data set in a real scene is established. And then, four channel networks are respectively used for extracting different modal data set features, and then the features are fused for driving behavior prediction. And finally, driving behavior prediction is carried out in a real driving scene, and 74.02% of driving behaviors can be accurately predicted 5.156 s ahead of time. The invention provides an effective method for the ADAS system to predict the driving behavior.
本发明属于驾驶辅助系统技术领域,公开了一种基于眼动记录和摄像监控的多模驾驶行为预测方法,应用于ADAS系统对危险驾驶动作进行警示或提醒。针对当前驾驶行为预测任务缺乏驾驶员眼动信息的使用问题,使用眼镜式眼动仪采集眼动数据,预测驾驶行为,辅助对危险驾驶行为进行警示或提醒。为此,本发明建立一个真实场景下驾驶员驾驶行为数据集。然后,分别使用四个通道网络提取不同模态数据集特征再融合各特征进行驾驶行为预测。最后,在真实驾驶场景下进行驾驶行为预测,可以提前5.156s准确预测74.02%的驾驶行为。本发明为ADAS系统预测驾驶行为提供了一种有效的方法。
Multi-mode driving behavior prediction method based on eye movement record and camera monitoring
一种基于眼动记录和摄像监控的多模驾驶行为预测方法
2024-10-01
Patent
Electronic Resource
Chinese
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V |
Behavior based driving record management and rehabilitation
European Patent Office | 2016
|BEHAVIOR BASED DRIVING RECORD MANAGEMENT AND REHABILITATION
European Patent Office | 2022
|Multi-mode driving method and device of camera, vehicle and storage medium
European Patent Office | 2024
|Driving behavior record management system and method based on image processing
European Patent Office | 2020
|Driving behavior monitoring vehicle service platform system and driving behavior monitoring method
European Patent Office | 2023
|