The invention belongs to the technical field of driving assistance systems, and discloses a multimode driving behavior prediction method based on eye movement records and camera monitoring, which is applied to an ADAS system for warning or reminding dangerous driving actions. In order to solve the use problem that a current driving behavior prediction task lacks eye movement information of a driver, a glasses type eye tracker is used for collecting eye movement data, the driving behavior is predicted, and dangerous driving behaviors are assisted to be warned or reminded. Therefore, a driver driving behavior data set in a real scene is established. And then, four channel networks are respectively used for extracting different modal data set features, and then the features are fused for driving behavior prediction. And finally, driving behavior prediction is carried out in a real driving scene, and 74.02% of driving behaviors can be accurately predicted 5.156 s ahead of time. The invention provides an effective method for the ADAS system to predict the driving behavior.

    本发明属于驾驶辅助系统技术领域,公开了一种基于眼动记录和摄像监控的多模驾驶行为预测方法,应用于ADAS系统对危险驾驶动作进行警示或提醒。针对当前驾驶行为预测任务缺乏驾驶员眼动信息的使用问题,使用眼镜式眼动仪采集眼动数据,预测驾驶行为,辅助对危险驾驶行为进行警示或提醒。为此,本发明建立一个真实场景下驾驶员驾驶行为数据集。然后,分别使用四个通道网络提取不同模态数据集特征再融合各特征进行驾驶行为预测。最后,在真实驾驶场景下进行驾驶行为预测,可以提前5.156s准确预测74.02%的驾驶行为。本发明为ADAS系统预测驾驶行为提供了一种有效的方法。


    Access

    Download


    Export, share and cite



    Title :

    Multi-mode driving behavior prediction method based on eye movement record and camera monitoring


    Additional title:

    一种基于眼动记录和摄像监控的多模驾驶行为预测方法


    Contributors:
    YAN HONGMEI (author) / WU ZHANGBI (author)

    Publication date :

    2024-10-01


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V



    Behavior based driving record management and rehabilitation

    BASIR OTMAN A / MINERS WILLIAM BEN / MANOHARAN SHUNKAR | European Patent Office | 2016

    Free access

    BEHAVIOR BASED DRIVING RECORD MANAGEMENT AND REHABILITATION

    BASIR OTMAN A / MINERS WILLIAM BEN / MANOHARAN SHUNKAR | European Patent Office | 2022

    Free access

    Multi-mode driving method and device of camera, vehicle and storage medium

    ZHANG PENG / LU YAOHUA / ZHANG BIAOWEN et al. | European Patent Office | 2024

    Free access

    Driving behavior record management system and method based on image processing

    ZHANG KAISHENG / ZHANG CHENJING / QIN BO | European Patent Office | 2020

    Free access

    Driving behavior monitoring vehicle service platform system and driving behavior monitoring method

    YANG JIAN / WANG CHAOHUI / ZHANG XIAOYU | European Patent Office | 2023

    Free access