The invention discloses a driver danger early warning method, device and equipment and a storage medium, and belongs to the technical field of automobiles. The method comprises the following steps: acquiring visible light image data shot by a first camera and infrared image data shot by a second camera; performing region fusion on the visible light image data and the infrared image data to obtain fused image data; identifying the fused image data through a preset target identification model to obtain target information; performing behavior prediction on a target object in the target information through a long-short-term memory model to obtain a prediction behavior of the target object; and performing early warning based on the prediction behavior, projecting the fused image data to a preset position so as to enhance the sight line of a driver, accurately predicting the merging lane of vehicles and pedestrians, performing early warning on the driver, and projecting the fused image data so as to improve the driving safety.

    本发明公开了一种驾驶员危险预警方法、装置、设备及存储介质,属于汽车技术领域。本发明通过获取第一摄像头拍摄的可见光图像数据以及第二摄像头拍摄的红外图像数据;将所述可见光图像数据与所述红外图像数据进行区域融合,得到融合图像数据;通过预设目标识别模型对所述融合图像数据进行识别,得到目标信息;通过长短期记忆模型对所述目标信息中的目标物体进行行为预测,得到目标物体的预测行为;基于所述预测行为进行预警,并将所述融合图像数据投影至预设位置,以增强驾驶员的视线,对车辆和行人汇入车道进行准确预测并给出驾驶员预警,将融合图像数据进行投影,提高驾驶的安全性。


    Access

    Download


    Export, share and cite



    Title :

    Driver danger early warning method, device and equipment and storage medium


    Additional title:

    驾驶员危险预警方法、装置、设备及存储介质


    Contributors:
    LI YINGYING (author) / TAN YIZHE (author) / ZHU ZHIBIN (author) / SHI SHENGMING (author) / MO ZHONGTING (author)

    Publication date :

    2022-04-15


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06K Erkennen von Daten , RECOGNITION OF DATA / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    Vehicle danger early warning method and device, electronic equipment and storage medium

    HOU YIXING / YU XIHANG / CHEN YANWEI et al. | European Patent Office | 2024

    Free access

    Driver early warning method, device and equipment and storage medium

    LIU ZHIZI / CHEN XING | European Patent Office | 2023

    Free access

    Lateral danger early warning method and device, vehicle and storage medium

    LI HAO / WANG WENRUI / WANG QIU et al. | European Patent Office | 2024

    Free access

    Driver fatigue early warning method and device, electronic equipment and storage medium

    LIU XIANGCHAO / YUAN LUFENG / LI ZHENYANG | European Patent Office | 2023

    Free access

    Road driving danger early warning method, device and equipment

    WANG QIANGQIANG | European Patent Office | 2020

    Free access