The invention discloses a traffic road perception auxiliary driving early warning system, method and device based on machine vision. The method comprises the steps: collecting a road image in real time, and transmitting the collected road image to a Nvidia TX2 development board; the Nvidia TX2 development board is used for processing the received image; measuring and calculating the distance between the vehicle and a target object by utilizing a target distance measuring module according to the processed image, comparing the distance with the distance measured by a laser distance measuring module, and judging whether a distance measuring result needs to be corrected or not; judging whether the front is a traffic light by using a traffic light detection algorithm according to the processedimage; recognizing a lane where the vehicle is located by using a lane detection algorithm according to the processed image; the correction or recognition result is sent to a display and a voice earlywarning device; the display is used for displaying the correction or recognition result; and the voice early warning device is used for carrying out voice early warning prompt when the correction orrecognition result meets a preset condition. According to the method, the compressed deep learning recognition model is utilized, the calculation speed and accuracy of recognition are improved. Meanwhile, by comparing the measurement results of the two distance measurement algorithms, a driver can be informed in time when the distance measurement function of the system is abnormal, and the risk oftraffic accidents caused by misjudgment is reduced.

    一种基于机器视觉的交通道路感知辅助驾驶预警系统、方法及装置,该方法包括:实时采集道路图像,将采集的道路图像发送给Nvidia TX2开发板;所述Nvidia TX2开发板对接收的图像进行处理;根据处理后的图像利用目标测距模块测算本车与目标物的距离,比较所述距离与激光测距模块测得的距离,判断是否需要对测距结果进行修正;根据处理后的图像利用红绿灯检测算法判断前方是否为红绿灯;根据处理后的图像利用车道检测算法识别出本车所在的车道;将所述修正或识别的结果发送给显示器和语音预警装置;所述显示器,对所述修正或识别的结果进行显示;所述语音预警装置,在修正或识别的结果满足预设条件时进行语音预警提示。本发明利用压缩的深度学习的识别模型,提升了识别的计算速度和准确度,同时,通过对两种测距算法的测量结果进行比较,在系统的测距功能异常时能够及时通知驾驶员,降低因误判而引发交通事故的风险。


    Access

    Download


    Export, share and cite



    Title :

    Traffic road perception auxiliary driving early warning device based on machine vision


    Additional title:

    一种基于机器视觉的交通道路感知辅助驾驶预警装置


    Contributors:
    ZHU XIANGLEI (author) / HAO JIANYE (author) / DU ZHIBIN (author) / WANG ZAN (author) / YAN MING (author) / WANG HAICHI (author)

    Publication date :

    2020-06-26


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Active early warning type traffic road perception auxiliary driving early warning system

    ZHU XIANGLEI / HAO JIANYE / DU ZHIBIN et al. | European Patent Office | 2020

    Free access

    Road traffic early warning device

    PAN LINFENG / PAN RUOLI | European Patent Office | 2022

    Free access

    Road traffic early warning device

    CHEN JUN / LI BANGYU / ZHAO BIN | European Patent Office | 2023

    Free access

    Road traffic deceleration early warning device

    CHEN JUN / LI BANGYU / ZHAO BIN | European Patent Office | 2023

    Free access

    Road traffic early warning system and control method of road traffic early warning system

    XU GUOQING / RAO QINQUAN / XU GUOHUA et al. | European Patent Office | 2020

    Free access