The invention discloses an automatic driving vehicle safety control method and device based on multi-modal data. The method comprises the steps that first driving information including first position information and first speed information, 3D point cloud data including a driving environment and video stream driving environment information including the driving environment in the driving process of a target driving vehicle are obtained; determining feature information of each first obstacle in at least one first obstacle in the driving environment based on the driving environment information, wherein the feature information comprises second position information and second speed information; the first driving information and the feature information of each first obstacle are utilized to determine the collision time of the target driving vehicle and each first obstacle, and at least one collision time corresponding to at least one first obstacle is obtained; and predicting whether the driver needs to take over the target driving vehicle according to the at least one collision time. And the prediction accuracy of predicting whether the driver needs to take over the vehicle driving in a complex urban road scene is improved.

    本申请公开了一种基于多模态数据的自动驾驶车辆安全控制方法及装置,方法为获取目标行驶车辆在行驶过程中包括第一位置信息与第一速度信息的第一行驶信息与包括行驶环境的3D点云数据及行驶环境的视频流行驶环境信息;基于行驶环境信息确定出行驶环境内的至少一个第一障碍物中各第一障碍物的特征信息,特征信息包括第二位置信息与第二速度信息;利用第一行驶信息与各第一障碍物的特征信息确定目标行驶车辆与各第一障碍物的碰撞时间,得到至少一个第一障碍物对应的至少一个碰撞时间;根据至少一个碰撞时间预测是否需要驾驶员接管驾驶目标行驶车辆。提高在复杂城市道路场景中预测是否需要驾驶员进行车辆驾驶接管的预测准确度。


    Access

    Download


    Export, share and cite



    Title :

    Automatic driving vehicle safety control method and device based on multi-modal data


    Additional title:

    基于多模态数据的自动驾驶车辆安全控制方法及装置


    Publication date :

    2025-03-07


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Automatic driving safety assisting method and system based on multi-modal fusion

    CHEN LIN / LIANG HONGBIN / SHANG MINGSHENG et al. | European Patent Office | 2025

    Free access

    Multi-modal vehicle speed prediction method based on driving data

    WU GANG / YU BOYANG / WANG CHUNYAN et al. | European Patent Office | 2020

    Free access

    MULTI-MODAL MOVEMENT PLAN FRAMEWORK FOR AUTOMATIC DRIVING VEHICLE

    ZHANG YAJIA / LI DONG / ZHANG RANRAN et al. | European Patent Office | 2020

    Free access

    Automatic driving model, method and device capable of realizing multi-modal interaction and vehicle

    HUANG JIZHOU / WANG FAN | European Patent Office | 2024

    Free access

    Vehicle automatic driving safety control method and system

    YANG QIYONG / GUO ZHONGLIANG / LI HUI et al. | European Patent Office | 2024

    Free access