The invention discloses an automatic driving vehicle safety control method and device based on multi-modal data. The method comprises the steps that first driving information including first position information and first speed information, 3D point cloud data including a driving environment and video stream driving environment information including the driving environment in the driving process of a target driving vehicle are obtained; determining feature information of each first obstacle in at least one first obstacle in the driving environment based on the driving environment information, wherein the feature information comprises second position information and second speed information; the first driving information and the feature information of each first obstacle are utilized to determine the collision time of the target driving vehicle and each first obstacle, and at least one collision time corresponding to at least one first obstacle is obtained; and predicting whether the driver needs to take over the target driving vehicle according to the at least one collision time. And the prediction accuracy of predicting whether the driver needs to take over the vehicle driving in a complex urban road scene is improved.
本申请公开了一种基于多模态数据的自动驾驶车辆安全控制方法及装置,方法为获取目标行驶车辆在行驶过程中包括第一位置信息与第一速度信息的第一行驶信息与包括行驶环境的3D点云数据及行驶环境的视频流行驶环境信息;基于行驶环境信息确定出行驶环境内的至少一个第一障碍物中各第一障碍物的特征信息,特征信息包括第二位置信息与第二速度信息;利用第一行驶信息与各第一障碍物的特征信息确定目标行驶车辆与各第一障碍物的碰撞时间,得到至少一个第一障碍物对应的至少一个碰撞时间;根据至少一个碰撞时间预测是否需要驾驶员接管驾驶目标行驶车辆。提高在复杂城市道路场景中预测是否需要驾驶员进行车辆驾驶接管的预测准确度。
Automatic driving vehicle safety control method and device based on multi-modal data
基于多模态数据的自动驾驶车辆安全控制方法及装置
2025-03-07
Patent
Electronic Resource
Chinese
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion |
Automatic driving safety assisting method and system based on multi-modal fusion
European Patent Office | 2025
|Multi-modal vehicle speed prediction method based on driving data
European Patent Office | 2020
|MULTI-MODAL MOVEMENT PLAN FRAMEWORK FOR AUTOMATIC DRIVING VEHICLE
European Patent Office | 2020
|Automatic driving model, method and device capable of realizing multi-modal interaction and vehicle
European Patent Office | 2024
|Vehicle automatic driving safety control method and system
European Patent Office | 2024
|