The invention relates to the technical field of intelligent driving, and discloses an intelligent networked automobile multi-modal sensing and decision-making system based on deep learning, and the system comprises a multi-modal data collection module which is used for collecting image data and radar time sequence data around a vehicle through a vehicle-mounted camera and a vehicle-mounted radar sensor, the surrounding environment of the vehicle can be sensed in all directions; the image data processing module is used for processing the image data by using an improved deep learning model and extracting target object feature information in the image; the radar data processing module is used for analyzing the change trend of the radar time sequence data and making an optimal driving decision according to different traffic scenes in combination with the feature information of the target object; and the optimal decision execution module is used for executing an optimal decision action according to the optimal driving decision. According to the invention, high-precision perception and quick response to environment information in a complex traffic scene can be realized, the driving safety is improved, and the traffic efficiency is optimized.
本发明涉及智能驾驶技术领域,公开了一种基于深度学习的智能网联汽车多模态感知与决策系统,包括:多模态数据采集模块,用于通过车载摄像头和车载雷达传感器采集车辆周围的图像数据和雷达时间序列数据,以对车辆周围环境进行全方位感知;图像数据处理模块,用于利用改进的深度学习模型对所述图像数据进行处理,提取图像中的目标物体特征信息;雷达数据处理模块,用于对所述雷达时间序列数据的变化趋势进行分析,并结合所述目标物体特征信息,根据不同交通场景做出最优行车决策;最优决策执行模块,用于根据所述最优行车决策来执行最优决策动作。本发明能够实现在复杂交通场景下对环境信息的高精度感知与快速响应,提高行车安全并优化交通效率。
Intelligent networked automobile multi-mode sensing and decision-making system based on deep learning
基于深度学习的智能网联汽车多模态感知与决策系统
2025-04-01
Patent
Electronic Resource
Chinese
IPC: | G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion |
SRL-based intelligent networked automobile function degradation decision-making method and system
European Patent Office | 2025
|European Patent Office | 2025
|Lane-changing decision-making and trajectory planning method for intelligent networked automobile
European Patent Office | 2024
|European Patent Office | 2024
|Intelligent networked automobile data sensing method based on mutual information
European Patent Office | 2022
|