The invention relates to the technical field of intelligent driving, and discloses an intelligent networked automobile multi-modal sensing and decision-making system based on deep learning, and the system comprises a multi-modal data collection module which is used for collecting image data and radar time sequence data around a vehicle through a vehicle-mounted camera and a vehicle-mounted radar sensor, the surrounding environment of the vehicle can be sensed in all directions; the image data processing module is used for processing the image data by using an improved deep learning model and extracting target object feature information in the image; the radar data processing module is used for analyzing the change trend of the radar time sequence data and making an optimal driving decision according to different traffic scenes in combination with the feature information of the target object; and the optimal decision execution module is used for executing an optimal decision action according to the optimal driving decision. According to the invention, high-precision perception and quick response to environment information in a complex traffic scene can be realized, the driving safety is improved, and the traffic efficiency is optimized.

    本发明涉及智能驾驶技术领域,公开了一种基于深度学习的智能网联汽车多模态感知与决策系统,包括:多模态数据采集模块,用于通过车载摄像头和车载雷达传感器采集车辆周围的图像数据和雷达时间序列数据,以对车辆周围环境进行全方位感知;图像数据处理模块,用于利用改进的深度学习模型对所述图像数据进行处理,提取图像中的目标物体特征信息;雷达数据处理模块,用于对所述雷达时间序列数据的变化趋势进行分析,并结合所述目标物体特征信息,根据不同交通场景做出最优行车决策;最优决策执行模块,用于根据所述最优行车决策来执行最优决策动作。本发明能够实现在复杂交通场景下对环境信息的高精度感知与快速响应,提高行车安全并优化交通效率。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent networked automobile multi-mode sensing and decision-making system based on deep learning


    Additional title:

    基于深度学习的智能网联汽车多模态感知与决策系统


    Contributors:
    CHEN DAOQUAN (author) / XU JINFENG (author) / HAN JIABO (author) / CHEN NING (author) / GAO ZHANYAO (author) / JIN LEILEI (author)

    Publication date :

    2025-04-01


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    SRL-based intelligent networked automobile function degradation decision-making method and system

    LI YANG / LI JIAN / QIN HONGMAO et al. | European Patent Office | 2025

    Free access

    Intelligent networked PHEV multi-driving-mode autonomous decision control method based on deep learning

    LEI ZHENZHEN / ZHANG SHUAI / XUE ALONG et al. | European Patent Office | 2025

    Free access

    Lane-changing decision-making and trajectory planning method for intelligent networked automobile

    ZHAO MIN / SUN DIHUA / WANG YAO | European Patent Office | 2024

    Free access

    Intelligent automobile decision-making method based on driving intention and deep reinforcement learning

    PEI XIAOFEI / LU SONGXIN / YANG BO | European Patent Office | 2024

    Free access

    Intelligent networked automobile data sensing method based on mutual information

    XIANG CHAOCAN / CHEN RUI / CHENG LIANGHUA et al. | European Patent Office | 2022

    Free access