The invention relates to the technical field of information processing, and provides a decision-making method and system based on external environment multi-modal information perception, and the method comprises the steps: carrying out the feature fusion of camera data and laser radar data under a normal weather condition, obtaining first fusion data, and enabling the first fusion data to be used for a driving decision; and under a severe weather condition, feature fusion is performed on the first fusion data and the millimeter wave radar data to obtain second fusion data, and the second fusion data is used for driving decision making. By means of the technical scheme, the problem that in the prior art, an unmanned automobile is poor in environment sensing precision is solved.

    本发明涉及信息处理技术领域,提出了一种基于外环境多模态信息感知的决策方法及系统,在正常天气条件下,将摄像头数据和激光雷达数据进行特征融合,得到第一融合数据,所述第一融合数据用于驾驶决策;在恶劣天气条件下,将第一融合数据和毫米波雷达数据进行特征融合,得到第二融合数据,所述第二融合数据用于驾驶决策。通过上述技术方案,解决了现有技术中无人驾驶汽车对环境感知精度差的问题。


    Access

    Download


    Export, share and cite



    Title :

    Decision-making method and system based on external environment multi-modal information perception


    Additional title:

    一种基于外环境多模态信息感知的决策方法及系统


    Contributors:
    GU LIFANG (author) / ZHANG YONGCHANG (author)

    Publication date :

    2023-01-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion




    Automatic driving decision-making system based on multi-modal perception and hierarchical action

    ZHENG KAI / SU HAN / LIU SHUNCHENG et al. | European Patent Office | 2023

    Free access

    Parameterized Decision-making with Multi-modal Perception for Autonomous Driving

    Xia, Yuyang / Liu, Shuncheng / Yu, Quanlin et al. | ArXiv | 2023

    Free access


    Evidential deep learning-based multi-modal environment perception for intelligent vehicles

    Geletu, Mihreteab Negash / Giurgi, Danut-Vasile / Josso-Laurain, Thomas et al. | IEEE | 2023