3D object detection is becoming an indispensable functional module for environmental perception in autonomous driving, and LiDAR-based detection methods have made remarkable progress in terms of accuracy. However, point clouds often fail to distinguish objects with similar structures, leading to false detection. Therefore, other sensors and LiDAR fusion are naturally considered a solution. Nevertheless, current fusion methods are either limited to poor precision or efficiency. To this end, this chapter proposes a plug-and-play module named RI-Fusion to achieve the effective fusion of LiDAR and camera, and the module can be easily accessed by existing LiDAR-based algorithms. Furthermore, a particular fusion method of RaDAR and 16-line LiDAR based on multimodal and multi-scale fusion is proposed, called M 2 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M^{2}$$\end{document}-Fusion. The interaction is achieved by learning the features of each modality by exchanging the information of the intermediate feature layers with a self-attention mechanism. Experiments show that the method has better environmental adaptability and low cost.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Sensor Object Detection


    Contributors:
    Zhang, Xinyu (author) / Li, Jun (author) / Li, Zhiwei (author) / Liu, Huaping (author) / Zhou, Mo (author) / Wang, Li (author) / Zou, Zhenhong (author)

    Published in:

    Publication date :

    2023-05-11


    Size :

    35 pages




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Multi-Sensor Probabilistic Object Detection and Automated Braking

    KADETOTAD SNEHA / JAIN JINESH J / NARIYAMBUT MURALI VIDYA et al. | European Patent Office | 2019

    Free access

    Multi-sensor probabilistic object detection and automated braking

    KADETOTAD SNEHA / JAIN JINESH J / MURALI VIDYA NARIYAMBUT et al. | European Patent Office | 2019

    Free access


    Multi-sensor probabilistic object detection and automated braking

    SNEHA KADETOTAD / JINESH J JAIN | European Patent Office | 2018

    Free access

    Object velocity detection from multi-modal sensor data

    PRADHAN SABEEK MANI / SLOAN COOPER STOKES | European Patent Office | 2023

    Free access