3D object detection is becoming an indispensable functional module for environmental perception in autonomous driving, and LiDAR-based detection methods have made remarkable progress in terms of accuracy. However, point clouds often fail to distinguish objects with similar structures, leading to false detection. Therefore, other sensors and LiDAR fusion are naturally considered a solution. Nevertheless, current fusion methods are either limited to poor precision or efficiency. To this end, this chapter proposes a plug-and-play module named RI-Fusion to achieve the effective fusion of LiDAR and camera, and the module can be easily accessed by existing LiDAR-based algorithms. Furthermore, a particular fusion method of RaDAR and 16-line LiDAR based on multimodal and multi-scale fusion is proposed, called \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M^{2}$$\end{document}-Fusion. The interaction is achieved by learning the features of each modality by exchanging the information of the intermediate feature layers with a self-attention mechanism. Experiments show that the method has better environmental adaptability and low cost.
Multi-Sensor Object Detection
Multi-sensor Fusion for Autonomous Driving ; Chapter : 4 ; 51-85
2023-05-11
35 pages
Article/Chapter (Book)
Electronic Resource
English
Multi-Sensor Probabilistic Object Detection and Automated Braking
European Patent Office | 2019
|Multi-sensor probabilistic object detection and automated braking
European Patent Office | 2019
|Multi-Sensor Fusion and Enhancement for Object Detection
NTRS | 2005
|Multi-sensor probabilistic object detection and automated braking
European Patent Office | 2018
|