Autonomous vehicles require constant environmental perception to obtain the distribution of obstacles to achieve safe driving. Specifically, 3D object detection is a vital functional module as it can simultaneously predict surrounding objects' categories, locations, and sizes. Generally, autonomous vehicles are equipped with multiple sensors, including cameras and LiDARs. The fact that single-modal methods suffer from unsatisfactory detection performance motivates utilizing multiple modalities as inputs to compensate for single sensor faults. Although many multi-modal fusion detection algorithms exist, there is still a lack of comprehensive and in-depth analysis of these methods to clarify how to fuse multi-modal data effectively. Therefore, this paper surveys recent advancements in fusion detection methods. First, we present the broad background of multi-modal 3D object detection and identify the characteristics of widely used datasets along with their evaluation metrics. Second, instead of the traditional classification method of early, middle, and late fusion, we categorize and analyze all fusion methods from three aspects: feature representation, alignment, and fusion, which reveals how these fusion methods are implemented in an essential way. Third, we provide an in-depth comparison of their pros and cons and compare their performance in mainstream datasets. Finally, we further summarize current challenges and research trends for realizing the full potential of multi-modal 3D object detection.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-Modal 3D Object Detection in Autonomous Driving: A Survey and Taxonomy


    Beteiligte:
    Wang, Li (Autor:in) / Zhang, Xinyu (Autor:in) / Song, Ziying (Autor:in) / Bi, Jiangfeng (Autor:in) / Zhang, Guoxin (Autor:in) / Wei, Haiyue (Autor:in) / Tang, Liyao (Autor:in) / Yang, Lei (Autor:in) / Li, Jun (Autor:in) / Jia, Caiyan (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-07-01


    Format / Umfang :

    8054979 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Leveraging Uncertainties for Deep Multi-modal Object Detection in Autonomous Driving

    Feng, Di / Cao, Yifan / Rosenbaum, Lars et al. | IEEE | 2020




    EVALUATING MULTI-MODAL TRAJECTORY PREDICTIONS FOR AUTONOMOUS DRIVING

    ETTINGER SCOTT MORGAN / ANGUELOV DRAGOMIR | Europäisches Patentamt | 2022

    Freier Zugriff

    A Survey on 3D Object Detection Methods for Autonomous Driving Applications

    Arnold, Eduardo / Al-Jarrah, Omar Y. / Dianati, Mehrdad et al. | IEEE | 2019