3D object detection has aroused increasing interest as a crucial component of autonomous driving systems. While recent works have explored various multi-modal fusion methods to enhance accuracy and robustness, fusing multi-view images and high-definition (HD) maps remains uncharted. Inspired by our previous work, we endeavor to introduce HD maps to camera-based detection, prompting the design of a new framework. To address this, we first analyze the function of HD maps in object detection to understand their benefits and the rationale for their fusion. From this analysis, we identify key disparities in view, semantics, and scale, leading to the development of MIM, a framework for HD Maps Incorporated Multi-view 3D object detection. HD maps are enriched in semantics by sampling unlabeled areas and encoding them into map features. Simultaneously, multi-view images are transformed into features in bird’s-eye view (BEV) using the adopted baseline. These features are then fused using attention mechanisms to align scales. Experiments conducted on the nuScenes dataset demonstrate that MIM outperforms camera-based methods. Moreover, an in-depth analysis investigates how HD maps impact object detection regarding each semantic layer. The results underscore the operational intricacies of HD maps in perception, setting the stage for future research. Code is available at https://github.com/WHU-xjs/MIM-3D-Det.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MIM: High-Definition Maps Incorporated Multi-View 3D Object Detection


    Contributors:


    Publication date :

    2025-03-01


    Size :

    2455510 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Learned Enrichment of Top-View Grid Maps Improves Object Detection

    Wirges, Sascha / Yang, Ye / Richter, Sven et al. | IEEE | 2020


    View-based object recognition using saliency maps

    Shokoufandeh, A. / Marsic, I. / Dickinson, S. J. | British Library Online Contents | 1999


    AUTONOMOUS VEHICLE PARKING USING HIGH-DEFINITION MAPS

    MOCHERLA ANISHA / RUSIGNOLA MICHAEL / ZHANG KEVIN | European Patent Office | 2024

    Free access

    MODEL-BASED LOCALIZATION ON HIGH-DEFINITION MAPS

    ZHOU MIANWEI / CHEN YIBO / BHATIA ABHISHEK | European Patent Office | 2024

    Free access

    Enhanced high definition maps for a vehicle

    MOUSTAFA HASSNAA / ANANDARAJ SUBRAMANIAN / PINHEIRO ANA LUCIA et al. | European Patent Office | 2024

    Free access