Camera-LiDAR 3D object detection has been extensively investigated due to its significance for many real-world applications. However, there are still of great challenges to address the intrinsic data difference and perform accurate feature fusion among two modalities. To these ends, we propose a two-stream architecture termed as CL3D, that integrates with point enhancement module, point-guided fusion module with IoU-aware head for cross-modal 3D object detection. Specifically, pseudo LiDAR is firstly generated from RGB image, and point enhancement module (PEM) is then designed to enhance the raw LiDAR with pseudo point. Moreover, point-guided fusion module (PFM) is developed to find image-point correspondence at different resolutions, and incorporate semantic with geometric features in a point-wise manner. We also investigate the inconsistency between localization confidence and classification score in 3D detection, and introduce IoU-aware prediction head (IoU Head) for accurate box regression. Comprehensive experiments are conducted on publicly available KITTI dataset, and CL3D reports the outstanding detection performance compared to both single- and multi-modal 3D detectors, demonstrating its effectiveness and competitiveness.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    CL3D: Camera-LiDAR 3D Object Detection With Point Feature Enhancement and Point-Guided Fusion


    Beteiligte:
    Lin, Chunmian (Autor:in) / Tian, Daxin (Autor:in) / Duan, Xuting (Autor:in) / Zhou, Jianshan (Autor:in) / Zhao, Dezong (Autor:in) / Cao, Dongpu (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-10-01


    Format / Umfang :

    3038342 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    TOP-DOWN OBJECT DETECTION FROM LIDAR POINT CLOUDS

    SMOLYANSKIY NIKOLAI / OLDJA RYAN / CHEN KE et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Deep Learning-based Radar, Camera, and Lidar Fusion for Object Detection

    Nobis, Felix Otto Geronimo | TIBKAT | 2022

    Freier Zugriff