Camera-LiDAR 3D object detection has been extensively investigated due to its significance for many real-world applications. However, there are still of great challenges to address the intrinsic data difference and perform accurate feature fusion among two modalities. To these ends, we propose a two-stream architecture termed as CL3D, that integrates with point enhancement module, point-guided fusion module with IoU-aware head for cross-modal 3D object detection. Specifically, pseudo LiDAR is firstly generated from RGB image, and point enhancement module (PEM) is then designed to enhance the raw LiDAR with pseudo point. Moreover, point-guided fusion module (PFM) is developed to find image-point correspondence at different resolutions, and incorporate semantic with geometric features in a point-wise manner. We also investigate the inconsistency between localization confidence and classification score in 3D detection, and introduce IoU-aware prediction head (IoU Head) for accurate box regression. Comprehensive experiments are conducted on publicly available KITTI dataset, and CL3D reports the outstanding detection performance compared to both single- and multi-modal 3D detectors, demonstrating its effectiveness and competitiveness.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CL3D: Camera-LiDAR 3D Object Detection With Point Feature Enhancement and Point-Guided Fusion


    Contributors:
    Lin, Chunmian (author) / Tian, Daxin (author) / Duan, Xuting (author) / Zhou, Jianshan (author) / Zhao, Dezong (author) / Cao, Dongpu (author)

    Published in:

    Publication date :

    2022-10-01


    Size :

    3038342 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    TOP-DOWN OBJECT DETECTION FROM LIDAR POINT CLOUDS

    SMOLYANSKIY NIKOLAI / OLDJA RYAN / CHEN KE et al. | European Patent Office | 2021

    Free access

    Deep Learning-based Radar, Camera, and Lidar Fusion for Object Detection

    Nobis, Felix Otto Geronimo | TIBKAT | 2022

    Free access