Many LiDAR-based methods for detecting large objects, single-class object detection, or under easy situations were claimed to perform well. However, due to their failure to exploit image semantics, their performance in detecting small targets or under challenging conditions does not exceed that of fusion-based approaches. In order to elevate the detection performance in a complex environment, this paper proposes a multi-modal and multi-class 3D object detection network, named Voxel-Pixel Fusion Network (VoPiFNet). Within this network, we design a key novel component called the Voxel-Pixel Fusion Layer, which takes advantage of the geometric relation of a voxel-pixel pair and effectively fuses voxel features and pixel features with the cross-modal attention mechanism. Moreover, after considering the characteristics of the voxel-pixel pair, we design four parameters to guide and enhance this fusion effect. This proposed layer can be integrated with voxel-based 3D LiDAR detectors and 2D image detectors. Finally, the proposed method is evaluated on the public KITTI benchmark dataset for multi-class 3D object detection at different levels. Extensive experiments show that our method outperforms the state-of-the-art methods in detecting challenging pedestrian category and achieve promising performance in overall 3D mean average precision (mAP).


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    VoPiFNet: Voxel-Pixel Fusion Network for Multi-Class 3D Object Detection


    Beteiligte:
    Wang, Chia-Hung (Autor:in) / Chen, Hsueh-Wei (Autor:in) / Chen, Yi (Autor:in) / Hsiao, Pei-Yung (Autor:in) / Fu, Li-Chen (Autor:in)


    Erscheinungsdatum :

    01.08.2024


    Format / Umfang :

    2339785 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Point-Voxel Fusion for Multimodal 3D Detection

    Wang, Ke / Zhang, Zhichuang | IEEE | 2022


    PPF-Det: Point-Pixel Fusion for Multi-Modal 3D Object Detection

    Xie, Guotao / Chen, Zhiyuan / Gao, Ming et al. | IEEE | 2024


    RGB pixel-block point-cloud fusion for object detection

    Foster, Timothy / Dalal, Ajaya / Ball, John E. | British Library Conference Proceedings | 2021



    Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

    Luo, Xizhao / Zhou, Feng / Tao, Chongben et al. | IEEE | 2022