In recent years, with the advancement of artificial intelligence technology, autonomous driving technologies have gradually emerged. 3D object detection using point clouds has become a key in this field. Multi-frame fusion of point clouds is a promising technique to enhance 3D object detection for autonomous driving systems. However, most existing multi-frame detection methods focus primarily on utilizing vehicle-side lidar data. Infrastructure-side detection remains relatively unexplored, yet can enhance vital vehicle-road coordination capabilities. To help with this coordination, we propose an efficient multi-frame aggregation multi-scale fusion network specifically for infrastructure-side 3D object detection. First, our key innovation is a novel multi-frame feature aggregation module that effectively integrates information from multiple past point cloud frames to improve detection accuracy. This module comprises a feature pyramid network to fuse multi-scale features, as well as a cross-attention mechanism to learn semantic correlations between different frames over time. Next, we incorporate deformable attention, which reduces the computational overhead of aggregation by sampling locations. We designed Multi-frame and Multi-scale modules, thereby we named the model MAMF-Net. Finally, through extensive experiments on two infrastructure-side datasets including the V2X-Seq-SPD dataset which was released by Baidu corporation, we demonstrate that MAMF-Net delivers consistent accuracy improvements over single frame detectors such as PointPillars, PV-RCNN and TED-S, especially boosting pedestrian detection by 5%. Our approach also surpasses other multi-frame methods designed for vehicle-side point clouds such as MPPNet.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Infrastructure-Side Point Cloud Object Detection via Multi-Frame Aggregation and Multi-Scale Fusion


    Beteiligte:
    Yue, Ye (Autor:in) / Qi, Honggang (Autor:in) / Deng, Yongqiang (Autor:in) / Li, Juanjuan (Autor:in) / Liang, Hao (Autor:in) / Miao, Jun (Autor:in)


    Erscheinungsdatum :

    01.01.2025


    Format / Umfang :

    2706307 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-Scale Fusion for Object Representation

    Zhao, Rongzhen / Wang, Vivienne / Kannala, Juho et al. | ArXiv | 2024

    Freier Zugriff

    RGB pixel-block point-cloud fusion for object detection

    Foster, Timothy / Dalal, Ajaya / Ball, John E. | British Library Conference Proceedings | 2021



    Multi-view 3D Object Detection Based on Point Cloud Enhancement

    Chen, Shijie / Wang, Wei | Springer Verlag | 2022


    PPF-Det: Point-Pixel Fusion for Multi-Modal 3D Object Detection

    Xie, Guotao / Chen, Zhiyuan / Gao, Ming et al. | IEEE | 2024