In recent years, with the advancement of artificial intelligence technology, autonomous driving technologies have gradually emerged. 3D object detection using point clouds has become a key in this field. Multi-frame fusion of point clouds is a promising technique to enhance 3D object detection for autonomous driving systems. However, most existing multi-frame detection methods focus primarily on utilizing vehicle-side lidar data. Infrastructure-side detection remains relatively unexplored, yet can enhance vital vehicle-road coordination capabilities. To help with this coordination, we propose an efficient multi-frame aggregation multi-scale fusion network specifically for infrastructure-side 3D object detection. First, our key innovation is a novel multi-frame feature aggregation module that effectively integrates information from multiple past point cloud frames to improve detection accuracy. This module comprises a feature pyramid network to fuse multi-scale features, as well as a cross-attention mechanism to learn semantic correlations between different frames over time. Next, we incorporate deformable attention, which reduces the computational overhead of aggregation by sampling locations. We designed Multi-frame and Multi-scale modules, thereby we named the model MAMF-Net. Finally, through extensive experiments on two infrastructure-side datasets including the V2X-Seq-SPD dataset which was released by Baidu corporation, we demonstrate that MAMF-Net delivers consistent accuracy improvements over single frame detectors such as PointPillars, PV-RCNN and TED-S, especially boosting pedestrian detection by 5%. Our approach also surpasses other multi-frame methods designed for vehicle-side point clouds such as MPPNet.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Infrastructure-Side Point Cloud Object Detection via Multi-Frame Aggregation and Multi-Scale Fusion


    Contributors:
    Yue, Ye (author) / Qi, Honggang (author) / Deng, Yongqiang (author) / Li, Juanjuan (author) / Liang, Hao (author) / Miao, Jun (author)


    Publication date :

    2025-01-01


    Size :

    2706307 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    RGB pixel-block point-cloud fusion for object detection

    Foster, Timothy / Dalal, Ajaya / Ball, John E. | British Library Conference Proceedings | 2021



    Multi-view 3D Object Detection Based on Point Cloud Enhancement

    Chen, Shijie / Wang, Wei | Springer Verlag | 2022


    Multi-Scale Fusion for Object Representation

    Zhao, Rongzhen / Wang, Vivienne / Kannala, Juho et al. | ArXiv | 2024

    Free access

    PPF-Det: Point-Pixel Fusion for Multi-Modal 3D Object Detection

    Xie, Guotao / Chen, Zhiyuan / Gao, Ming et al. | IEEE | 2024