LiDAR point cloud semantic segmentation algorithm is crucial to the environmental understanding of unmanned vehicles. At this stage, in autonomous vehicles, effectively integrating the complementary information of LiDAR and camera has become the focus of research. In this work, a network framework (called PI-Seg) for LiDAR point clouds semantic segmentation by fusing appearance features of RGB images is proposed. In this paper, the perspective projection module is introduced to align and synchronize point clouds with images to reduce appearance information loss. And an efficient and concise dual-flow feature extraction network is designed, a fusion module based on a continuous convolution structure is used for feature fusion, which effectively reduces the amount of parameters and runtime performance, and more suitable for autonomous driving scenarios. Finally, the fused features are added to the LiDAR point cloud features as the final output features, and the point cloud category label prediction is realized through the MLP network. The experimental results demonstrate that PI-Seg has a 5.3% higher mIoU score than SalsaNext, which is also a projection-based method, and still has a 1.4% performance improvement compared with the latest Cylinder3D algorithm, and in quantitative analyses the mAP value also has the best performance, showing that PI-Seg is better than other existing methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving


    Additional title:

    Int.J Automot. Technol.


    Contributors:
    Du, Jiahao (author) / Huang, Xiaoci (author) / Xing, Mengyang (author) / Zhang, Tao (author)

    Published in:

    Publication date :

    2023-06-01


    Size :

    11 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    RGB and LiDAR fusion based 3D Semantic Segmentation for Autonomous Driving

    El Madawi, Khaled / Rashed, Hazem / El Sallab, Ahmad et al. | IEEE | 2019


    Leveraging Smooth Deformation Augmentation for LiDAR Point Cloud Semantic Segmentation

    Qiu, Shoumeng / Chen, Jie / Lai, Chenghang et al. | IEEE | 2024

    Free access

    Vehicle Detection and Localization using 3D LIDAR Point Cloud and Image Semantic Segmentation

    Barea, Rafael / Perez, Carlos / Bergasa, Luis M. et al. | IEEE | 2018


    Fast Semantic Segmentation of 3D Lidar Point Cloud Based on Random Forest Method

    Jiang, Songdi / Guo, Wei / Fan, Yuzhi et al. | TIBKAT | 2022


    Fast Semantic Segmentation of 3D Lidar Point Cloud Based on Random Forest Method

    Jiang, Songdi / Guo, Wei / Fan, Yuzhi et al. | Springer Verlag | 2022