Semantic segmentation of 3D point cloud is a key task in numerous intelligent transportation system applications, e.g., self-driving vehicles, traffic monitoring. Due to the sparsity and varying density of points in the outdoor point clouds, it becomes particularly challenging to extract object-centric features from data. This leads to poor semantic segmentation, especially for the rare object classes. To address that, we introduce the first-ever Slot Attention Transformer based technique to effectively model object-centric features in point cloud data. Our method uses cylindrical splits of space for voxelization and computes channel-wise positional embeddings before repetitively encoding the point cloud with slot attentions. Our second major contribution is a Large-Scale Outdoor Point Cloud dataset (SWAN), collected in a dense urban environment, driving 150km distance. It provides 16 billion points in more than 200K frames. The dataset also provides annotations for 10K frames for 24 classes. We also contribute a data augmentation scheme to handle rare object classes in real-world point clouds. Besides benchmarking popular existing methods on SWAN for the first time, we thoroughly evaluate our technique on the existing large-scale datasets, Semantic KITTI and nuScenes. Our results demonstrate a consistent performance gain for our technique, and verify the need of the more challenging SWAN dataset.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SAT3D: Slot Attention Transformer for 3D Point Cloud Semantic Segmentation


    Contributors:


    Publication date :

    2023-05-01


    Size :

    2991894 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Deep Learning on 3D Point Cloud for Semantic Segmentation

    Ning, Zhihan / Tang, Linlin / Qi, Shuhan et al. | TIBKAT | 2022


    Deep Learning on 3D Point Cloud for Semantic Segmentation

    Ning, Zhihan / Tang, Linlin / Qi, Shuhan et al. | Springer Verlag | 2021


    TransRVNet: LiDAR Semantic Segmentation With Transformer

    Cheng, Hui-Xian / Han, Xian-Feng / Xiao, Guo-Qiang | IEEE | 2023


    Leveraging Smooth Deformation Augmentation for LiDAR Point Cloud Semantic Segmentation

    Qiu, Shoumeng / Chen, Jie / Lai, Chenghang et al. | IEEE | 2024

    Free access