The BERT-style (Bidirectional Encoder Representations from Transformers) pre-training paradigm has achieved remarkable success in both NLP (Natural Language Processing) and CV (Computer Vision). However, due to the sparsity and lack of semantic information in point cloud data, directly applying this paradigm faces significant obstacles. To address these issues, we propose LSV-MAE, a masked autoencoding pre-training scheme designed for voxel representations. We pre-train the backbone to reconstruct the masked voxels features extracted by PointNN. To enhance the feature extraction capability of the encoder, the point cloud is voxelized with different voxel sizes at different pre-training stages. Meanwhile, to minimize the effect of masking key points during the masking stage, the masked voxel features is re-integrated during the decoder processing. To test the proposed approach, experiments are conducted on well-known datasets. It is shown that the proposed method can improve detection accuracy by 1% to 18%, compared to the model without pre-training, across datasets of different sizes.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Rethinking Masked-Autoencoder-Based 3D Point Cloud Pretraining


    Beteiligte:
    Cheng, Nuo (Autor:in) / Luo, Chuanyu (Autor:in) / Li, Xinzhe (Autor:in) / Hu, Ruizhi (Autor:in) / Li, Han (Autor:in) / Ma, Sikun (Autor:in) / Ren, Zhong (Autor:in) / Jiang, Haipeng (Autor:in) / Li, Xiaohan (Autor:in) / Lei, Shengguang (Autor:in)


    Erscheinungsdatum :

    02.06.2024


    Format / Umfang :

    1338115 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    APS: ACTIVE PRETRAINING WITH SUCCESSOR FEATURES

    LIU, HAO / ABBEEL, PIETER | TIBKAT | 2022


    The point - Rethinking luxury

    Cumberford, Robert | Online Contents | 2001


    Rethinking the White Point

    Farrell, J. E. / Wandell, B. A. / Society for Information Display et al. | British Library Conference Proceedings | 1993


    Score-Based Multimodal Autoencoder

    Wesego, Daniel / Rooshenas, Pedram | ArXiv | 2023

    Freier Zugriff