Knowledge distillation has recently been proven to be effective for model compression and acceleration of point cloud-based 3D object detection. However, the complementary network pruning is often overlooked during knowledge distillation. In this paper, we propose a pre-pruned distillation framework that combines network pruning and knowledge distillation to better transfer knowledge from the teacher to the student. To maintain the feature consistency between the student and the teacher, we train a teacher model and then generate a compact student model by structural channel pruning. Then, we employ multi-source knowledge distillation to transfer both mid-level and high-level information to the student model. Additionally, to improve the object detection performance of the student model, we propose a soft pivotal position selection mask to emphasize the features of the foreground regions during distillation. We conduct experiments on both pillarand voxel-based 3D object detectors on the Waymo datasets, demonstrating the effectiveness of our approach in compressing point cloud-based 3D detectors.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Pre-pruned Distillation for Point Cloud-based 3D Object Detection


    Beteiligte:
    Li, Fuyang (Autor:in) / Min, Chen (Autor:in) / Xiao, Liang (Autor:in) / Zhao, Dawei (Autor:in) / Si, Shubin (Autor:in) / Xue, Hanzhang (Autor:in) / Nie, Yiming (Autor:in) / Dai, Bin (Autor:in)


    Erscheinungsdatum :

    02.06.2024


    Format / Umfang :

    1519633 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Local pruning global pruned network under knowledge distillation

    Luo, Hanyi / Tang, Hao / Zhan, Kun | British Library Conference Proceedings | 2021


    Fast interpolation for line-pruned images

    Le, A.V. / Kim, H.-m. / Won, C.S. | British Library Online Contents | 2011


    Localization Distillation for Object Detection

    Zheng, Zhaohui / Ye, Rongguang / Hou, Qibin et al. | ArXiv | 2022

    Freier Zugriff

    Covariance based point cloud descriptors for object detection and recognition

    Fehr, Duc / Beksi, William J. / Zermas, Dimitris et al. | British Library Online Contents | 2016


    Multi-view 3D Object Detection Based on Point Cloud Enhancement

    Chen, Shijie / Wang, Wei | Springer Verlag | 2022