Real-time 3D object detection is a cornerstone for the safe operation of drones and autonomous vehicles (AVs)—drones must avoid millimeter-scale power lines in cluttered airspace, while AVs require instantaneous recognition of pedestrians and vehicles in dynamic urban environments. Although significant progress has been made in detection methods based on point clouds, cameras, and multimodal fusion, the computational complexity of existing high-precision models struggles to meet the real-time requirements of vehicular edge devices. Additionally, during the model lightweighting process, issues such as multimodal feature coupling failure and the imbalance between classification and localization performance often arise. To address these challenges, this paper proposes a knowledge distillation framework for multimodal 3D object detection, incorporating attention guidance, rank-aware learning, and interactive feature supervision to achieve efficient model compression and performance optimization. Specifically: To enhance the student model’s ability to focus on key channel and spatial features, we introduce attention-guided feature distillation, leveraging a bird’s-eye view foreground mask and a dual-attention mechanism. To mitigate the degradation of classification performance when transitioning from two-stage to single-stage detectors, we propose ranking-aware category distillation by modeling anchor-level distribution. To address the insufficient cross-modal feature extraction capability, we enhance the student network’s image features using the teacher network’s point cloud spatial priors, thereby constructing a LiDAR-image cross-modal feature alignment mechanism. Experimental results demonstrate the effectiveness of the proposed approach in multimodal 3D object detection. On the KITTI dataset, our method improves network performance by 4.89% even after reducing the number of channels by half.


    Access

    Download


    Export, share and cite



    Title :

    MultiDistiller: Efficient Multimodal 3D Detection via Knowledge Distillation for Drones and Autonomous Vehicles


    Contributors:
    Binghui Yang (author) / Tao Tao (author) / Wenfei Wu (author) / Yongjun Zhang (author) / Xiuyuan Meng (author) / Jianfeng Yang (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Knowledge distillation for autonomous vehicles

    WANG MINFA / DING KAI / CHEN HAOYU et al. | European Patent Office | 2025

    Free access

    KNOWLEDGE DISTILLATION FOR AUTONOMOUS VEHICLES

    WANG MINFA / DING KAI / CHEN HAOYU et al. | European Patent Office | 2022

    Free access

    KNOWLEDGE DISTILLATION FOR AUTONOMOUS VEHICLES

    WANG MINFA / DING KAI / CHEN HAOYU et al. | European Patent Office | 2022

    Free access