3D detection task plays a crucial role in the perception system of intelligent vehicles. LiDAR-based 3D detectors perform well on particular autonomous driving benchmarks, but may poorly generalize to other domains. Existing 3D domain adaptive detection methods usually require annotation-related statistics or continuous refinement of pseudo-labels. The former is not always feasible for practical applications, while the latter lacks sufficient accurate supervision. In this work, we propose a novel unsupervised domain adaptive framework, namely Adaptation Via Proxy (AVP), that explicitly leverages cross-domain relationships to generate adequate high-quality samples, thus mitigating domain shifts for existing LiDAR-based 3D detectors. Specifically, we first train the detector on source domain with the curriculum example mining (CEM) strategy to enhance its generalization capability. Then, we integrate the profitable instance knowledge from the source domain with the contextual information from the target domain, to construct the instance-aware proxy, which is a data collection with diverse training scenes and stronger supervision. Finally, we fine-tune the pre-trained detector on the proxy data for further optimizing the detector to overcome domain gaps. To build the instance-aware proxy, two components are proposed, i.e., the multi-view multi-scale aggregation (MMA) method for producing high-quality pseudo-labels, and the hybrid instance augmentation (HIA) technique for integrating the knowledge from source annotations to enhance supervision. Note that AVP is architecture-agnostic thus it can be easily injected with any LiDAR-based 3D detectors. Extensive experiments on Waymo, nuScenes, KITTI and Lyft demonstrate the superiority of the proposed method over the state-of-the-art approaches for different adaptation scenarios.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptation via Proxy: Building Instance-Aware Proxy for Unsupervised Domain Adaptive 3D Object Detection


    Contributors:
    Li, Ziyu (author) / Yao, Yuncong (author) / Quan, Zhibin (author) / Qi, Lei (author) / Feng, Zhen-Hua (author) / Yang, Wankou (author)

    Published in:

    Publication date :

    2024-02-01


    Size :

    7260882 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Unsupervised Domain Adaptive Object Detection Using Forward-Backward Cyclic Adaptation

    Yang, Siqi / Wu, Lin / Wiliem, Arnold et al. | British Library Conference Proceedings | 2021


    Proxy system

    YAMAMOTO YOSHITAKA | European Patent Office | 2023

    Free access

    Proxy device, proxy system, and computer-readable storage medium

    KUBO CHIKAGE / NAKANO KEIKO / MAEDA EIICHI et al. | European Patent Office | 2021

    Free access

    MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detection

    Tsai, Darren / Berrio, Julie Stephany / Shan, Mao et al. | IEEE | 2023


    Planet Craters Detection Based on Unsupervised Domain Adaptation

    Zhang, Zhaoxiang / Xu, Yuelei / Song, Jianing et al. | IEEE | 2023