Automotive radar has been extensively utilized in cars for many years as an essential sensor, primarily due to its robustness in extreme weather conditions, its capacity to measure Doppler information in the surrounding environment, and its cost-effectiveness. Recently, developments in radar technologies and the availability of open-source radar data sets have attracted more attention to radars and using them for perception tasks in deep learning based autonomous driving. However, annotating radar data for large-scale autonomous driving perception tasks is challenging, i.e., it is difficult for humans to label this data and often requires a semi-automatic approach that involves projecting labels from other sensors, such as cameras and LiDARs. The lack of high-quality labeled data has limited the performance of radar perception models. In this paper, we propose MVRAE, a Multi-View Radar AutoEncoder, which employs self-supervised learning to learn meaningful representations from multi-view radar data without any labels. Our approach is based on the intuition that a good representation for multi-view radar data, which includes range-angle, range-Doppler, and angle-Doppler views, should enable the reconstruction of one view solely from the representations of the other two views. Experimental results demonstrate that our proposed self-supervised method, that can be used as a pre-training step for autonomous driving task, allows the model to learn meaningful representations from unlabeled radar data and achieves enhanced label efficiency for downstream tasks, such as radar semantic segmentation. To the best of our knowledge, MVRAE is the first work that employs self-supervised learning and conducts systematic experiments with multi-view radar data.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-View Radar Autoencoder for Self-Supervised Automotive Radar Representation Learning


    Beteiligte:
    Zhu, Haoran (Autor:in) / He, Haoze (Autor:in) / Choromanska, Anna (Autor:in) / Ravindran, Satish (Autor:in) / Shi, Binbin (Autor:in) / Chen, Lihui (Autor:in)


    Erscheinungsdatum :

    02.06.2024


    Format / Umfang :

    3209776 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    ARC: Automotive Radar Consistency Regularization for Semi-Supervised Learning

    Lee, Wei-Yu / Jovanov, Ljubomir / Kumcu, Asli et al. | IEEE | 2024


    Self-Supervised Velocity Estimation for Automotive Radar Object Detection Networks

    Niederlohner, Daniel / Ulrich, Michael / Braun, Sascha et al. | IEEE | 2022


    Multi Beam Automotive Radar

    Haberland, U. / Deutsche Gesellschaft fur Ortung und Navigation | British Library Conference Proceedings | 1998


    Automotive RADAR

    Winner, Hermann | Springer Verlag | 2015