With the rapid development of autonomous driving technology, radar sensors play a vital role in the perception system due to their robustness under harsh environmental conditions, exact range and velocity perception capability. However, the state-of-the-art performance of algorithms solely based on radar to achieve various perception tasks, such as classifying road users and infrastructures, still lags far behind expectation. Their failure can mainly be accounted for the extreme sparseness of radar point cloud for objects, low angular resolution, and the issue of ghost targets. In this work, we propose a novel network that employs the complex range-Doppler matrix as input to achieve radar-tailored panoptic segmentation (i.e., free-space segmentation and object detection). Our network surpasses previous works in free-space segmentation and object detection tasks, and the improvement in the former task is especially notable. During training, the segmented camera image with radar customized adaption is utilized as the ground truth. Through such a cross-modal supervision method, the labeling expense is alleviated considerably. Based on it, we further design an innovative camera-radar system concept that is able to automatically train deep neural networks with radar measurement.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Cross-Modal Supervision-Based Multitask Learning With Automotive Radar Raw Data


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    2023-04-01


    Format / Umfang :

    3197632 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Deep 4D Automotive Radar-Camera Fusion Odometry with Cross-Modal Transformer Fusion

    Zhuo, Guirong / Xiong, Lu / Zhou, Mingyu et al. | SAE Technical Papers | 2023


    Ship target detection based on multitask learning

    He, Junran / Zhang, Ting / Liu, Zhaoying et al. | SPIE | 2022


    Deep Multitask Learning for Railway Track Inspection

    Gibert, Xavier | Online Contents | 2017


    Cross-Modal Localization: Using Automotive Radar for Absolute Geolocation within a Map Produced with Visible-Light Imagery

    Iannucci, Peter A. / Narula, Lakshay / Humphreys, Todd E. | BASE | 2020

    Freier Zugriff

    Deep Multitask Learning for Railway Track Inspection

    Gibert, Xavier / Patel, Vishal M. / Chellappa, Rama | IEEE | 2017