With the rapid development of autonomous driving technology, radar sensors play a vital role in the perception system due to their robustness under harsh environmental conditions, exact range and velocity perception capability. However, the state-of-the-art performance of algorithms solely based on radar to achieve various perception tasks, such as classifying road users and infrastructures, still lags far behind expectation. Their failure can mainly be accounted for the extreme sparseness of radar point cloud for objects, low angular resolution, and the issue of ghost targets. In this work, we propose a novel network that employs the complex range-Doppler matrix as input to achieve radar-tailored panoptic segmentation (i.e., free-space segmentation and object detection). Our network surpasses previous works in free-space segmentation and object detection tasks, and the improvement in the former task is especially notable. During training, the segmented camera image with radar customized adaption is utilized as the ground truth. Through such a cross-modal supervision method, the labeling expense is alleviated considerably. Based on it, we further design an innovative camera-radar system concept that is able to automatically train deep neural networks with radar measurement.
Cross-Modal Supervision-Based Multitask Learning With Automotive Radar Raw Data
IEEE Transactions on Intelligent Vehicles ; 8 , 4 ; 3012-3025
2023-04-01
3197632 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Deep 4D Automotive Radar-Camera Fusion Odometry with Cross-Modal Transformer Fusion
SAE Technical Papers | 2023
|Ship target detection based on multitask learning
SPIE | 2022
|Deep Multitask Learning for Railway Track Inspection
Online Contents | 2017
|Deep Multitask Learning for Railway Track Inspection
IEEE | 2017
|