As an emerging technology and a relatively affordable device, the 4D imaging radar has already been confirmed effective in performing 3D object detection in autonomous driving [1] . Nevertheless, the sparsity and noisiness of 4D radar point clouds hinder further performance improvement, and in-depth studies about its fusion with other modalities are lacking. On the other hand, as a new image view transformation strategy, sampling has been applied in a few image-based detectors and shown to outperform the widely applied depth-based splatting proposed in Lift-Splat-Shoot (LSS) [2] , even without image depth prediction [3] . However, the potential of sampling is not fully unleashed. As a result, this paper investigates the sampling strategy on the camera and 4D imaging radar fusion-based 3D object detection. In the proposed LiDAR Excluded Lean (LXL) model, predicted image depth distribution maps and radar 3D occupancy grids are generated from image perspective view (PV) features and radar bird’s eye view (BEV) features, respectively. They are sent to the core of LXL, called radar occupancy-assisted depth-based sampling , to aid image view transformation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusion


    Contributors:
    Xiong, Weiyi (author) / Liu, Jianan (author) / Huang, Tao (author) / Han, Qing-Long (author) / Xia, Yuxuan (author) / Zhu, Bing (author)


    Publication date :

    2024-06-02


    Size :

    783673 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    LXL: LiDAR Excluded Lean 3D Object Detection With 4D Imaging Radar and Camera Fusion

    Xiong, Weiyi / Liu, Jianan / Huang, Tao et al. | IEEE | 2024


    RADAR LIDAR OBJECT DETECTION USING RADAR AND LIDAR FUSION

    MENG XIAOLI / ZHOU LUBING / SHETTI KARAN RAJENDRA | European Patent Office | 2023

    Free access

    Deep Learning-based Radar, Camera, and Lidar Fusion for Object Detection

    Nobis, Felix Otto Geronimo | TIBKAT | 2022

    Free access

    Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks

    Munir, Farzeen / Azam, Shoaib / Kucner, Tomasz et al. | IEEE | 2023


    Multi-Object Tracking with Object Candidate Fusion for Camera and LiDAR Data

    Yin, Huilin / Lu, Yu / Lin, Jia et al. | IEEE | 2023