Although LiDAR sensors are crucial for autonomous systems due to providing precise depth information, they struggle with capturing fine object details, especially at a distance, due to sparse and non-uniform data. Recent advances introduced pseudo-LiDAR, i.e., synthetic dense point clouds, using additional modalities such as cameras to enhance 3D object detection. We present a novel LiDAR-only framework that augments raw scans with denser pseudo point clouds by solely relying on LiDAR sensors and scene semantics, omitting the need for cameras. Our framework first utilizes a segmentation model to extract scene semantics from raw point clouds, and then employs a multi-modal domain translator to generate synthetic image segments and depth cues without real cameras. This yields a dense pseudo point cloud enriched with semantic information. We also introduce a new semantically guided projection method, which enhances detection performance by retaining only relevant pseudo points. We applied our framework to different advanced 3D object detection methods and reported up to 2.9% performance upgrade. We also obtained comparable results on the KITTI 3D object detection test set, in contrast to other state-of-the-art LiDAR-only detectors.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Semantics-aware LiDAR-Only Pseudo Point Cloud Generation for 3D Object Detection


    Contributors:


    Publication date :

    2024-06-02


    Size :

    4303075 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Monocular Pseudo-LiDAR Point Cloud Extrapolation Based on Iterative Hybrid Rendering

    Zhang, Chunlan / Lin, Chunyu / Liao, Kang et al. | IEEE | 2023


    YoloV8 Based Novel Approach for Object Detection on LiDAR Point Cloud

    Behera, Sriya / Anand, Bhaskar / P, Rajalakshmi | IEEE | 2024


    Efficient 3D Object Detection Based on Pseudo-LiDAR Representation

    Meng, Haitao / Li, Changcai / Chen, Gang et al. | IEEE | 2024



    GNSS NLOS Exclusion Based on Dynamic Object Detection Using LiDAR Point Cloud

    Wen, Weisong Weisong / Zhang, Guohao / Hsu, Li-Ta | IEEE | 2021