3D object detection is a critical task in the field of robotics and autonomous driving. Although recent light detection and ranging (LiDAR)-based 3D object detection techniques have been well-studied and achieve high detection accuracy, the cost of the LiDAR sensor itself proposes a high premium for its practical implementation. Recently introduced Pseudo-LiDAR based methods that utilize image data to detect 3D information show great prospects for their high cost-effectiveness. However, existing Pseudo-LiDAR methods tend to be intensive computations for the adaption of complex stereo matching algorithms, and therefore can not meet the real-time requirement. To tackle this issue, we propose a lightweight Pseudo-LiDAR 3D detection system that achieves both high accuracy and high responsiveness. Specifically, we adopt a highly efficient depth estimator with Binary Neural Networks (BNNs) to exploit timely depth prediction. To mitigate the accuracy degradation issue caused by the quantization of the BNNs, we introduce several promoting schemes into the depth estimation procedure, including continuous depth approximation, geometric constraints of virtual planes, and training scope restriction, to enhance its performance. Moreover, we further provide an in-depth analysis to the architecture of 3D detector orienting to the Pseudo-LiDAR task and develop effective modules to gain solid accuracy improvement while maintaining low runtime demand. Experiments on the KITTI benchmark and online leaderboard show that our system can conduct the 3D detection within a mere 36 ms, while simultaneously achieving competitive results when compared to the state-of-the-art algorithms.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Efficient 3D Object Detection Based on Pseudo-LiDAR Representation


    Contributors:
    Meng, Haitao (author) / Li, Changcai (author) / Chen, Gang (author) / Chen, Long (author) / Knoll, Alois (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    5830360 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Real-time Pseudo-LiDAR 3D object detection with geometric constraints

    Li, Changcai / Meng, Haitao / Chen, Gang et al. | IEEE | 2022


    LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection

    Pitropov, Matthew / Huang, Chengjie / Abdelzad, Vahdat et al. | IEEE | 2022


    PSEUDO LIDAR

    SHAAG NADAV / NEUHOF DAVID / MOSKOWITZ JEFFREY et al. | European Patent Office | 2022

    Free access

    Pseudo lidar

    SPRINGER OFER / NEUHOF DAVID / MOSKOWITZ JEFFREY et al. | European Patent Office | 2023

    Free access