We address the problem of 3D reconstruction from uncalibrated LiDAR point cloud and stereo images. Since the usage of each sensor alone for 3D reconstruction has weaknesses in terms of density and accuracy, we propose a deep sensor fusion framework for high-precision depth estimation. The proposed architecture consists of calibration network and depth fusion network, where both networks are designed considering the trade-off between accuracy and efficiency for mobile devices. The calibration network first corrects an initial extrinsic parameter to align the input sensor coordinate systems. The accuracy of calibration is markedly improved by formulating the calibration in the depth domain. In the depth fusion network, complementary characteristics of sparse LiDAR and dense stereo depth are then encoded in a boosting manner. Since training data for the LiDAR and stereo depth fusion are rather limited, we introduce a simple but effective approach to generate pseudo ground truth labels from the raw KITTI dataset. The experimental evaluation verifies that the proposed method outperforms current state-of-the-art methods on the KITTI benchmark. We also collect data using our proprietary multi-sensor acquisition platform and verify that the proposed method generalizes across different sensor settings and scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    High-Precision Depth Estimation Using Uncalibrated LiDAR and Stereo Fusion


    Contributors:


    Publication date :

    2020-01-01


    Size :

    8157154 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    LiDAR - Stereo Camera Fusion for Accurate Depth Estimation

    Cholakkal, Hafeez Husain / Mentasti, Simone / Bersani, Mattia et al. | IEEE | 2020


    Uncalibrated stereo hand-eye coordination

    Hollinghurst, N. / Cipolla, R. | British Library Online Contents | 1994


    Solving Uncalibrated Photometric Stereo Using Total Variation

    Quéau, Y. | British Library Online Contents | 2015



    Junction Analysis in Uncalibrated Stereo under Planar Modeling

    Paletta, L. / Sinclair, D. / Pinz, A. et al. | British Library Conference Proceedings | 1997