Near-field depth estimation around a self-driving car is an important function that can be achieved by four wide-angle fisheye cameras having a field of view of over 180°. Depth estimation based on convolutional neural networks (CNNs) produce state of the art results, but progress is hindered because depth annotation cannot be obtained manually. Synthetic datasets are commonly used but they have limitations. For instance, they do not capture the extensive variability in the appearance of objects like vehicles present in real datasets. There is also a domain shift while performing inference on natural images illustrated by many attempts to handle the domain adaptation explicitly. In this work, we explore an alternate approach of training using sparse LiDAR data as ground truth for depth estimation for fisheye camera. We built our own dataset using our self-driving car setup which has a 64-beam Velodyne LiDAR and four wide angle fisheye cameras. To handle the difference in view-points of LiDAR and fisheye camera, an occlusion resolution mechanism was implemented. We started with Eigen's multiscale convolutional network architecture [1] and improved by modifying activation function and optimizer. We obtained promising results on our dataset with RMSE errors comparable to the state-of-the-art results obtained on KITTI.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Monocular Fisheye Camera Depth Estimation Using Sparse LiDAR Supervision


    Beteiligte:
    Kumar, Varun Ravi (Autor:in) / Milz, Stefan (Autor:in) / Witt, Christian (Autor:in) / Simon, Martin (Autor:in) / Amende, Karl (Autor:in) / Petzold, Johannes (Autor:in) / Yogamani, Senthil (Autor:in) / Pech, Timo (Autor:in)


    Erscheinungsdatum :

    2018-11-01


    Format / Umfang :

    1208900 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Sparse Pseudo-LiDAR Depth Assisted Monocular Depth Estimation

    Shao, Shuwei / Pei, Zhongcai / Chen, Weihai et al. | IEEE | 2024



    Local Scene Depth Estimation Using Rotating Monocular Camera

    Kutty, Krishnan / Thomas, Sonu / Senthamilarasu, Vinuchackravarthy | SAE Technical Papers | 2015


    Local scene depth estimation using rotating monocular camera

    Thomas,S. / Kutty,K. / Senthamilarasu,V. et al. | Kraftfahrwesen | 2015


    Monocular Depth Estimation Through Virtual-World Supervision and Real-World SfM Self-Supervision

    Gurram, Akhil / Tuna, Ahmet Faruk / Shen, Fengyi et al. | IEEE | 2022