This paper introduces a stereo reconstruction method that besides producing accurate results in real-time, is capable to detect and conceal possible failures caused by one of the cameras. A classification of stereo camera sensor faults is initially introduced, the most common types of defects being highlighted. We next present a stereo camera failure detection method in which various additional checks are being introduced, with respect to the aforementioned error classification. Furthermore, we propose a novel error correction method based on CNNs (convolutional neural networks) that is capable of generating reliable disparity maps by using prior information provided by semantic segmentation in conjunction with the last available disparity. We highlight the efficiency of our approach by evaluating its performance in various driving scenarios and show that it produces accurate disparities on images from Kitti stereo and raw datasets while running in real-time on a regular GPU.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Real-time Stereo Reconstruction Failure Detection and Correction using Deep Learning


    Contributors:


    Publication date :

    2018-11-01


    Size :

    2096583 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Real-Time Semantic Segmentation-Based Stereo Reconstruction

    Miclea, Vlad-Cristian / Nedevschi, Sergiu | IEEE | 2020

    Free access

    Real-Time Detection of Independent Motion using Stereo

    Agrawal, Motilal / Konolige, Kurt / Iocchi, Luca | IEEE | 2005


    Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

    Hou, Jun / Ye, Xiufen | British Library Conference Proceedings | 2022


    Real-Time Drone Detection Using Deep Learning

    Sricharan, K. / Venkat, M. | Springer Verlag | 2023

    Free access

    Real-time motion stereo

    Ens, J. / Li, Z.N. | IEEE | 1993