Unsupervised deep learning methods have demonstrated an impressive performance for understanding the structure of 3D scene from videos. These data-based learning methods are able to learn the tasks, such as depth, ego-motion, and optical flow estimation. In this paper, we propose a novel unsupervised deep learning method to jointly estimate scene depth, camera ego-motion, and optical flow from stereo images. Consecutive stereo images are used to train the system. After training stage, the system is able to estimate dense depth map, camera 6D pose, and optical flow by using a sequence of monocular images. No labelled data set is required for training. The supervision signals for training three deep neural networks of the system come from various forms of image warping. Due to the use of optical flow, the impact caused by occlusions and moving objects on the estimation results is alleviated. Experiments on the KITTI and Cityscapes datasets show that the proposed system demonstrates a better performance in terms of accuracy in depth, ego-motion, and optical flow estimation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Unsupervised Deep Learning of Depth, Ego-Motion, and Optical Flow from Stereo Images


    Beteiligte:
    Yang, Delong (Autor:in) / Luo, Zhaohui (Autor:in) / Shang, Peng (Autor:in) / Hu, Zhigang (Autor:in)


    Erscheinungsdatum :

    09.08.2021


    Format / Umfang :

    2248286 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Depth from dynamic stereo images

    Fan Jiang / Weymouth, T.E. | IEEE | 1989


    Unsupervised Multi-Spectrum Stereo Depth Estimation for All-Day Vision

    Guo, Yubin / Kong, Hui / Gu, Shuo | IEEE | 2024


    Depth map estimation with stereo images

    Europäisches Patentamt | 2017

    Freier Zugriff

    Unsupervised Learning of Depth, Optical Flow and Pose With Occlusion From 3D Geometry

    Wang, Guangming / Zhang, Chi / Wang, Hesheng et al. | IEEE | 2022


    Estimation of depth and 3D motion parameter of moving object with multiple stereo images

    Yi, J.-W. / Oh, J.-H. | British Library Online Contents | 1996