We consider the problem of next frame prediction from video input. A recurrent convolutional neural network is trained to predict depth from monocular video input, which, along with the current video image and the camera trajectory, can then be used to compute the next frame. Unlike prior next-frame prediction approaches, we take advantage of the scene geometry and use the predicted depth for generating the next frame prediction. Our approach can produce rich next frame predictions which include depth information attached to each pixel. Another novel aspect of our approach is that it predicts depth from a sequence of images (e.g. in a video), rather than from a single still image. We evaluate the proposed approach on the KITTI dataset, a standard dataset for benchmarking tasks relevant to autonomous driving. The proposed method produces results which are visually and numerically superior to existing methods that directly predict the next frame. We show that the accuracy of depth prediction improves as more prior frames are considered.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Geometry-based next frame prediction from monocular video


    Contributors:


    Publication date :

    2017-06-01


    Size :

    2434476 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Monocular ranging system based on space geometry

    Qian, Ye / Chen, Qian / Yang, Wenguang et al. | SPIE | 2019


    CNN-BASED MULTI-FRAME IMO DETECTION FROM A MONOCULAR CAMERA

    Fanani, Nolang / Ochs, Matthias / Sturck, Alina et al. | British Library Conference Proceedings | 2018


    CNN-based multi-frame IMO detection from a monocular camera

    Fanani, Nolang / Ochs, Matthias / Sturck, Alina et al. | IEEE | 2018


    Real Time Speed Estimation From Monocular Video

    Temiz, M. S. / Kulur, S. / Dogan, S. | BASE | 2012

    Free access

    Monocular Video serves RADAR-based Emergency Braking

    Wedel, Andreas / Franke, Uwe | IEEE | 2007