In this paper we propose a method to construct a virtual sequence for a camera moving through a static environment given an input sequence from a different camera trajectory. Existing image-based rendering techniques can generate photorealistic images given a set of input views, though the output images almost unavoidably contain small regions where the colour has been incorrectly chosen. In a single image these artifacts are often hard to spot, but become more obvious when viewing a real image with its virtual stereo pair, and even more so when when a sequence of novel views is generated, since the artifacts are rarely temporally consistent.

    To address this problem of consistency, we propose a new spatio-temporal approach to novel video synthesis. The pixels in the output video sequence are modelled as nodes of a 3–D graph. We define an MRF on the graph which encodes photoconsistency of pixels as well as texture priors in both space and time. Unlike methods based on scene geometry which yield highly connected graphs, our approach results in a graph whose degree is independent of scene structure. The MRF energy is therefore tractable and we solve it for the whole sequence using a state-of-the-art message passing optimisation algorithm. We demonstrate the effectiveness of our approach in reducing temporal artifacts.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Temporal Priors for Novel Video Synthesis


    Contributors:

    Conference:

    Asian Conference on Computer Vision ; 2007 ; Tokyo, Japan November 18, 2007 - November 22, 2007


    Published in:

    Computer Vision – ACCV 2007 ; Chapter : 59 ; 601-610


    Publication date :

    2007-01-01


    Size :

    10 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Bayesian video matting using learnt image priors

    Apostoloff, N. / Fitzgibbon, A. | IEEE | 2004


    Bayesian Video Matting Using Learnt Image Priors

    Apostoloff, N. / Fitzgibbon, A. / IEEE Computer Society | British Library Conference Proceedings | 2004


    All Mover Priors

    MEHTA HERSH / WERNER ERIC BLAINE / BIGLAN ALBERT JOHN et al. | European Patent Office | 2020

    Free access


    Behavioral Priors for Detection and Tracking of Pedestrians in Video Sequences

    Antonini, G. / Martinez, S. V. / Bierlaire, M. et al. | British Library Online Contents | 2006