In this paper we propose a method to construct a virtual sequence for a camera moving through a static environment given an input sequence from a different camera trajectory. Existing image-based rendering techniques can generate photorealistic images given a set of input views, though the output images almost unavoidably contain small regions where the colour has been incorrectly chosen. In a single image these artifacts are often hard to spot, but become more obvious when viewing a real image with its virtual stereo pair, and even more so when when a sequence of novel views is generated, since the artifacts are rarely temporally consistent.

    To address this problem of consistency, we propose a new spatio-temporal approach to novel video synthesis. The pixels in the output video sequence are modelled as nodes of a 3–D graph. We define an MRF on the graph which encodes photoconsistency of pixels as well as texture priors in both space and time. Unlike methods based on scene geometry which yield highly connected graphs, our approach results in a graph whose degree is independent of scene structure. The MRF energy is therefore tractable and we solve it for the whole sequence using a state-of-the-art message passing optimisation algorithm. We demonstrate the effectiveness of our approach in reducing temporal artifacts.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Temporal Priors for Novel Video Synthesis


    Beteiligte:
    Yagi, Yasushi (Herausgeber:in) / Kang, Sing Bing (Herausgeber:in) / Kweon, In So (Herausgeber:in) / Zha, Hongbin (Herausgeber:in) / Shahrokni, Ali (Autor:in) / Woodford, Oliver (Autor:in) / Reid, Ian (Autor:in)

    Kongress:

    Asian Conference on Computer Vision ; 2007 ; Tokyo, Japan November 18, 2007 - November 22, 2007


    Erschienen in:

    Computer Vision – ACCV 2007 ; Kapitel : 59 ; 601-610


    Erscheinungsdatum :

    2007-01-01


    Format / Umfang :

    10 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Bayesian video matting using learnt image priors

    Apostoloff, N. / Fitzgibbon, A. | IEEE | 2004


    Bayesian Video Matting Using Learnt Image Priors

    Apostoloff, N. / Fitzgibbon, A. / IEEE Computer Society | British Library Conference Proceedings | 2004


    All Mover Priors

    MEHTA HERSH / WERNER ERIC BLAINE / BIGLAN ALBERT JOHN et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    All mover priors

    MEHTA HERSH / WERNER ERIC B / BIGLAN ALBERT JOHN et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Behavioral Priors for Detection and Tracking of Pedestrians in Video Sequences

    Antonini, G. / Martinez, S. V. / Bierlaire, M. et al. | British Library Online Contents | 2006