In this paper, we consider the problem of super-resolving a human face video by a very high (/spl times/ 16) zoom factor. Inspired by the literature on hallucination and example-based learning, we formulate this task using a graphical model that encodes, (1) spatio-temporal consistencies, and (2) image formation & degradation processes. A video database of facial expressions is used to learn a domain-specific prior for high-resolution videos. The problem is posed as one of probabilistic inference, in which we aim to find the high-resolution video that satisfies the constraints expressed through the graphical model. Traditional approaches to this problem using video data first estimate the relative motion between frames and then compensate for it, and effectively resulting in multiple measurements of the scene. Our use of time is rather direct, we define data structures that span multiple consecutive frames enriching our feature vectors with a temporal signature. We then exploit these signatures to find consistent solutions over time. In our experiments, an 8/spl times/6 pixel-wide face video, subject to translational jitter and additive noise, gets magnified to a 128/spl times/96 pixel video. Our results show that by exploiting both space and time, drastic improvements can be achieved in both video flicker artifacts and mean-squared-error.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    High-zoom video hallucination by exploiting spatio-temporal regularities


    Contributors:
    Dedeoglu, G. (author) / Kanade, T. (author) / August, J. (author)


    Publication date :

    2004-01-01


    Size :

    604189 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    High-Zoom Video Hallucination by Exploiting Spatio-Temporal Regularities

    Dedeoglu, G. / Kanade, T. / August, J. et al. | British Library Conference Proceedings | 2004


    Facial Expression Hallucination

    Congyong Su, / Li Huang, | IEEE | 2005


    High Resolution Digital Zoom using Temporal IIR Filter

    Jung-Hyun Hwang, Jung-Hyun Hwang / Hweihn Chung, Hweihn Chung / Sung-Il Su, Sung-Il Su et al. | IEEE | 1996


    Face Hallucination: Theory and Practice

    Liu, C. / Shum, H. Y. / Freeman, W. T. | British Library Online Contents | 2007


    A spatio-temporal pyramid matching for video retrieval

    Choi, J. / Wang, Z. / Lee, S. C. et al. | British Library Online Contents | 2013