Video matting, or layer extraction, is a classic inverse problem in computer vision that involves the extraction of foreground objects, and the alpha mattes that describe their opacity, from a set of images. Modem approaches that work with natural backgrounds often require user-labelled "trimaps" that segment each image into foreground, background and unknown regions. For long sequences, the production of accurate trimaps can be time consuming. In contrast, another class of approach depends on automatic background extraction to automate the process, but existing techniques do not make use of spatiotemporal consistency, and cannot take account of operator hints such as trimaps. This paper presents a method inspired by natural image statistics that cleanly unifies these approaches. A prior is learnt that models the relationship between the spatiotemporal gradients in the image sequence and those in the alpha mattes. This is used in combination with a learnt foreground colour model and a prior on the alpha distribution to help regularize the solution and greatly improve the automatic performance of such systems. The system is applied to several real image sequences that demonstrate the advantage that the unified approach can afford.
Bayesian video matting using learnt image priors
2004-01-01
651250 byte
Conference paper
Electronic Resource
English
Bayesian Video Matting Using Learnt Image Priors
British Library Conference Proceedings | 2004
|Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting
British Library Online Contents | 2009
|Image and Video Matting with Membership Propagation
Springer Verlag | 2007
|Bayesian image segmentation using wavelet-based priors
IEEE | 2005
|A Bayesian approach to digital matting
IEEE | 2001
|