Interactive audio-visual (AV) applications such as free viewpoint video (FVV) aim to enable unrestricted spatio-temporal navigation within multiple camera environments. Current virtual viewpoint view synthesis solutions for FVV are either purely image-based implying large information redundancy; or involve reconstructing complex 3D models of the scene. In this paper we present a new multiple image view synthesis algorithm that only requires camera parameters and disparity maps. The multi-view synthesis (MVS) approach can be used in any multi-camera environment and is scalable as virtual views can be created given 1 to N of the available video inputs, providing a means to gracefully handle scenarios where camera inputs decrease or increase over time. The algorithm identifies and selects only the best quality surface areas from available reference images, thereby reducing perceptual errors in virtual view reconstruction. Experimental results are presented and verified using both objective (PSNR) and subjective comparisons.
Multiple image view synthesis for free viewpoint video applications
2005-01-01
724684 byte
Conference paper
Electronic Resource
English
Multiple Image Viewsynthesis for Free Viewpoint Video Applications
British Library Conference Proceedings | 2005
|On-line free-viewpoint video: From single to multiple view rendering
British Library Online Contents | 2008
|Free-viewpoint video relighting from multi-view sequence under general illumination
British Library Online Contents | 2014
|Free-Viewpoint Image Synthesis from Multiple-Viewimages Taken with Uncalibrated Moving Cameras
British Library Conference Proceedings | 2005
|