A robust, multi-frame, progressive refinement framework for registering narrow field of view video to reference imagery is presented. A major strength of the approach is its effectiveness in the presence of dissimilar video and reference image appearance. Normalized oriented energy image pyramids are employed to enable alignment of images with global visual dissimilarities, yet local feature commonality. Local matching is then applied coarse-to-fine, along four dimensions: spatial frequency, local support, search range, and model order (a robust parametric model fit is used to reject outliers at each iteration). Globally optimal multi-frame alignment is obtained with respect to several constraints: frame-to-reference local matches, recovered frame-to-frame motion, and optional a priori estimates of sensor pose. The framework is described in detail and applied to two examples: aerial video to geographic reference image alignment (georegistration) and retinal slit lamp video to fundus image alignment.
Video to reference image alignment in the presence of sparse features and appearance change
2001-01-01
1219315 byte
Conference paper
Electronic Resource
English
Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change
British Library Conference Proceedings | 2001
|Exploiting Inter-frame Correlation for Fast Video to Reference Image Alignment
Springer Verlag | 2007
|Object tracking via appearance modeling and sparse representation
British Library Online Contents | 2011
|Automatically building appearance models from image sequences using salient features
British Library Online Contents | 2002
|A Framework for Modeling Appearance Change in Image Sequences
British Library Conference Proceedings | 1998
|