A robust, multi-frame, progressive refinement framework for registering narrow field of view video to reference imagery is presented. A major strength of the approach is its effectiveness in the presence of dissimilar video and reference image appearance. Normalized oriented energy image pyramids are employed to enable alignment of images with global visual dissimilarities, yet local feature commonality. Local matching is then applied coarse-to-fine, along four dimensions: spatial frequency, local support, search range, and model order (a robust parametric model fit is used to reject outliers at each iteration). Globally optimal multi-frame alignment is obtained with respect to several constraints: frame-to-reference local matches, recovered frame-to-frame motion, and optional a priori estimates of sensor pose. The framework is described in detail and applied to two examples: aerial video to geographic reference image alignment (georegistration) and retinal slit lamp video to fundus image alignment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Video to reference image alignment in the presence of sparse features and appearance change


    Contributors:
    Hirvonen, D. (author) / Matei, B. (author) / Wildes, R. (author) / Hsu, S. (author)


    Publication date :

    2001-01-01


    Size :

    1219315 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Video to Reference Image Alignment in the Presence of Sparse Features and Appearance Change

    Hirvonen, D. / Matei, B. / Wildes, R. et al. | British Library Conference Proceedings | 2001


    Exploiting Inter-frame Correlation for Fast Video to Reference Image Alignment

    Mahmood, Arif / Khan, Sohaib | Springer Verlag | 2007


    Object tracking via appearance modeling and sparse representation

    Chen, F. / Wang, Q. / Wang, S. et al. | British Library Online Contents | 2011


    Automatically building appearance models from image sequences using salient features

    Walker, K. N. / Cootes, T. F. / Taylor, C. J. | British Library Online Contents | 2002


    A Framework for Modeling Appearance Change in Image Sequences

    Black, M. J. / Fleet, D. J. / Yacoob, Y. et al. | British Library Conference Proceedings | 1998