We present an approach for fusion of video streams produced by multiple imaging sensors such as visible-band and infrared sensors. Our approach is based on a model in which the sensor images are noisy, locally affine functions of the true scene. This model explicitly incorporates reversals in local contrast, sensor-specific features and noise in the sensing process. Given the parameters of the local affine transformations and the sensor images, a Bayesian framework provides a maximum a posterior estimate of the true scene. This estimate constitutes the rule for fusing the sensor images. We also give a maximum likelihood estimate for the parameters of the local affine transformations. Under Gaussian assumptions on the underlying distributions, estimation of the affine parameters is achieved by local principal component analysis. The sensor noise is estimated by analyzing the sequence of images in each video stream. The analysis of the video streams and the synthesis of the fused stream is performed in a multiresolution pyramid domain.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multistream video fusion using local principal components analysis


    Contributors:

    Conference:

    Infrared Technology and Applications XXIV ; 1998 ; San Diego,CA,USA


    Published in:

    Publication date :

    1998-10-26





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Numerical Simulation of Multistream Nozzle Flows

    K. M. Peery / C. K. Forester | AIAA | 1980


    LES OF MULTISTREAM THERMALLY NON-UNIFORM SUPERSONIC JETS

    Chauhan, Monika / Massa, Luca | TIBKAT | 2021



    Noise Suppression in Moderate-Speed Multistream Jets

    Papamoschou, Dimitri / Abbey, Erin | AIAA | 2002


    Producing Audio Effects for Multistream Processing of Sound

    Dulepov, V. E. / Shishkin, D. Y. | British Library Online Contents | 1999