We use the cumulative distribution of a random variable to define the information content in it and use it to develop a novel measure of information that parallels Shannon entropy, which we dub cumulative residual entropy (CRE). The key features of CRE may be summarized as, (1) its definition is valid in both the continuous and discrete domains, (2) it is mathematically more general than the Shannon entropy and (3) its computation from sample data is easy and these computations converge asymptotically to the true values. We define the cross-CRE (CCRE) between two random variables and apply it to solve the uni- and multimodal image alignment problem for parameterized (rigid, affine and projective) transformations. The key strengths of the CCRE over using the now popular mutual information method (based on Shannon's entropy) are that the former has significantly larger noise immunity and a much larger convergence range over the field of parameterized transformations. These strengths of CCRE are demonstrated via experiments on synthesized and real image data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Cumulative residual entropy, a new measure of information & its application to image alignment


    Contributors:
    Wang, (author) / Vemuri, (author) / Rao, (author) / Chen, (author)


    Publication date :

    2003-01-01


    Size :

    538050 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Cumulative Residual Entropy, A New Measure of Information and its Application to Image Alignment

    Wang, F. / Vemuri, B. / Rao, M. et al. | British Library Conference Proceedings | 2003


    Non-Rigid Multi-Modal Image Registration Using Cross-Cumulative Residual Entropy

    Wang, F. / Vemuri, B. C. | British Library Online Contents | 2007


    Entropy, information and image

    Maitre, H. | British Library Conference Proceedings | 1996


    Image coding using high-order conditional entropy-constrained residual VQ

    Kossentini, F. / Chung, W.C. / Smith, M.J.T. | IEEE | 1994


    Image Coding using High-Order Conditional Entropy-Constrained Residual VQ

    Kossentini, F. / Chung, W. C. / Smith, M. J. T. et al. | British Library Conference Proceedings | 1994