We propose modeling images and related visual objects as bags of pixels or sets of vectors. For instance, gray scale images are modeled as a collection or bag of (X, Y, I) pixel vectors. This representation implies a permutational invariance over the bag of pixels, which is naturally handled by endowing each image with a permutation matrix. Each matrix permits the image to span a manifold of multiple configurations, capturing the vector set's invariance to orderings or permutation transformations. Permutation configurations are optimized while jointly modeling many images via maximum likelihood. The solution is a uniquely solvable convex program, which computes correspondence simultaneously for all images (as opposed to traditional pairwise correspondence solutions). Maximum likelihood performs a nonlinear dimensionality reduction, choosing permutations that compact the permuted image vectors into a volumetrically minimal subspace. This is highly suitable for principal components analysis which, when applied to the permutationally invariant bag of pixels representation, outperforms PCA on appearance-based vectorization by orders of magnitude. Furthermore, the bag of pixels subspace benefits from automatic correspondence estimation, giving rise to meaningful linear variations such as morphings, translations, and jointly spatio-textural image transformations. Results are shown for several datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Images as bags of pixels


    Contributors:
    Jebara, (author)


    Publication date :

    2003-01-01


    Size :

    4913726 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Images as Bags of Pixels

    Jebara, T. / IEEE | British Library Conference Proceedings | 2003


    Lasing pixels may form images in projection TV

    Lawandy, N. / Firehammer, J. / Vartak, S. | British Library Online Contents | 1997


    STORAGE BAGS

    MILES SHANE | European Patent Office | 2024

    Free access

    STORAGE BAGS

    MILES SHANE | European Patent Office | 2022

    Free access

    STORAGE BAGS

    MILES SHANE | European Patent Office | 2021

    Free access