In this paper, we propose a novel strategy at an abstract level by combining textual and visual clustering results to retrieve images using semantic keywords and auto-annotate images based on similarity with existing keywords. Our main hypothesis is that images that fall in to the same textcluster can be described with common visual features of those images. In this approach, images are first clustered according to their text annotations using C3M clustering technique. The images are also segmented into regions and then clustered based on low-level visual features using k-means clustering algorithm on the image regions. The feature vector of the images is then changed to a dimension equal to the number of visual clusters where each entry of the new feature vector signifies the contribution of the image to that visual cluster. Then a matrix is created for each textual cluster, where each row in the matrix is the new feature vector for the image in that textual cluster. A feature vector is also created for the query image and it is then appended to the matrix for each textual cluster and images in the textual cluster that give the highest coupling coefficient are considered for retrieval and annotations of the images in that textual cluster are considered as candidate annotations for the query image. Experiments have demonstrated that good accuracy of proposal and its high potential of use in annotation of images and for improvement of content based image retrieval.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Combining textual and visual clusters for semantic image retrieval and auto-annotation


    Beteiligte:
    Celebi, E. (Autor:in) / Alpkoca, A. (Autor:in)

    Erscheinungsdatum :

    2005-01-01


    Format / Umfang :

    7 pages



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Print


    Sprache :

    Englisch




    ObjectPatchNet: Towards scalable and semantic image annotation and retrieval

    Zhang, S. / Tian, Q. / Hua, G. et al. | British Library Online Contents | 2014


    A probabilistic semantic model for image annotation and multimodal image retrieval

    Ruofei Zhang, / Zhongfei Zhang, / Mingjing Li, et al. | IEEE | 2005


    A Probabilistic Semantic Model for Image Annotation and Multi-Modal Image Retrieval

    Zhang, R. / Zhang, Z. / Li, M. et al. | British Library Conference Proceedings | 2005


    Enhancing query interpretation by combining textual and visual analyses

    Fakhfakh, Rim / Ksibi, Amel / Ben Ammar, Anis et al. | IEEE | 2013


    Hidden Annotation in Content Based Image Retrieval

    Cox, I. J. / Papathomas, T. V. / Ghosh, J. et al. | British Library Conference Proceedings | 1997