This paper proposes a novel framework for semantic indexing and retrieval in digital video. The components of the framework are probabilistic multimedia objects (multijects) and a network of such objects (multinets). The main contribution of this paper is a novel application of a factor graph framework to model the interactions in a network of multijects (multinet) at a semantic level. Factor graphs are statistical graphical models that provide an efficient framework for exact and approximate inference via the sum-product algorithm. Incorporating the statistical interactions between the concepts using factor graphs enhances the detection probability of individual multijects and provides a unified framework for integrating multiple modalities and supports inference of unobservable concepts based on their relation with observable concepts. Our experiments reveal significant performance improvement using the inference on the factor graph models.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A factor graph framework for semantic indexing and retrieval in video


    Contributors:
    Naphade, (author) / Kozintsev, (author) / Huang, (author) / Ramchandran, (author)


    Publication date :

    2000-01-01


    Size :

    158245 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Factor Graph Framework for Semantic Indexing and Retrieval in Video

    Naphade, M. / Kozintsev, I. / Huang, T. et al. | British Library Conference Proceedings | 2000


    Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval

    Jiang, Y. G. / Ngo, C. W. | British Library Online Contents | 2009


    Indexing and retrieval of the MPEG compressed video

    Kobla, V. / Doermann, D. | British Library Online Contents | 1998


    Video Indexing Through Integration of Syntactic and Semantic Features

    Guensel, B. / Ferman, A. M. / Tekalp, A. M. et al. | British Library Conference Proceedings | 1996


    Video indexing through integration of syntactic and semantic features

    Gunsel, B. / Ferman, A.M. / Tekalp, A.M. | IEEE | 1996