This paper proposes a novel framework for semantic indexing and retrieval in digital video. The components of the framework are probabilistic multimedia objects (multijects) and a network of such objects (multinets). The main contribution of this paper is a novel application of a factor graph framework to model the interactions in a network of multijects (multinet) at a semantic level. Factor graphs are statistical graphical models that provide an efficient framework for exact and approximate inference via the sum-product algorithm. Incorporating the statistical interactions between the concepts using factor graphs enhances the detection probability of individual multijects and provides a unified framework for integrating multiple modalities and supports inference of unobservable concepts based on their relation with observable concepts. Our experiments reveal significant performance improvement using the inference on the factor graph models.
A factor graph framework for semantic indexing and retrieval in video
2000-01-01
158245 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
A Factor Graph Framework for Semantic Indexing and Retrieval in Video
British Library Conference Proceedings | 2000
|Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval
British Library Online Contents | 2009
|Indexing and retrieval of the MPEG compressed video
British Library Online Contents | 1998
|Video Indexing Through Integration of Syntactic and Semantic Features
British Library Conference Proceedings | 1996
|ToCAI: A Framework for Indexing and Retrieval of Multimedia Documents
British Library Conference Proceedings | 1999
|