Detection of high-level semantics from audio-visual data is a challenging multimedia understanding problem. The difficulty mainly lies in the gap that exists between low level media features and high level semantic concepts. In an attempt to bridge this gap, Naphade et al. (see Proceedings of Workshop on Content Based Access to Image and Video Libraries, p.35-39, 2000 and Proceedings of IEEE International Conference on Image Processing, Chicago, IL, vol.3, p.536-40, 1998) proposed a probabilistic framework for semantic understanding. The components of this framework are probabilistic multimedia objects and a graphical network of such objects. We show how the framework supports detection of multiple high-level concepts, which enjoy spatial and temporal-support. More importantly, we show why context matters and how it can be modeled. Using a factor graph framework, we model context and use it to improve detection of sites, objects and events. Using concepts outdoor and flying-helicopter we demonstrate how the factor graph multinet models context and uses it for late integration of multimodal features. Using ROC curves and probability of error curves we support the intuition that context should help.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Detecting semantic concepts using context and audiovisual features


    Contributors:
    Naphade, M.R. (author) / Huang, T.S. (author)


    Publication date :

    2001-01-01


    Size :

    1094653 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Detecting Semantic Concepts Using Context and Audiovisual Features

    Naphade, M. / Huang, T. / IEEE Computer Society | British Library Conference Proceedings | 2001


    NHI audiovisual lending library

    National Highway Institute | SLUB | 1980


    AUDIOVISUAL FLIGHT ADVISORY SYSTEM

    Hatfaludy, L. / International Council of the Aeronautical Sciences | British Library Conference Proceedings | 2004


    Mapping low-level features to high-level semantic concepts in region-based image retrieval

    Wei Jiang, / Kap Luk Chan, / Mingjing Li, et al. | IEEE | 2005


    Video preprocessing for audiovisual indexing

    Albiol, A. / Torres, L. / Delp, E.J. | IEEE | 2002