Detection of high-level semantics from audio-visual data is a challenging multimedia understanding problem. The difficulty mainly lies in the gap that exists between low level media features and high level semantic concepts. In an attempt to bridge this gap, Naphade et al. (see Proceedings of Workshop on Content Based Access to Image and Video Libraries, p.35-39, 2000 and Proceedings of IEEE International Conference on Image Processing, Chicago, IL, vol.3, p.536-40, 1998) proposed a probabilistic framework for semantic understanding. The components of this framework are probabilistic multimedia objects and a graphical network of such objects. We show how the framework supports detection of multiple high-level concepts, which enjoy spatial and temporal-support. More importantly, we show why context matters and how it can be modeled. Using a factor graph framework, we model context and use it to improve detection of sites, objects and events. Using concepts outdoor and flying-helicopter we demonstrate how the factor graph multinet models context and uses it for late integration of multimodal features. Using ROC curves and probability of error curves we support the intuition that context should help.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Detecting semantic concepts using context and audiovisual features


    Beteiligte:
    Naphade, M.R. (Autor:in) / Huang, T.S. (Autor:in)


    Erscheinungsdatum :

    01.01.2001


    Format / Umfang :

    1094653 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Detecting Semantic Concepts Using Context and Audiovisual Features

    Naphade, M. / Huang, T. / IEEE Computer Society | British Library Conference Proceedings | 2001


    NHI audiovisual lending library

    National Highway Institute | SLUB | 1980


    AUDIOVISUAL FLIGHT ADVISORY SYSTEM

    Hatfaludy, L. / International Council of the Aeronautical Sciences | British Library Conference Proceedings | 2004


    Mapping low-level features to high-level semantic concepts in region-based image retrieval

    Wei Jiang, / Kap Luk Chan, / Mingjing Li, et al. | IEEE | 2005


    Video preprocessing for audiovisual indexing

    Albiol, A. / Torres, L. / Delp, E.J. | IEEE | 2002