We define and present a new model for semantic video compression and searching, and apply this model to several video genres, with special emphasis on instructional videos. In this model, a semantic distance based on the video genre is computed between adjacent frames in a dynamic video buffer of predetermined size, and redundant "unkey" frames leak from the buffer interior into a data structure "leakage history directed acyclic graph" (LHDAG) which records the relative importance of these frames. What exits the buffer forms a highly compressed video stream consisting of only the most semantically significant video frames, whereas the LHDAG permits efficient semantic exploration of the video interior. This novel hierarchical but context-sensitive data structure LHDAG permits the searching of the video at display rates that are proportional to visual significance, at levels of semantic density selectable by the user. The data structure is simple to create and query, and appears to be more psychologically plausible than more straightforward fixed sampling indexing schemes. We empirically display and mathematically analyze the relationships of the video buffer's leaking rate, buffer size, and exit delay, and demonstrate its performance on several extended videos. The flexibility of the method is indicated by its demonstration on two very different definitions of semantic significance: color similarity, and content ("ink pixel") similarity.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Time-constrained dynamic semantic compression for video indexing and interactive searching


    Contributors:


    Publication date :

    2001-01-01


    Size :

    1054892 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Time-Constrained Dynamic Semantic Compression for Video Indexing and Interactive Searching

    Liu, T. / Kender, J. R. / IEEE | British Library Conference Proceedings | 2001


    Video Indexing Through Integration of Syntactic and Semantic Features

    Guensel, B. / Ferman, A. M. / Tekalp, A. M. et al. | British Library Conference Proceedings | 1996



    A Factor Graph Framework for Semantic Indexing and Retrieval in Video

    Naphade, M. / Kozintsev, I. / Huang, T. et al. | British Library Conference Proceedings | 2000


    A factor graph framework for semantic indexing and retrieval in video

    Naphade, / Kozintsev, / Huang, et al. | IEEE | 2000