We describe an approach to object and scene retrieval which searches for and localizes all the occurrences of a user outlined object in a video. The object is represented by a set of viewpoint invariant region descriptors so that recognition can proceed successfully despite changes in viewpoint, illumination and partial occlusion. The temporal continuity of the video within a shot is used to track the regions in order to reject unstable regions and reduce the effects of noise in the descriptors. The analogy with text retrieval is in the implementation where matches on descriptors are pre-computed (using vector quantization), and inverted file systems and document rankings are used. The result is that retrieved is immediate, returning a ranked list of key frames/shots in the manner of Google. The method is illustrated for matching in two full length feature films.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Video Google: a text retrieval approach to object matching in videos


    Contributors:
    Sivic, (author) / Zisserman, (author)


    Publication date :

    2003-01-01


    Size :

    2282088 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Video Google: A Text Retrieval Approach to Object Matching in Videos

    Sivic, J. / Zisserman, A. / IEEE | British Library Conference Proceedings | 2003


    Annotation and Retrieval of Video Documents: Sports Videos

    Assfalg, J. / Bertini, M. / Colombo, C. et al. | British Library Conference Proceedings | 2003


    Annotation and retrieval of video documents: sports videos

    Assfalg, J. / Bertini, M. / Colombo, C. et al. | IEEE | 2003


    A spatio-temporal pyramid matching for video retrieval

    Choi, J. / Wang, Z. / Lee, S. C. et al. | British Library Online Contents | 2013


    Video retrieval based on object discovery

    Liu, D. / Chen, T. | British Library Online Contents | 2009