Abstract This paper addresses the problem of how to learn an appropriate feature representation from video to benefit video-based face recognition. By simultaneously exploiting the spatial and temporal information, the problem is posed as learning Spatio-Temporal Embedding (STE) from raw video. STE of a video sequence is defined as its condensed version capturing the essence of space-time characteristics of the video. Relying on the co-occurrence statistics and supervised signatures provided by training videos, STE preserves the intrinsic temporal structures hidden in video volume, meanwhile encodes the discriminative cues into the spatial domain. To conduct STE, we propose two novel techniques, Bayesian keyframe learning and nonparametric discriminant embedding (NDE), for temporal and spatial learning, respectively. In terms of learned STEs, we derive a statistical formulation to the recognition problem with a probabilistic fusion model. On a large face video database containing more than 200 training and testing sequences, our approach consistently outperforms state-of-the-art methods, achieving a perfect recognition accuracy.


    Access

    Download


    Export, share and cite



    Title :

    Spatio-temporal Embedding for Statistical Face Recognition from Video


    Contributors:
    Liu, Wei (author) / Li, Zhifeng (author) / Tang, Xiaoou (author)


    Publication date :

    2006-01-01


    Size :

    15 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Spatio-temporal Embedding for Statistical Face Recognition from Video

    Liu, W. / Li, Z. / Tang, X. | British Library Conference Proceedings | 2006



    Spatio-temporal segmentation of video data

    Wang, John / Adelson, Edward H. | SPIE | 1994


    METHODS FOR SPATIO-TEMPORAL SCENE-GRAPH EMBEDDING FOR AUTONOMOUS VEHICLE APPLICATIONS

    AL FARUQUE MOHAMMAD ABDULLAH / YU SHIH-YUAN / MALAWADE ARNAV VAIBHAV et al. | European Patent Office | 2023

    Free access