Abstract This paper addresses the problem of how to learn an appropriate feature representation from video to benefit video-based face recognition. By simultaneously exploiting the spatial and temporal information, the problem is posed as learning Spatio-Temporal Embedding (STE) from raw video. STE of a video sequence is defined as its condensed version capturing the essence of space-time characteristics of the video. Relying on the co-occurrence statistics and supervised signatures provided by training videos, STE preserves the intrinsic temporal structures hidden in video volume, meanwhile encodes the discriminative cues into the spatial domain. To conduct STE, we propose two novel techniques, Bayesian keyframe learning and nonparametric discriminant embedding (NDE), for temporal and spatial learning, respectively. In terms of learned STEs, we derive a statistical formulation to the recognition problem with a probabilistic fusion model. On a large face video database containing more than 200 training and testing sequences, our approach consistently outperforms state-of-the-art methods, achieving a perfect recognition accuracy.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Spatio-temporal Embedding for Statistical Face Recognition from Video


    Beteiligte:
    Liu, Wei (Autor:in) / Li, Zhifeng (Autor:in) / Tang, Xiaoou (Autor:in)


    Erscheinungsdatum :

    2006-01-01


    Format / Umfang :

    15 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Spatio-temporal Embedding for Statistical Face Recognition from Video

    Liu, W. / Li, Z. / Tang, X. | British Library Conference Proceedings | 2006



    Spatio-temporal segmentation of video data

    Wang, John / Adelson, Edward H. | SPIE | 1994


    METHODS FOR SPATIO-TEMPORAL SCENE-GRAPH EMBEDDING FOR AUTONOMOUS VEHICLE APPLICATIONS

    AL FARUQUE MOHAMMAD ABDULLAH / YU SHIH-YUAN / MALAWADE ARNAV VAIBHAV et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Real-time Attention-Augmented Spatio-Temporal Networks for Video-based Driver Activity Recognition

    Saleh, Khaled / Mihaita, Adriana-Simona / Yu, Kun et al. | IEEE | 2022