Abstract This paper addresses the problem of how to learn an appropriate feature representation from video to benefit video-based face recognition. By simultaneously exploiting the spatial and temporal information, the problem is posed as learning Spatio-Temporal Embedding (STE) from raw video. STE of a video sequence is defined as its condensed version capturing the essence of space-time characteristics of the video. Relying on the co-occurrence statistics and supervised signatures provided by training videos, STE preserves the intrinsic temporal structures hidden in video volume, meanwhile encodes the discriminative cues into the spatial domain. To conduct STE, we propose two novel techniques, Bayesian keyframe learning and nonparametric discriminant embedding (NDE), for temporal and spatial learning, respectively. In terms of learned STEs, we derive a statistical formulation to the recognition problem with a probabilistic fusion model. On a large face video database containing more than 200 training and testing sequences, our approach consistently outperforms state-of-the-art methods, achieving a perfect recognition accuracy.
Spatio-temporal Embedding for Statistical Face Recognition from Video
Computer Vision – ECCV 2006 ; 7 ; 374-388
Lecture Notes in Computer Science ; 3952 , 7
2006-01-01
15 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Spatio-temporal Embedding for Statistical Face Recognition from Video
British Library Conference Proceedings | 2006
|British Library Online Contents | 2014
|Spatio-temporal segmentation of video data
SPIE | 1994
|METHODS FOR SPATIO-TEMPORAL SCENE-GRAPH EMBEDDING FOR AUTONOMOUS VEHICLE APPLICATIONS
Europäisches Patentamt | 2023
|