This paper presents a method to model and recognize human faces in video sequences. Each registered person is represented by a low-dimensional appearance manifold in the ambient image space, the complex nonlinear appearance manifold expressed as a collection of subsets (named pose manifolds), and the connectivity among them. Each pose manifold is approximated by an affine plane. To construct this representation, exemplars are sampled from videos, and these exemplars are clustered with a K-means algorithm; each cluster is represented as a plane computed through principal component analysis (PCA). The connectivity between the pose manifolds encodes the transition probability between images in each of the pose manifold and is learned from a training video sequences. A maximum a posteriori formulation is presented for face recognition in test video sequences by integrating the likelihood that the input image comes from a particular pose manifold and the transition probability to this pose manifold from the previous frame. To recognize faces with partial occlusion, we introduce a weight mask into the process. Extensive experiments demonstrate that the proposed algorithm outperforms existing frame-based face recognition methods with temporal voting schemes.
Video-based face recognition using probabilistic appearance manifolds
2003-01-01
466470 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Video-Based Face Recognition Using Probabilistic Appearance Manifolds
British Library Conference Proceedings | 2003
|Visual tracking and recognition using probabilistic appearance manifolds
British Library Online Contents | 2005
|Learning appearance manifolds from video
IEEE | 2005
|Video-based face model fitting using Adaptive Active Appearance Model
British Library Online Contents | 2010
|