This paper describes a two-stage system for 3D tracking of pose and deformation of the human face in monocular image sequences without the use of special markers. The first stage of the system learns the space of all possible facial deformations by applying principal component analysis on real stereo tracking data. The resulting model approximates any generic shape as a linear combination of shape basis vectors. The second stage of the system uses this low-complexity deformable model for simultaneous tracking of pose and deformation of the face from a single image sequence. This stage is known as model-based monocular tracking. There are three main contributions of this paper. First we demonstrate that a data-driven approach for model construction is suitable for tracking non rigid objects and offers an elegant and practical alternative to the task of manual construction of models using 3D scanners or CAD modelers. Second, we show that such a method exhibits good tracking accuracy (errors less than 5 mm) and robustness characteristics. Third, we demonstrate that our system exhibits very promising generalization properties in enabling tracking of multiple persons with the same 3D model.
A data-driven model for monocular face tracking
Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 ; 2 ; 701-708 vol.2
2001-01-01
1436380 byte
Conference paper
Electronic Resource
English
A Data-Driven Model for Monocular Face Tracking
British Library Conference Proceedings | 2001
|Embedded control using monocular vision: Face tracking
IEEE | 2017
|3D Face pose estimation and tracking from a monocular camera
British Library Online Contents | 2002
|Tracking Persons in Monocular Image Sequences
British Library Online Contents | 1999
|Silhouette lookup for monocular 3D pose tracking
British Library Online Contents | 2007
|