This paper describes a two-stage system for 3D tracking of pose and deformation of the human face in monocular image sequences without the use of special markers. The first stage of the system learns the space of all possible facial deformations by applying principal component analysis on real stereo tracking data. The resulting model approximates any generic shape as a linear combination of shape basis vectors. The second stage of the system uses this low-complexity deformable model for simultaneous tracking of pose and deformation of the face from a single image sequence. This stage is known as model-based monocular tracking. There are three main contributions of this paper. First we demonstrate that a data-driven approach for model construction is suitable for tracking non rigid objects and offers an elegant and practical alternative to the task of manual construction of models using 3D scanners or CAD modelers. Second, we show that such a method exhibits good tracking accuracy (errors less than 5 mm) and robustness characteristics. Third, we demonstrate that our system exhibits very promising generalization properties in enabling tracking of multiple persons with the same 3D model.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A data-driven model for monocular face tracking


    Contributors:


    Publication date :

    2001-01-01


    Size :

    1436380 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Data-Driven Model for Monocular Face Tracking

    Gokturk, S. / Bouguet, J. / Grzeszczuk, R. et al. | British Library Conference Proceedings | 2001


    Embedded control using monocular vision: Face tracking

    Flores-Delgado, J. I. / Martinez-Santos, L. G. / Lozano, R. et al. | IEEE | 2017


    3D Face pose estimation and tracking from a monocular camera

    Ji, Q. | British Library Online Contents | 2002


    Tracking Persons in Monocular Image Sequences

    Wachter, S. / Nagel, H.-H. | British Library Online Contents | 1999


    Silhouette lookup for monocular 3D pose tracking

    Howe, N. R. | British Library Online Contents | 2007