We explore the application of facial tracking to automated re-animation. To this end, it is necessary to recover both head-pose and facial expression from the facial movement of a performer. However, both effects are coupled. This is a serious problem, which previous studies haven't fully considered. The solution to this interaction problem proposed here is to solve explicitly, at each timestep, for pose and expression variables. In principle this is a nonlinear inverse problem. However, appropriate parameterisation of pose in terms of affine transformations with parallax, and of expression in terms of key-frames, reduces the problem to a bilinear one. This can then be solved directly by Singular Value Decomposition. Thus actor-driven animation has ben implemented in real-time, at video field-rate, using two Indy desktop workstations.
Separability of pose and expression in facial tracking and animation
1998-01-01
1010836 byte
Conference paper
Electronic Resource
English
Separability of Pose and Expression in Facial Tracking and Animation
British Library Conference Proceedings | 1998
|Facial Expression Morphing and Animation with Local Warping Methods
British Library Conference Proceedings | 1999
|A Physically-Based Model for Real-Time Facial Expression Animation
British Library Conference Proceedings | 2001
|