We explore the application of facial tracking to automated re-animation. To this end, it is necessary to recover both head-pose and facial expression from the facial movement of a performer. However, both effects are coupled. This is a serious problem, which previous studies haven't fully considered. The solution to this interaction problem proposed here is to solve explicitly, at each timestep, for pose and expression variables. In principle this is a nonlinear inverse problem. However, appropriate parameterisation of pose in terms of affine transformations with parallax, and of expression in terms of key-frames, reduces the problem to a bilinear one. This can then be solved directly by Singular Value Decomposition. Thus actor-driven animation has ben implemented in real-time, at video field-rate, using two Indy desktop workstations.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Separability of pose and expression in facial tracking and animation


    Contributors:
    Bascle, B. (author) / Blake, A. (author)


    Publication date :

    1998-01-01


    Size :

    1010836 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Separability of Pose and Expression in Facial Tracking and Animation

    Bascle, B. / Blake, A. / IEEE; Computer Society | British Library Conference Proceedings | 1998


    Facial Expression Morphing and Animation with Local Warping Methods

    Lin, D. / Huang, H. / IEEE | British Library Conference Proceedings | 1999



    A Physically-Based Model for Real-Time Facial Expression Animation

    Zhang, Y. / Sung, E. / Prakash, E. et al. | British Library Conference Proceedings | 2001


    A physically-based model for real-time facial expression animation

    Zhang, Y. / Sung, E. / Prakash, E. | IEEE | 2001