We propose the concept of manifold of facial expression based on the observation that images of a subject's facial expressions define a smooth manifold in the high dimensional image space. Such a manifold representation can provide a unified framework for facial expression analysis. We first apply active wavelet networks (AWN) on the image sequences for facial feature localization. To learn the structure of the manifold in the feature space derived by AWN, we investigated two types of embeddings from a high dimensional space to a low dimensional space: locally linear embedding (LLE) and Lipschitz embedding. Our experiments show that LLE is suitable for visualizing expression manifolds. After applying Lipschitz embedding, the expression manifold can be approximately considered as a super-spherical surface in the embedding space. For manifolds derived from different subjects, we propose a nonlinear alignment algorithm that keeps the semantic similarity of facial expression from different subjects on one generalized manifold. We also show that nonlinear alignment outperforms linear alignment in expression classification.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Manifold of facial expression


    Contributors:
    Chang, Y. (author) / Hu, C. (author) / Turk, M. (author)


    Publication date :

    2003-01-01


    Size :

    591548 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Manifold of Facial Expression

    Chang, Y. / Hu, C. / Turk, M. et al. | British Library Conference Proceedings | 2003


    Manifold based analysis of facial expression

    Chang, Y. / Hu, C. / Feris, R. et al. | British Library Online Contents | 2006



    Manifold based sparse representation for facial understanding in natural images

    Ptucha, R. / Savakis, A. | British Library Online Contents | 2013


    Facial Expression Decomposition

    Wang, H. / Ahuja, N. / IEEE | British Library Conference Proceedings | 2003