While speech animation fundamentally consists of a sequence of phonemes over time, sophisticated animation requires smooth interpolation and co-articulation effects, where the preceding and following phonemes influence the shape of a phoneme. Co-articulation has been approached in speech animation research in several ways, most often by simply smoothing the mouth geometry motion over time. Data-driven approaches tend to generate realistic speech animation, but they need to store a large facial motion database, which is not feasible for real time gaming and interactive applications on platforms such as PDAs and cell phones. In this paper we show that accurate speech co-articulation model with compact size can be learned from facial motion capture data. An initial phoneme sequence is generated automatically from text-to-speech (TTS) systems. Then, our learned co-articulation model is applied to the resulting phoneme sequence, producing natural and detailed motion. The contribution of this work is that speech co-articulation models "learned" from real human motion data can be used to generate natural-looking speech motion while simultaneously preserving the expressiveness of the animation via keyframing control. Simultaneously, this approach can be effectively applied to interactive applications due to its compact size.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Synthesizing speech animation by learning compact speech co-articulation models


    Contributors:
    Deng, Z. (author) / Lewis, J.P. (author) / Neumann, U. (author)


    Publication date :

    2005-01-01


    Size :

    1348714 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Synthesizing Speech Animation By Learning Compact Speech Co-Articulation Models

    Deng, Z. / Lewis, J. P. / Neumann, U. et al. | British Library Conference Proceedings | 2005


    Real-Time Speech-Driven Face Animation

    Hong, P. / Wen, Z. / Huang, T. et al. | British Library Conference Proceedings | 2002


    Lipreadable Frame Animation Driven by Speech Parameters

    Lavagetto, F. / Arzarello, D. / Caranzano, M. et al. | British Library Conference Proceedings | 1994



    Vision Based Speech Animation Transferring with Underlying Anatomical Structure

    Pei, Y. / Zha, H. | British Library Conference Proceedings | 2006