Two different approaches are here presented for converting speech into graphic animation, suitable to lipreading. Coarticulation modeling has been taken into account by means of an original algorithm for multistep statistical processing of digital speech in the cepstrum space. Two different visualization methods have been used, the first based on key reference pictures and the second based on a parametric flexible structure. Speech is converted, in real-time, into lipreadable visual animation by associating incoming acoustic frames with correspondent consistent graphic primitives, pictures or parameters, suitably visualized. Multiple fields of application are foreseen, mainly in rehabilitation, training, education and communication among hard of hearing people.<>
Lipreadable frame animation driven by speech parameters
1994-01-01
335285 byte
Conference paper
Electronic Resource
English
Lipreadable Frame Animation Driven by Speech Parameters
British Library Conference Proceedings | 1994
|Real-Time Speech-Driven Face Animation
British Library Conference Proceedings | 2002
|Speaker-independent speech-driven facial animation using a hierarchical model
British Library Conference Proceedings | 2003
|Video Input Driven Animation (VIDA)
British Library Conference Proceedings | 2003
|Video input driven animation (VIDA)
IEEE | 2003
|