DFKI-LT - Artimate: an articulatory animation framework for audiovisual speech synthesis

Ingmar Steiner, Slim Ouni
Artimate: an articulatory animation framework for audiovisual speech synthesis
in: John Kane, Joćo Cabral (eds.):
1 ISCA Workshop on Innovation and Applications in Speech Technology (IAST), Pages 57-60, Dublin, Ireland, Online, CNGL, 3/2012
 
We present a modular framework for articulatory animation synthesis using speech motion capture data obtained with electromagnetic articulography (EMA). Adapting a skeletal animation approach, the articulatory motion data is applied to a three-dimensional (3D) model of the vocal tract, creating a portable resource that can be integrated in an audiovisual (AV) speech synthesis platform to provide realistic animation of the tongue and teeth for a virtual character. The framework also provides an interface to articulatory animation synthesis, as well as an example application to illustrate its use with a 3D game engine. We rely on cross-platform, open-source software and open standards to provide a lightweight, accessible, and portable workflow.
 
Files: BibTeX, 1203.3574, hal-00678964, muster.ucd.ie, paper.pdf