Progress in animation of an EMA-controlled tongue model for acoustic-visual speech synthesis

Ingmar Steiner, Slim Ouni

In: Bernd J. Kröger, Peter Birkholz (Hrsg.). Elektronische Sprachsignalverarbeitung 2011. Seiten 245-252 Studientexte zur Sprachkommunikation 61 ISBN 978-3-942710-37-4 TUDpress Dresden, Germany 9/2011.


We present a technique for the animation of a 3D kinematic tongue model, one component of the talking head of an acoustic-visual (AV) speech synthesizer. The skeletal animation approach is adapted to make use of a deformable rig controlled by tongue motion capture data obtained with electromagnetic articulography (EMA), while the tongue surface is extracted from volumetric magnetic resonance imaging (MRI) data. Initial results are shown and future work outlined.

Weitere Links

tongue.pdf (pdf, 1 MB) tongue-poster.pdf (pdf, 2 MB)

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence