Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

Ingmar Steiner, Korin Richmond, Slim Ouni

In: Michael Pucher , Darren Cosker , Gregor Hofer , Michael Berger , William Smith (Hrsg.). ACM 3rd International Symposium on Facial Analysis and Animation (FAA). International Symposium on Facial Analysis and Animation (FAA-12) September 21-21 Vienna Austria ISBN 978-1-4503-1793-1 ACM 9/2012.


The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approaches to facial animation can make use of sophisticated motion capture techniques, the animation of the intraoral articulators (viz. the tongue, jaw, and velum) typically makes use of simple rules or viseme morphing, in stark contrast to the otherwise high quality of facial modeling. Using appropriate speech production data could significantly improve the quality of articulatory animation for AV synthesis.

Weitere Links

abstract.pdf (pdf, 258 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence