Publikation

A System for Facial Expression-based Affective Speech Translation

Zeeshan Ahmed, Ingmar Steiner, Éva Székely, Julie Carson-Berndsen

In: ACM International Conference on Intelligent User Interfaces (IUI). International Conference on Intelligent User Interfaces (IUI-13) March 19-22 Santa Monica CA United States Seiten 57-58 ISBN 978-1-4503-1966-9 ACM 3/2013.

Abstrakt

In the emerging field of speech-to-speech translation, emphasis is currently placed on the linguistic content, while the significance of paralinguistic information conveyed by facial expression or tone of voice is typically neglected. We present a prototype system for multimodal speech-to-speech translation that is able to automatically recognize and translate spoken utterances from one language into another, with the output rendered by a speech synthesis system. The novelty of our system lies in the technique of generating the synthetic speech output in one of several expressive styles that is automatically determined using a camera to analyze the user's facial expression during speech.

Weitere Links

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence