Publication

Yochina: Mobile Multimedia and Multimodal Crosslingual Dialog System

Feiyu Xu, Sven Schmeier, Renlong Ai, Hans Uszkoreit

In: Joseph Mariani (editor). Proceedings of International Workshop On Spoken Dialogue Systems Technology 2012. International Workshop On Spoken Dialogue Systems Technology (IWSDS-2012) November 28-30 Paris France Springer 2012.

Abstract

Yochina is a mobile application for crosslingual and crosscultural understanding. The core of the demonstrated app supports dialogues between English and Chinese or German and Chinese. The dialogue facility is connected with interactive language guides, culture guides and country guides. The app is based on a generic framework enabling such novel combinations of interactive assistance and reference for any language pair, travel region and culture. The framework integrates template-based translation, speech-synthesis, finite-state models of crosslingual dialogues and multimedia sentence generation. Furthermore, it allows the interlinking between crosslingual communication and tourism-relevant content. A semantic search provides easy access to words, phrases, translations and information.

Projekte

yochina.pdf (pdf, 2 MB)

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz