A Multimodal Mobile B2B Dialogue Interface on the iPhone

Daniel Porta; Daniel Sonntag; Robert Neßelrath
In: Proceedings of the 4th Workshop on Speech in Mobile and Pervasive Environments. Workshop on Speech in Mobile and Pervasive Environments (SIMPE-09), located at in conjunction with MobileHCI '09, September 15, Bonn, Germany, 2009.


In this paper, we describe a mobile Business-to-Business (B2B) interaction system. The mobile device supports users in accessing a service platform. A multimodal dialogue system allows a business expert to intuitively search and browse for services in a real-world production pipeline. We implemented a distributed client-server dialogue application for natural language speech input and speech output generation. On the mobile device, we implemented a multimodal client application which comprises of a GUI for touch gestures and a three-dimensional visualization. The client is linked to an ontology-based dialogue platform and fully leverages the device`s interaction capabilities in order to provide intuitive access to the service platform while on the go.


Förderprogramm THESEUS_CTC_IUI
Förderprogramm THESEUS_TEX_IUI

Weitere Links