DFKI-LT - Natural and Intuitive Multimodal Dialogue for In-Car Applications: The SAMMIE System

Tilman Becker, Nate Blaylock, Ciprian Gerstenberger, Ivana Kruijff-Korbayová, Andreas Korthauer, Manfred Pinkal, Michael Pitz, Peter Poller, Jan Schehl
Natural and Intuitive Multimodal Dialogue for In-Car Applications: The SAMMIE System
in: G. Brewka, S. Coradeschi, A. Perini, P. Traverso (eds.):
2 ECAI 2006, Pages 612-616, Riva del Garda, Italy, IOS Press, Amsterdam, 2006
 
We present SAMMIE, a laboratory demonstrator of an in-car showcase of a multimodal dialogue system developed in the TALK project in cooperation between DFKI/USAAR/BOSCH/BMW, to show natural, intuitive mixed-initiative interaction, with particular emphasis on multimodal turn-planning and natural language generation. SAMMIE currently supports speech-centered multimodal access for the driver to a MP3-player application including search and browsing, as well as composition and modification of playlists. Our approach to dialogue modeling is based on collaborative problem solving integrated with an extended Information State Update paradigm. A formal usability evaluation of a first baseline system of SAMMIE by naive users in a simulated environment yielded positive results, and the improved final version will be integrated in a BMW research car.
 
Files: BibTeX, pais06-sammie.pdf