Skip to main content Skip to main navigation


Natural and Intuitive Multimodal Dialogue for In-Car Applications: The SAMMIE System

Tilman Becker; Nate Blaylock; Ciprian Gerstenberger; Ivana Kruijff-Korbayová; Andreas Korthauer; Manfred Pinkal; Michael Pitz; Peter Poller; Jan Schehl
In: G. Brewka; S. Coradeschi; A. Perini; P. Traverso (Hrsg.). ECAI 2006. European Conference on Artificial Intelligence (ECAI-2006), 17th, August 29 - September 1, Riva del Garda, Italy, Pages 612-616, ISBN 978-1-58603-642-3, IOS Press, Amsterdam, 2006.


We present SAMMIE, a laboratory demonstrator of an in-car showcase of a multimodal dialogue system developed in the TALK project in cooperation between DFKI/USAAR/BOSCH/BMW, to show natural, intuitive mixed-initiative interaction, with particular emphasis on multimodal turn-planning and natural language generation. SAMMIE currently supports speech-centered multimodal access for the driver to a MP3-player application including search and browsing, as well as composition and modification of playlists. Our approach to dialogue modeling is based on collaborative problem solving integrated with an extended Information State Update paradigm. A formal usability evaluation of a first baseline system of SAMMIE by naive users in a simulated environment yielded positive results, and the improved final version will be integrated in a BMW research car.


Weitere Links