The Augmented Dorfladen -- Interacting with Real and Virtual Products in Instrumented Shelves

Michael Schmitz, Elena Minina, Homeira Quraischy

In: Proceedings of 5th International Conference on Intelligent Environments. International Conference on Intelligent Environments (IE-2009) 5th July 20-21 Barcelona Spain Seiten 57-64 IOS Press Amsterdam, The Netherlands 2009.


This work describes a multimodal product information and comparison system designed for a rural corner store (the so called Dorfladen). Such a Dorfladen only provides a limited assortment, which we extend with virtual items on embedded displays, allowing customers to inspect and select unavailable products along their real world shopping activities for later ordering. We present the design and implementation of the system prototype and discuss the main results of a formal user study evaluating the user interface, which combines tangible interaction and natural language dialogues to interact with real and virtual products in one instrumented space.


Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence