Publikation

A German-Chinese Speech-Gesture Behavioural Corpus of Device Control in a Smart Home

Dimitra Anastasiou, Cui Jian, Christoph Stahl

In: Proceedings of the 6th International Conference on Pervasive Technologies Related to Assistive Environments. Workshop on Affect and Behaviour Related Assistance (ABRA-13) The 6th International Conference on Pervasive Technologies Related to Assistive Environments befindet sich International Conference on Pervasive Technologies Related to Assistive Environments May 29-31 Rhodos Greece ACM Digital Library 5/2013.

Abstrakt

This paper reports on empirical studies on the use of speech and gesture interaction for device control in the Bremen Ambient Assisted Living Lab (BAALL) at the German Research Center for Artificial Intelligence at the University of Bremen. Our goal is to create and evaluate a multimodal corpus of device control (turn on lights, open sliding door, etc.). A Wizard-of-Oz user study was conducted in this lab with German and Chinese participants in order to carry out a comparative analysis of cross-lingual spatial spoken and gesture commands and report on cultural differences. The long-term goal is to design and develop a speech and gesture combining multimodal interactive system, while considering relevant behavioural aspects, such as cultural differences presented in this paper.

Projekte

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence