Publication

A 3D Gesture Recognition System for Multimodal Dialog Systems

Robert Neßelrath, Jan Alexandersson

In: Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems. IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (KRPD-09) 6th located at 21.IJCAI July 12-12 Pasadena California United States Pages 46-51 IJCAI 2009 7/2009.

Abstract

We present a framework for integrating dynamic gestures as a new input modality into arbitrary applications. The framework allows training new gestures and recognizing them as user input with the help of machine learning algo-rithms. The precision of the gesture recognition is evaluated with special attention to the elderly. We show how this functionality is implemented into our dialogue system and present an example application which allows the system to learn and recognize gestures in a speech based dialogue.

nesselrath-gesture_recognition_system.pdf (pdf, 476 KB)

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz