Skip to main content Skip to main navigation

Publikation

A 3D Gesture Recognition System for Multimodal Dialog Systems

Robert Neßelrath; Jan Alexandersson
In: Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems. IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (KRPD-09), 6th, located at 21.IJCAI, July 12, Pasadena, California, USA, Pages 46-51, IJCAI 2009, 7/2009.

Zusammenfassung

We present a framework for integrating dynamic gestures as a new input modality into arbitrary applications. The framework allows training new gestures and recognizing them as user input with the help of machine learning algo-rithms. The precision of the gesture recognition is evaluated with special attention to the elderly. We show how this functionality is implemented into our dialogue system and present an example application which allows the system to learn and recognize gestures in a speech based dialogue.