A Gesture Based System for Context-Sensitive Interaction with Smart Homes

Robert Neßelrath, Chensheng Lu, Christian Husodo Schulz, Jochen Frey, Jan Alexandersson

In: Reiner Wichert, Birgid Eberhardt (editor). Ambient Assisted Living, 4. AAL-Kongress 2011. Deutscher AAL-Kongress January 25-26 Berlin Germany Pages 209-219 Advanced Technologies and Societal Change ISBN 978-3-642-18166-5 Springer 1/2011.


This paper introduces a system for gesture based interaction with smart environments. The framework we present connects gesture recognition results with control commands for appliances in a smart home that are accessed through a middleware based on the ISO 24752 standard URC (Universal Remote Console). Gesture recognition is realized by applying three dimensional acceleration sensor information of the WiiMote from Nintendo. This information is trained to a toolkit for gesture recognition that implements machine learning algorithms well known from speech recognition. Our study focuses on two interaction concepts with the aim to exploit the context and special home scenarios. This serves to reduce the number of gestures while in parallel retaining the control complexity on a high level. A user test, also with older persons, compares both concepts and evaluates their efficiency by observing the response times and the subjective impressions of the test persons.

nesselrath_aal2011.pdf (pdf, 1 MB)

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz