MMIR Framework: Multimodal Mobile Interaction and Rendering

Aaron Ruß

In: Matthias Horbach (editor). INFORMATIK 2013: Informatik angepasst an Mensch, Organisation und Umwelt. Workshop Modellbasierte Entwicklung von Benutzungsschnittstellen (MoBe-13) located at INFORMATIK 2013 September 16-20 Koblenz Germany Pages 2702-2713 Lecture Notes in Informatics (LNI) P-220 ISBN 978-3-88579-614-5 Köllen Druck+Verlag GmbH Bonn 2013.


In this article, we present the MMIR (Multimodal Mobile Interaction and Rendering) framework that is targeted at building lightweight dialog systems. The framework is geared towards multimodal interaction development for applications where only limited resources are available, e.g. so that they can run self-contained even on mobile devices. The framework utilizes SCXML for modeling application-specific states and state transitions as well as for processing input modality events.

Russ_(2013)_MMIR_Framework_-_Multimodal_Mobile_Interaction_and_Rendering__self-published.pdf (pdf, 691 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz