Skip to main content Skip to main navigation


MMIR Framework: Multimodal Mobile Interaction and Rendering

Aaron Ruß
In: Matthias Horbach (Hrsg.). INFORMATIK 2013: Informatik angepasst an Mensch, Organisation und Umwelt. Workshop Modellbasierte Entwicklung von Benutzungsschnittstellen (MoBe-13), located at INFORMATIK 2013, September 16-20, Koblenz, Germany, Pages 2702-2713, Lecture Notes in Informatics (LNI), Vol. P-220, ISBN 978-3-88579-614-5, Köllen Druck+Verlag GmbH, Bonn, 2013.


In this article, we present the MMIR (Multimodal Mobile Interaction and Rendering) framework that is targeted at building lightweight dialog systems. The framework is geared towards multimodal interaction development for applications where only limited resources are available, e.g. so that they can run self-contained even on mobile devices. The framework utilizes SCXML for modeling application-specific states and state transitions as well as for processing input modality events.