MeMo Workbench for Semi-Automated Usability Testing

Klaus-Peter Engelbrecht; Michael Kruppa; Sebastian Möller; Michael Quade

In: Proceedings of the 9th Conference in the Annual Series of Interspeech Events. Conference in the Annual Series of Interspeech Events (INTERSPEECH), located at SST 08, September 22-26, Brisbane, Queensland, Australia, Pages 1662-1665, ISCA, 2008.


In this paper we present a new approach to the automation of usability evaluation for interactive systems. Design ideas or complete systems are modeled as a conditional state machine. Then, user interactions with the system are simulated on the basis of tasks, by first searching for possible solution paths and then generating deviations from these paths under consideration of user groups and system attributes. The approach has been implemented into a workbench which supports the modeling of the system and the evaluation of the simulations. We present first results for the reliability of the approach in modeling interactions with a spoken dialog system.

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence