Multi-User Interaction on Media Facades through Live Video on Mobile Devices

Sebastian Boring; Sven Gehring; Alexander Wiethoff; Magdalena Blöckner; Johannes Schöning; Andreas Butz

In: Proceedings of the 28th International Conference on Human Factors in Computing Systems. ACM International Conference on Human Factors in Computing Systems (CHI-11), May 7-12, Vancouver, BC, Canada, ACM, 5/2011.


The increasing number of media facades in urban spaces offers great potential for new forms of interaction – especially for collaborative multi-user scenarios. In this paper, we present a way to interact with them through live video on mobile devices. Users can directly interact with the facade shown in the viewfinder. Additionally, we use the mobile display to show individual content that would otherwise clutter the facade's canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting freely on the facade and (2) solving a 15-puzzle. We tested the applications during the ARS Electronica Festival in Linz, Austria and found that users consider this interaction as easy-to-learn and that they enjoy collaborating or competing with others.


Weitere Links

p2721.pdf (pdf, 1 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence