Real-time 3D Gaze Analysis in Mobile Applications

Jan Hendrik Hammer, Michael Maurus, Jürgen Beyerer

In: Proceedings of the 2013 Conference on Eye Tracking South Africa. Conference on Eye Tracking South Africa (ETSA-13) August 29-31 Cape Town South Africa Pages 75-78 ETSA '13 ISBN 978-1-4503-2110-5 ACM 2013.


This paper presents a system for real-time analysis of 3D gaze data arising in mobile applications. Our system allows users to freely move in a known 3D environment while their gaze is computed on arbitrarily shaped objects. The scanpath is analysed fully automatically using fixations and areas-of-interest -- all in 3D and real time. Furthermore, the scanpath can be visualized in parallel in a 3D model of the environment. This enables to observe the scanning behaviour of a subject. We describe how this has been realized for a commercial off-the-shelf mobile eye tracker utilizing an inside-out tracking mechanism for head pose estimation. Moreover, we show examples of real gaze data collected in a museum.

Weitere Links

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz