Object Recognition System Guided by Gaze of the User with a Wearable Eye Tracker

Takumi Toyama

In: DAGM'11 Proceedings of the 33rd International Conference on Pattern Recognition. Annual Symposium of the German Association for Pattern Recognition (DAGM-11), 33rd, August 30 - September 2, Frankfurt, Germany, ISBN 978-3-642-23122-3, Springer, Berlin, 2011.


Existing approaches for object recognition typically rely on images captured on an ordinary digital camera and therefore the recognition task sometimes becomes difficult when the image contains other objects (cluttered) and the object of interest is not clearly indicated. In this work, we integrate a wearable eye tracker into the object recognition system in order to recognize which object the user is paying attention to in the scene camera. To demonstrate the usability of such a gaze1 based object recognition interface, we developed a prototypical application named Museum Guide 2.0 which can be used in a museum as a mechanical guide for visitors.


Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence