What Makes a Beautiful Landscape Beautiful: Adjective Noun Pairs Attention by Eye-Tracking and Gaze Analysis

Mohammad Osamh Adel Al-Naser, Seyyed Saleh Mozaffari Chanijani, Syed Saqib Bukhari, Damian Borth, Andreas Dengel

In: Proceedings of the 1st International Workshop on Affect & Sentiment in Multimedia. International Workshop on Affect and Sentiment in Multimedia (ASM-15) located at ACM International Multimedia Conference October 26-30 Brisbane Australia ISBN 978-1-4503-3750-2 ACM New York, NY, USA 10/2015.


This paper asks the questions: what makes a beautiful landscape beautiful, what makes a damaged building look damaged? It tackles the challenge to understand which regions of Adjective Noun Pairs (ANP) images attract attention when observed by a human subject. We employ eye-tracking techniques to record the gaze over a set of multiple ANPs images and derive regions of interests for these ANPs. Our contribution is to study eye fixation pattern in the context of ANPs and their characteristics between being objective or subjective on the one hand and holistic vs. localizable on the other hand. Our finding indicate that subjects who differ in their assessment of ANP labels also have different eye fixation pattern. Further, we provide insights about ANP attention during implicit and explicit ANP assessment.


Weitere Links

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz