A Basic Cognitive System for Interactive Continuous Learning of Visual Concepts

Danijel Skocaj, Miroslav Janicek, Geert-Jan Kruijff, Ales Leonardis, Pierre Lison, Alen Vrecko, Michael Zillich

In: Proceedings of the ICRA 2010 Workshop on Interactive Communication for Autonomous Intelligent Robots. Workshop on Interactive Communication for Autonomous Intelligent Robots (ICAIR-2010) May 7 Anchorage AK United States IEEE 2010.


Interactive continuous learning is an important characteristic of a cognitive agent that is supposed to operate and evolve in an everchanging environment. In this paper we present representations and mechanisms that are necessary for continuous learning of visual concepts in dialogue with a tutor. We present an approach for modelling beliefs stemming from multiple modalities and we show how these beliefs are created by processing visual and linguistic information and how they are used for learning. We also present a system that exploits these representations and mechanisms, and demonstrate these principles in the case of learning about object colours and basic shapes in dialogue with the tutor.


icair10main.pdf (pdf, 1 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence