Context- and Affect-Aware Personal Assistance in Instrumented Environments
  printable version



Specter is a personal assistant that keeps track of its user's actions and affective states. It creates a personal journal which, together with a user model learned on the basis of it, supports the generation of context-appropriate recommendations and actions.

Application scenarios of Specter include visits of company representatives to other companies, participation in trade fairs, and assistance during shopping trips. For the latter scenario a prototype is currently developed, which is integrated with semantic web technology and an instrumented environment.

Research in the Specter project addresses six interrelated topics, focusing primarily on issues that have received relatively little attention in previous research.


  • Extension of Perception: How can Specter communicate with objects in an instrumented environment and record the user's actions and affective states in the personal journal, without endangering the user's privacy and sense of control?
  • Learning About Behavior and Affect: How can Specter mine the personal journal to learn a model of the user's preferences, habits, and typical affective reactions?
  • Augmentation of Decision Making and Effecting: How can Specter exploit the user model and the personal journal to provide context-appropriate recommendations and assistance?
  • Reflection and Introspection: How can Specter enable the user to explore and modify the user model and the personal journal and to assist Specter in its learning?
  • Usability Engineering: Since the beginning of the project, studies with users have aimed to ensure that Specter's functionality and style of behavior meet the requirements of potential users.
  • System Integration: A hardware and software infrastructure is being built up that allows Specter to be demonstrated and evaluated in instrumented environments.

Sponsor      German Federal Ministry for Education and Research (BMB+F), contract 524-40001-01 IW C03
Principal Investigator      Dr. Alexander Kröner
Duration      January 2003 through December 2005

Contact      Dr. Alexander Kröner
Phone      +49-681-302-5395
Fax      +49-681-302-5020
E-Mail      kroener@dfki.de
More about      SPECTER