Skip to main content Skip to main navigation

Project

Specter

Context- and Affect-Aware Personal Assistance in Instrumented Environments

Context- and Affect-Aware Personal Assistance in Instrumented Environments

  • Duration:

SPECTER is a personal assistant that keeps track of its user's actions and affective states. It creates a personal journal which, together with a user model learned on the basis of it, supports the generation of context-appropriate recommendations and actions.

Application scenarios for SPECTER include visits of company representatives to other companies, participation in trade fairs, and assistance during shopping trips. In order to demonstrate the project goals a prototype is currently developed, which combines semantic web technologies with an instrumented environment.

Research in the SPECTER project addresses six interrelated topics, focusing primarily on issues that have received relatively little attention in previous research.

  • Extension of Perception: How can SPECTER communicate with objects in an instrumented environment and record the user's actions and affective states in the personal journal, without endangering the user's privacy and sense of control?
  • Learning About Behavior and Affect: How can SPECTER mine the personal journal to learn a model of the user's preferences, habits, and typical affective reactions?
  • Augmentation of Decision Making and Effecting: How can SPECTER exploit the user model and the personal journal to provide context-appropriate recommendations and assistance?
  • Reflection and Introspection: How can SPECTER enable the user to explore and modify the user model and the personal journal and to assist SPECTER in its learning?
  • Usability Engineering: Since the beginning of the project, studies with users have aimed to ensure that SPECTER's functionality and style of behavior meet the requirements of potential users.
  • System Integration: A hardware and software infrastructure is being built up that allows SPECTER to be demonstrated and evaluated in instrumented environments.

Sponsors

BMBF - Federal Ministry of Education and Research

BMBF - Federal Ministry of Education and Research

Publications about the project

Lala Ray; Bo Zhou; Sungho Suh; Paul Lukowicz

In: IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops). IEEE International Conference on Pervasive Computing and Communications (PerCom-2023), March 13-17, Atlanta, USA, IEEE, 3/2023.

To the publication

Melvin Chelli; Cédric Prigent; René Schubotz; Alexandru Costan; Gabriel Antoniu; Loïc Cudennec; Philipp Slusallek

In: Proceedings of the IEEE International Conference on Cluster Computing. IEEE International Conference on Cluster Computing (Cluster-2023), October 31 - November 3, Santa Fe, New Mexico, USA, IEEE, 2023.

To the publication

Vitor Fortes Rey; Sungho Suh; Paul Lukowicz

In: ACM International Symposium on Wearable Computers. ACM International Symposium on Wearable Computers (ISWC-2022), ACM, 9/2022.

To the publication