Symmetric Multimodality for Ambient Intelligence

DFKI is based in Kaiserslautern and Saarbruecken

DFKI is a Joint Venture of:

The Six R&D Departments of DFKI

The Structure of DFKI

Contract Research and Development as a Center of Excellence

DFKI recruits worldwide: 77 foreigners from 36 countries

Merging Various User Interface Paradigms

The Fusion of Multimodal Input

The Fusion of Multimodal Input

Symmetric Multimodality

What is Ambient Intelligence?

Ambient Intelligence as an Interdisciplinary Field

Outline of the Talk

Ambient Intelligence in the Future Store

Mobile Shop Assist

Plan-based Shopping Assistance

The Instrumented Shopping Environment

The Interaction Framework for Ambient Intelligence

Symmetric Multimodality for Ambient Intelligence (Wahlster 2003)

Natural Language Conversation with Products in a Cybershop

Automatic Comparison Shopping with Ambient Intelligence

Symmetric Multimodal in the Mobile Shop Assistant

Multimodal Interaction in the Instrumented Shop

Symmetric Multimodal Interaction in an Instrumented Shopping Environment

Anthropomorphized Objects: Mixed-Initiative Dialogs with Products

Question-Answering by Highlighting Physical Objects: Deictic Gestures with SearchLight

A Four-Layered Architecture for Ambient Intelligence

The Personal Journal: Augmenting Memory

Infrastructure

Capturing the Cognitive and Affective State of Users by Mobile Biosensors

Viewer Example: Annotating an Entry

The Memory Model for Augmented Cognition

Reflection and Introspection - A Journal Browser

Trigger Definition - From User Input to Executable Code

Reflection and Introspection Environment

SmartWeb-Konsortium

SmartWeb Combines Five Input Modalities

Mobile SmartWeb Applications for Car Drivers, Motor Bikers, and Pedestrians

Semantic Peer-to-Peer Communication between Vehicles Safety Agents

SmartWeb: Semantic Web Service Communication between Cars

SmartWeb: The Follow-up Project of SmartKom

The Basic Architecture of SmartWeb

SmartWeb: Spoken Dialogs for Comparison Shopping in the Car

SmartWeb as Mobile Assistant for Soccer Fans at the FIFA Worldcup 2006 in Germany

Partial View of the Soccer Ontology for the SmartWeb Demonstrator at the FIFA Soccer Worldcup 2006 in Germany

COMPASS 2008: Digital Olympics in Beijing 2008 in Cooperation with MOST

The SmartKom Consortium

SmartKom: A Flexible and Adaptive Shell for Multimodal Dialogues

SmartKom-Mobile as a Travel Companion in the Car

SmartKom-Mobile as a Travel Companion for Pedestrians

Unification of Scored Hypothesis Graphs for Modality Fusion in SmartKom

The Markup Language Layer Model of SmartKom

M3L Representation of an Intention Lattice Fragment

Fusing Symbolic and Statistical Information in SmartKom

SmartKom's Computational Mechanisms for Modality Fusion and Fission

URL of this Talk:

Conclusions