Situations-Adaptive Multimodale Interaktion für Innovative Mobilitätskonzepte der Zukunft

Situations-Adaptive Multimodale Interaktion für Innovative Mobilitätskonzepte der Zukunft

  • Duration:

Mobility is a critical pillar of our modern economy system. We envision that the car of the future will not only be considered from the perspective of a means of transportation, but as a multi-functional intelligent environment.

The overall goal of SiAM lies in the establishment of a scientific and technological foundation of situation-dependent multi-modality for the communication with and between the next generations of personal transportation.

To achieve this goal, we particularly take into consideration the interaction of individual and multiple road users with their environment (e.g. buildings and billboards), as well as the usage of car-to-x communication to improve intelligent driver assistance systems. The aspect of driving safety plays a major role in form of a new approach on the prediction of cognitive costs based on user interaction. Finally, the concepts are integrated into a multi-modal dialogue platform, which enables several new usage concepts (e.g. eye-gaze plus micro-gestures) and interaction tailored to a specific user via adaptation and persuasive behavior.

Core Components

The following components represent three core accessories that have been developed in SiAM:

  • Multimodal Dialogue Platform SiAM-dp
  • Pull-based car-to-x communication framework PADE
  • Eyetracking hardware and software solution EyeVIUS

Share project:

Contact Person
Dr.-Ing. Michael Feld


Publications about the project

Matthieu Deru, Robert Neßelrath

In: Proceedings of the 4th International Symposium on Pervasive Displays. International Symposium on Pervasive Displays (PerDis-15) 4th June 10-12 Saarbrücken Germany Pages 235-236 ISBN 978-1-4503-3608-6 ACM 2015.

To the publication
Monika Pepikj, Mohammad Mehdi Moniri, Robert Neßelrath, Tim Schwartz, Michael Feld, Yannick Körber, Matthieu Deru, Christian Müller

In: Proceedings of the International Conference on Intelligent Environments (IE). International Conference on Intelligent Environments (IE-15) July 15-17 Prague Czech Republic Pages 180-183 IEEE 2015.

To the publication

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz