Project

IDEAS4GAMES

Intelligent dialogue control and expressive speech synthesis for computer games

This project addresses novel interaction paradigms and technologies for enhancing the flexibility of interaction and dialogue management in computer games. This will enable computer-driven game characters to lead more intelligent and versatile dialogues than is possible with current games technology.

Research is targeted towards the following innovations.

Intelligent dialogue control by means of methods from artificial intelligence

  • Adaptation of the dialogue flow to the current context, the user's actions and the emotions of virtual characters, which are computed at run-time;
  • Consideration of previous dialogue in order to avoid repetitions and to generate a consistent behaviour.

Modelling emotions and personality on the basis of socio-psychological models

  • Integration of a component for modelling and computing emotions into a game engine;
  • Improvement of the bodily behaviour of virtual characters, e.g. selection and individual execution of gestures (which may accompany speech), idle movements, or the type of facial expression;
  • Impact of emotions on the dialogical and interactional behaviour of virtual characters in computer games.

Speech synthesis with reliable quality

  • Embedding speech synthesis in a game engine;
  • Predictability of synthesis quality;
  • Reduction of the manual effort during the creation of new synthetic voices;

Expressive speech synthesis

  • Generation of voices typical for game scenarios (giant, dwarf, robot, etc.) from synthetic speech by means of speech signal processing methods;
  • Automatic learning methods for emotion-specific sound patterns from sample data in view of generating synthetic speech;
  • Increasing the spectrum of available expressivity through domain-specific and domain-oriented synthetic voices.

Share project:

Contact Person
Dr. Patrick Gebhard

Publications about the project

Marc Schröder, Patrick Gebhard, Marcela Charfuelan Oliva, Christoph Endres, Michael Kipp, Sathish Chandra Pammi, Martin Rumpler, Oytun Türk

In: Andreas Dengel, K. Berns, Thomas Breuel, Frank Bomarius, Thomas Roth-Berghofer (editor). KI 2008: Advances in Artificial Intelligence. German Conference on Artificial Intelligence (KI-2008) September 23-26 Kaiserslautern Germany Pages 316-323 Lecture Notes in Artificial Intelligence (LNAI) 5243 Springer 2008.

To the publication
Patrick Gebhard, Marc Schröder, Marcela Charfuelan Oliva, Christoph Endres, Michael Kipp, Sathish Chandra Pammi, Martin Rumpler, Oytun Türk

In: Helmut Prendinger, James C. Lester, Mitsuru Ishizuka (editor). Proceedings of the 8th International Conference on Intelligent Virtual Agents. International Conference on Intelligent Virtual Agents (IVA-2008) September 1-3 Tokyo Japan Pages 426-440 Lecture Notes in Artificial Intelligence (LNAI) 5208 ISBN 978-3-540-85482-1 Springer 2008.

To the publication

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz