Natural Dialogues with an Artificial Partner - Revisited

Table of Contents

Natural Dialogues with an Artificial Partner - Revisited

Our First International Publication on HAM-RPM, 3rd ECAI, 1978

The HAM-RPM Core Team

Outline of the Talk

The HAM-RPM Tradition of Building Complete Dialogoue Systems as Testbeds

Three Levels of Language Processing

The Architecture of HAM-RPM (1978 - 1981)

The HAM-RPM Tradition of Building Multimodal Systems: Integrating Language and Vision

HAM-RPM: A Fully Operational Dialogue System Using 55K Memory of a PDP-10 under TOPS-10

HAM-RPM: A Fully Operational Dialogue System... (2)

HAM-RPM: A Fully Operational Dialogue System... (3)

Anticipation Feedback in the Generation of Elliptical Utterances

Anticipation Feedback: Simulating the User‘s Interpretation of a Planned Utterance of the System

Combining Language and Gestures in XTRA (eXpert TRAnslator, Wahlster et al. 1986)

Anticipation Feedback Loop in the XTRA Sytem

Symbolic and Subsymbolic Fusion of Multiple Modes

Mutual Disambiguation of Multiple Input Modes

Multimodal Interaction with Consumer Electronics via SmartKom

Fusion of the Results of Speech Recognition and Facial Expression Recognition

Recognizing Affect: An Angry Facial Expression of the User

From Spoken Dialogue to Multimodal Dialogue

Merging Various User Interface Paradigms

Multimodal Interaction with a Life-like Character

SmartKom: Intuitive Multimodal Interaction

SmartKom`s SDDP Interaction Metaphor: Natural Dialogues with an Artificial Partner

SmartKom: A Transportable Interface Agent

Multimodal Input and Output in SmartKom

Combination of Speech and Gesture in SmartKom

Multimodal Input and Output in SmartKom

The High-Level Control Flow of SmartKom

Conclusion

Thank You Walther von Hahn

E-Mail: wahlster@dfki.de

Homepage: http://www.dfki.de/~wahlster

Download presentation source