Deep Processing of Shallow Structures The Robust Integration of Speech, Language and Translation Technology for Intelligent Interface Agents

Outline

Challenges for Language Engineering

Context-Sensitive Speech-to-Speech Translation

Dialog Translation 1

Dialog Translation 2

Dialog Translation 3

Verbmobil II: Three Domains of Discourse

Verbmobil Partner

The Control Panel of Verbmobil

The Control Panel of Verbmobil

From a Multi-Agent Architecture to a Multi-Blackboard Architecture

A Multi-Blackboard Architecture for the Combination of Results from Deep and Shallow Processing Modules

Integrating Shallow and Deep Analysis Components in a Multi-Blackboard Architecture

New Data Collection with Four Input Devices

Extracting Statistical Properties from Large Corpora

VHG: A Packed Chart Representation of Partial Semantic Representations

Robust Dialog Semantics: Deep Processing of Shallow Structures

Semantic Correction of Recognition Errors

Robust Dialog Semantics: Combining and Completing Partial Representations

The Understanding of Spontaneous Speech Repairs

Automatic Understanding and Correction of Speech Repairs in Spontaneous Telephone Dialogs

Integrating a Deep HPSG-based Analysis with Probabilistic Dialog Act Recognition for Semantic Transfer

The Dialog Act Hierarchie used for Planning, Prediction, Translation and Generation

Combining Statistical and Symbolic Processing for Dialog Processing

Learning of Probabilistic Plan Operators from Annotated Corpora

Automatic Generation of Multilingual Protocols of Telephone Conversations

Automatic Generation of Minutes

The Control Panel of Verbmobil

Integrating Deep and Shallow Processing: Combining Results from Concurrent Translation Threads

A Context-Free Approach to the Selection of the Best Translation Result

Learning the Normalizing Factors Alpha and Beta from an Annotated Corpus

Example of a Linear Inequation Used for Offline Learning

The Context-Sensitive Selection of the Best Translation

Verbmobil: Long-Term, Large-Scale Funding and Its Impact

Spoken Dialogs about Schedules

Linguatronic : Spoken Dialogs with Mercedes-Benz

The Architecture of the SmartKom Agent (cf. Maybury/Wahlster 1998)

SmartKom: A Transportable and Transmutable Interface Agent

SmartKom-Public: A Multimodal Communication Booth

SmartKom-Mobile: A Handheld Communication Assistant

SmartKom-Home/Office: A Versatile Agent-based Interface

SmartKom: Intuitive Multimodal Interaction

Verbmobil: Translation of Spontaneous Speech

Conclusion (1)

Conclusion (2)

Conclusion (3)

Verbmobil's Scientific Advisory Board 1993-2000