Diagnostic Evaluation of Shallow Parsing Through an Annotated Reference Corpus

Judith Klein, Stephan Busemann, Thierry Declerck

In: Proceedings of the Workshop on Evaluation in Speech and Language Technology. Workshop on Evaluation in Speech and Language Technology (SALT) June 17-18 Sheffield United Kingdom Seiten 121-128 1997.


This paper describes the development of a diagnostic tool, implemented as an annotated e-mail database, for the evaluation of the analysis component of a German dialogue system, which has been realized as a NL front end to autonomous agent systems for appointment scheduling that use e-mail as their communication means. A shallow-parsing approach has been adopted as the NL server's module. Methodology and measures applied for the evaluation must be understood in the context of the role played by the NL component within the overall system.

Weitere Links

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence