DFKI-LT - Diagnostic Evaluation of Shallow Parsing Through an Annotated Reference Corpus
Diagnostic Evaluation of Shallow Parsing Through an Annotated Reference Corpus
2 Proceedings of the Workshop on Evaluation in Speech and Language Technology,
This paper describes the development of a diagnostic tool, implemented as an annotated e-mail database, for the evaluation of the analysis component of a German dialogue system, which has been realized as a NL front end to autonomous agent systems for appointment scheduling that use e-mail as their communication means. A shallow-parsing approach has been adopted as the NL server's module. Methodology and measures applied for the evaluation must be understood in the context of the role played by the NL component within the overall system.
Files: BibTeX, Klein:1997:DES.pdf