Data-driven approaches for information structure identification

Oana Postolache; Ivana Kruijff-Korbayová; Geert-Jan Kruijff

In: Proceedings of the Conference on Emperical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing (EMNLP), Vancouver, BC, Canada, ACL, 2005.


This paper investigates automatic identification of Information Structure (IS) in texts. The experiments use the Prague Dependency Treebank which is annotated with IS following the Praguian approach of Topic Focus Articulation. We automatically detect t(opic) and f(ocus), using node attributes from the treebank as basic features and derived features inspired by the annotation guidelines. We present the performance of decision trees (C4.5), maximum entropy, and rule induction (RIPPER) classifiers on all tectogrammatical nodes. We compare the results against a baseline system that always assigns f(ocus) and against a rule-based system. The best system achieves an accuracy of 90.69%, which is a 44.73% improvement over the baseline (62.66%).

postolache-et-al-05.pdf (pdf, 225 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence