Terra: a Collection of Translation Error-Annotated Corpora

Mark Fishel, Ondrej Bojar, Maja Popovic

In: Proceedings of the 8th International Conference on Language Resources and Evaluation. International Conference on Language Resources and Evaluation (LREC-12) 8th May 23-25 Istanbul Turkey European Language Resources Association (ELRA) 5/2012.


Recently the first methods of automatic diagnostics of machine translation have emerged; since this area of research is relatively young, the efforts are not coordinated. We present a collection of translation error-annotated corpora, consisting of automatically produced translations and their detailed manual translation error analysis. Using the collected corpora we evaluate the available state-of-the-art methods of MT diagnostics and assess, how well the methods perform, how they compare to each other and whether they can be useful in practice.


terra.pdf (pdf, 414 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence