DFKI-LT - From human to automatic error classification for machine translation output

Maja Popovic, Aljoscha Burchardt
From human to automatic error classification for machine translation output
2 15th International Conference of the European Association for Machine Translation (EAMT 11), Leuven, Belgium, European Association for Machine Translation, 5/2011
 
Future improvement of machine translation systems requires reliable automatic evaluation and error classification measures to avoid time and money consuming human classification. In this article, we propose a new method for automatic error classification and systematically compare its results to those obtained by humans. We show that the proposed automatic measures correlate well with human judgments across different error classes as well as across different translation outputs on four out of five commonly used error classes.
 
Files: BibTeX, Popovic-14-finalVersion.pdf