Benchmarking of Document Page SegmentationStefan Agne; Markus Rogger; Jörg Rohrschneider
In: Daniel P. Lopresti; Jiangying Zhou (Hrsg.). Document and Recognition and Retrieval VII. SPIE Conference on Document Recognition and Retrieval (DRR), January 26-27, San Jose, CA, USA, Pages 165-171, Proceedings of SPIE, Vol. 3967, ISBN 0-8194-3585-6, SPIE- International Society for Optical Engineering, 2000.
The decomposition of a document into segments such as text regions and graphics is a significant part of the document analysis process. The basic requirement for rating and improvement of page segmentation algorithms is systematic evaluation. The approaches known from the literature have the disadvantage that manually generated reference data (zoning ground truth) are needed for the evaluation task. The effort and cost of the creation of these data are very high. This paper describes the evaluation system SEE. The system requires the OCR generated text and the original text of the document in correct reading order (text ground truth) as input. No manually generated zoning ground truth is needed. The implicit structure information that is contained in the text ground truth is used for the evaluation of the automatic zoning. Therefore, an assignment of the corresponding text regions in the text ground truth and those in the OCR generated text (matches) is sought. A fault tolerant string matching algorithm is used to develop a method which tolerates OCR errors in the text. The segmentation errors are determined as a result of the evaluation of the matching. Subsequently, the edit operations which are necessary for the correction of the recognized segmentation errors are computed to estimate the correction costs.