Automatic Recognition and Interpretation of Pen- and Paper-Based Document Annotations

Marcus Liwicki; Markus Weber; Andreas Dengel

In: Bärbel Mersching; Marcus Hund; Zaheer Aziz (Hrsg.). KI 2009: Advances in Artificial Intelligence. German Conference on Artificial Intelligence (KI-09), Advances in Artificial Intelligence, September 15 - August 18, Paderborn, Germany, Page 664, Lecture Notes in Artificial Intelligence (LNAI), Vol. 5803, Springer-Verlag, 2009.


In this paper we present a system which recognizes handwritten annotations on printed text documents and interprets their semantic meaning. This system processes in three steps. In the first step, document analysis methods are applied to identify possible gestures and text regions. In the second step, the text and gestures are recognized using several state-of-the-art recognition methods. In the fourth step, the actual marked text is identified. Finally, the recognized information is sent to the Semantic Desktop, the personal Semantic Web on the Desktop computer, which supports users in their information management. In order to assess the performance of the system, we have performed an experimental study. We evaluated the different stages of the system and measured the overall performance.


Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence