Abstract
In this paper we present a system which recognizes handwritten annotations on printed text documents and interprets their semantic meaning. This system processes in three steps. In the first step, document analysis methods are applied to identify possible gestures and text regions. In the second step, the text and gestures are recognized using several state-of-the-art recognition methods. In the fourth step, the actual marked text is identified. Finally, the recognized information is sent to the Semantic Desktop, the personal Semantic Web on the Desktop computer, which supports users in their information management. In order to assess the performance of the system, we have performed an experimental study. We evaluated the different stages of the system and measured the overall performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sellen, A.J., Harper, R.H.R.: The Myth of the Paperless Office. MIT Press, Cambridge (2001)
RodrÃguez, J., Sánchez, G., Lladós, J.: A pen-based interface for real-time document edition. In: International Conference on Document Analysis and Recognition, vol. 2, pp. 939–943 (2007)
Weibel, N., Ispas, A., Signer, B., Norrie, M.C.: PaperProof: a paper-digital proof-editing system. In: Conference on Human Factors in Computing Systems, pp. 2349–2354. ACM, New York (2008)
Sauermann, L.: The semantic desktop - a basis for personal knowledge management. In: Maurer, H., Calude, C., Salomaa, A., Tochtermann, K. (eds.) Proceedings of the I-KNOW 2005. 5th International Conference on Knowledge Management, pp. 294–301 (2005)
Liwicki, M., Schumacher, K., Dengel, A., Weibel, N., Signer, B., Norrie, M.C.: Pen and paper-based interaction with the semantic desktop. In: Handout of 8th Int. Workshop on Document Analysis Systems, IAPR, o.A., September 2008, pp. 2–5 (2008)
Norrie, M.C., Signer, B., Weibel, N.: General framework for the rapid development of interactive paper applications. In: Proc. of CoPADD 2006, 1st Int. Workshop on Collaborating over Paper and Digital Documents, pp. 9–12 (2006)
Sauermann, L., van Elst, L., Dengel, A.: Pimo - a framework for representing personal information models. In: Pellegrini, T., Schaffert, S. (eds.) Proceedings of I-Semantics 2007, JUCS, pp. 270–277 (2007)
Plamondon, R., Srihari, S.N.: On-line and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Analysis and Machine Intelligence 22(1), 63–84 (2000)
Tappert, C.C., Suen, C.Y., Wakahara, T.: The state of the art in online handwriting recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 12(8), 787–808 (1990)
Vinciarelli, A.: A survey on off-line cursive script recognition. Pattern Recognition 35(7), 1433–1446 (2002)
Knerr, S., Anisimov, V., Baret, O., Gorsky, N., Price, D., Simon, J.: The A2iA INTERCHEQUE system: Courtesy amount and legal amount recognition for French checks. Int. Journal of Pattern Recognition and Artificial Intelligence 11(4), 505–548 (1997)
Pittman, J.A.: Handwriting recognition: Tablet pc text input. Computer 40(9), 49–54 (2007)
Signer, B., Kurmann, U., Norrie, M.C.: iGesture: a general gesture recognition framework. In: Proc. of ICDAR 2007, 9th Int. Conference on Document Analysis and Recognition, pp. 954–958 (2007)
Rubine, D.: Specifying gestures by example. In: SIGGRAPH 1991: Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques, pp. 329–337 (1991)
Feng, G., Viard-Gaudin, C., Zhengxing, S.: electric circuit diagram understanding using 2d dynamic programming. In: 11th Int. Conf. on Frontiers in Handwriting Recognition (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liwicki, M., Weber, M., Dengel, A. (2009). Automatic Recognition and Interpretation of Pen- and Paper-Based Document Annotations. In: Mertsching, B., Hund, M., Aziz, Z. (eds) KI 2009: Advances in Artificial Intelligence. KI 2009. Lecture Notes in Computer Science(), vol 5803. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04617-9_73
Download citation
DOI: https://doi.org/10.1007/978-3-642-04617-9_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04616-2
Online ISBN: 978-3-642-04617-9
eBook Packages: Computer ScienceComputer Science (R0)