Abstract
In this paper, we propose Kernel Principal Component Analysis as a feature selection method for offline cursive handwriting recognition based on Hidden Markov Models. In contrast to formerly used feature selection methods, namely standard Principal Component Analysis and Independent Component Analysis, nonlinearity is achieved by making use of a radial basis function kernel. In an experimental study we demonstrate that the proposed nonlinear method has a great potential to improve cursive handwriting recognition systems and is able to significantly outperform linear feature selection methods. We consider two diverse datasets of isolated handwritten words for the experimental evaluation, the first consisting of modern English words, and the second consisting of medieval Middle High German words.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Plamondon, R., Srihari, S.: Online and off-line handwriting recognition: A comprehensive survey. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 63–84 (2000)
Marti, U.V., Bunke, H.: Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition system. Journal of Pattern Recognition and Art. Intelligence 15, 65–90 (2001)
Vinciarelli, A., Bengio, S.: Off-line cursive word recognition using continuous density HMMs trained with PCA and ICA features. In: 16th Int. Conf. on Pattern Recognition, vol. 3, pp. 81–84 (2002)
Oja, E.: Independent component analysis: algorithms and applications. Neural Networks 13, 411–430 (2000)
Müller, K., Mika, S., Rätsch, G., Tsuda, K., Schölkopf, B.: An introduction to kernel-based learning algorithms. Neural Networks 12(2), 181–202 (2001)
Schölkopf, B., Smola, A., Müller, K.R.: Kernel principal component analysis. In: Advances in Kernel Method – Support Vector Learning, pp. 327–352. MIT Press, Cambridge (1999)
Liu, Y.H., Chen, Y.T., Lu, S.S.: Face detection using kernel PCA and imbalanced SVM. In: Jiao, L., Wang, L., Gao, X.-b., Liu, J., Wu, F. (eds.) ICNC 2006. LNCS, vol. 4221, pp. 351–360. Springer, Heidelberg (2006)
Ekinci, M., Aykut, M.: Palmprint recognition by applying wavelet-based kernel PCA. Journal of Computer Science and Technology 23(5), 851–861 (2008)
Shi, D., Ong, Y.S., Tan, E.C.: Handwritten chinese character recognition using kernel active handwriting model. In: Proc. IEEE Int. Conf. on Systems, Man and Cybernetics, vol. 1, pp. 251–255. IEEE, Los Alamitos (2003)
Takiguchi, T., Ariki, Y.: Robust feature extraction using kernel PCA. In: Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, pp. 509–512. IEEE, Los Alamitos (2006)
Marti, U.V., Bunke, H.: The IAM-database: an English sentence database for off-line handwriting recognition. Int. Journal on Document Analysis and Recognition 5, 39–46 (2002)
Wüthrich, M., Liwicki, M., Fischer, A., Indermühle, E., Bunke, H., Viehhauser, G., Stolz, M.: Lanugage model integration for the recognition of handwritten medieval documents. Accepted for publication in Proc. IEEE Int. Conf. on Document Analysis and Recognition (2009)
Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257–285 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fischer, A., Bunke, H. (2009). Kernel PCA for HMM-Based Cursive Handwriting Recognition. In: Jiang, X., Petkov, N. (eds) Computer Analysis of Images and Patterns. CAIP 2009. Lecture Notes in Computer Science, vol 5702. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03767-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-03767-2_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03766-5
Online ISBN: 978-3-642-03767-2
eBook Packages: Computer ScienceComputer Science (R0)