Skip to main content

Fast Feature Selection in an HMM-Based Multiple Classifier System for Handwriting Recognition

  • Conference paper
Pattern Recognition (DAGM 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2781))

Included in the following conference series:

Abstract

A novel, fast feature selection method for hidden Markov model (HMM) based classifiers is introduced in this paper. It is also shown how this method can be used to create ensembles of classifiers. The proposed methods are tested in the context of a handwritten text recognition task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Proc. of the 8th International Workshop on Frontiers in Handwritting Recognition, Niagara-on-the Lake, Ontario, Canada (2002)

    Google Scholar 

  2. Breiman, L.: Bagging predictors. Machine Learning (2), 123–140 (1996)

    Google Scholar 

  3. Charlet, D., Jouvet, D.: Optimizing feature set for speaker verification. Pattern Recognition Letters 18, 873–879 (1997)

    Article  Google Scholar 

  4. Devijver, P.A., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice-Hall, Englewood Cliffs (1982)

    MATH  Google Scholar 

  5. Dietterich, T.G.: Ensemble methods in machine learning. In: [13], pp. 1–15

    Google Scholar 

  6. Freund, Y., Schapire, R.: A decision-theoretic generalisation of on-line learning and an application to boosting. Journal of Computer and Systems Sciences 55(1), 119–139 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  7. Grandidier, F., Sabourin, R., Gilloux, M., Suen, C.Y.: An a priori indicator of the discrimination power of discrete hidden markov models. In: Proc. of the 6th Int. Conference on Document Analysis and Recognition, pp. 350–354 (2001)

    Google Scholar 

  8. Ho, T.K.: The random subspace method for constructing decision forests. IEEE Trans. on Pattern Analysis and Machine Intelligence 20(8), 832–844 (1998)

    Article  Google Scholar 

  9. Jain, A., Zongker, D.: Feature selection: evaluation, application, and small sample performance. IEEE Trans. on Pattern Analysis and Machine Intelligence 19(2), 153–158 (1997)

    Article  Google Scholar 

  10. Kaltenmeier, A., Caesar, T., Gloger, J.M., Mandler, E.: Sophisticated topology of hidden Markov models for cursive script recognition. In: Proc. of 2nd Int. Conf. on Document Analysis and Recognition, Tsukuba Science City, Japan, pp. 139–142 (1993)

    Google Scholar 

  11. Kim, G., Govindaraju, V., Srihar, S.N.: Architecture for handwritten text recognition systems. In: Lee, S.-W. (ed.) Advances in Handwriting Recognition, pp. 163–172. World Scientific Publ. Co., Singapore (1999)

    Google Scholar 

  12. Kittler, J., Pudil, P., Somol, P.: Advances in statistical feature selection. In: Singh, S., Murshed, N., Kropatsch, W.G. (eds.) ICAPR 2001. LNCS, vol. 2013, pp. 425–434. Springer, Heidelberg (2001)

    Google Scholar 

  13. Kittler, J., Roli, F. (eds.): MCS 2000. LNCS, vol. 1857. Springer, Heidelberg (2000)

    Google Scholar 

  14. Krishnan, S., Samudravijaya, K., Rao, P.: Feature selection for pattern classification with gaussian mixture models: A new objective function. Pattern Recognition Letters 17, 803–809 (1996)

    Article  Google Scholar 

  15. Marti, U., Bunke, H.: Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition system. Int. Journal of Pattern Recognition and Art. Intelligence 15, 65–90 (2001)

    Article  Google Scholar 

  16. Marti, U., Bunke, H.: The IAM-database: an English sentence database for offline handwriting recognition. Int. Journal of Document Analysis and Recognition 5, 39–46 (2002)

    Article  MATH  Google Scholar 

  17. Narendra, M.P., Fukunaga, K.: A branch and bound algorithm for feature subset selection. IEEE Trans. Comp. 26(9), 917–922 (1977)

    Article  MATH  Google Scholar 

  18. Pudil, P., Novovic̃ovà, J., Kittler, J.: Floating search methods in feature selection. Pattern Recognition Letters 15(11), 1119–1125 (1994)

    Article  Google Scholar 

  19. Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. of the IEEE 77(2), 257–285 (1989)

    Article  Google Scholar 

  20. Somol, P., Pudil, P.: Oscillating search algorithms for feature selection. In: Proc. of 15th Int. Conference on Pattern Recognition, pp. 406–409 (2000)

    Google Scholar 

  21. Wang, W., Brakensiek, A., Rigoll, G.: Combination of multiple classifiers for handwritten word recognition. In: [1], pp. 117–122

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Günter, S., Bunke, H. (2003). Fast Feature Selection in an HMM-Based Multiple Classifier System for Handwriting Recognition. In: Michaelis, B., Krell, G. (eds) Pattern Recognition. DAGM 2003. Lecture Notes in Computer Science, vol 2781. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45243-0_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45243-0_38

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40861-1

  • Online ISBN: 978-3-540-45243-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics