Skip to main content

Information-Theoretic Selection of Classifiers for Building Multiple Classifier Systems

  • Conference paper
Advances in Intelligent Computing (ICIC 2005)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3644))

Included in the following conference series:

  • 3483 Accesses

Abstract

Only a few studies have investigated on how to select component classifiers from a classifier pool. But, the performance of multiple classifier systems depends on the component classifiers as well as the combination methods. A couple of information-theoretic methods selecting the component classifiers by considering the relationship among classifiers are proposed in this paper. These methods are applied to the classifier pool and examine the possible classifier sets for building the multiple classifier systems. A classifier set is selected as a candidate and evaluated with the other classifier sets on the recognition of unconstrained handwritten numerals.

This research was financially supported by Hansung University in the year of 2005.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On Combining Classifiers. IEEE TPAMI 20, 226–239 (1998)

    Google Scholar 

  2. Woods, K., Kegelmeyer Jr., W.P., Bowyer, K.: Combinition of Multiple Classifiers Using Local Accuracy Estimates. IEEE TPAMI 19, 405–410 (1997)

    Google Scholar 

  3. Kang, H.J., Lee, S.W.: Experimental Results on the Construction of Multiple Classifiers Recognizing Handwritten Numerals. In: Proc. of the 6th ICDAR, pp. 1026–1030 (2001)

    Google Scholar 

  4. Kang, H.J., Lee, S.W.: A Dependency-based Framework of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals. In: Proc. of 1999 IEEE Comp. Soc. Conf. on CVPR, vol. 2, pp. 124–129 (1999)

    Google Scholar 

  5. Lewis, P.M.: Approximating Probability Distributions to Reduce Storage Requirement. Information and Control 2, 214–225 (1959)

    Article  MATH  MathSciNet  Google Scholar 

  6. Kang, H.J., Lee, S.W.: Combining Classifiers based on Minimization of a Bayes Error Rate. In: Proc. of the 5th ICDAR, pp. 398–401 (1999)

    Google Scholar 

  7. Wang, D.C.C., Wong, A.K.C.: Classification of Discrete Data with Feature Space Transform. IEEE TAC AC-24, 434–437 (1979)

    Google Scholar 

  8. Suen, C.Y., Nadal, C., Legault, R., Mai, T.A., Lam, L.: Computer Recognition of Unconstrained Handwritten Numerals. Proc. of IEEE, 1162–1180 (1992)

    Google Scholar 

  9. Blake, C., Merz, C.: UCI repository of machine learning databases. Irvine, CA, Dept. of Infor. and Comp. Sciences (1998), http://www.ics.uci.edu/~mlearn/mlrepository.html

  10. Oh, I.S., Suen, C.Y.: Distance features for neural network-based recognition of handwritten characters. IJDAR 1, 73–88 (1998)

    Article  Google Scholar 

  11. Oh, I.S., Lee, J.S., Hong, K.C., Choi, S.M.: Class-expert approach to unconstrained handwritten numeral recognition. In: Proc. of the 5th IWFHR, pp. 35–40 (1996)

    Google Scholar 

  12. Matsui, T., Tsutsumida, T., Srihari, S.N.: Combination of Stroke/Background Structure and Contour-direction Features in Handprinted Alphanumeric Recognition. In: Proc. of the 4th IWFHR, pp. 87–96 (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kang, HJ., Choo, M. (2005). Information-Theoretic Selection of Classifiers for Building Multiple Classifier Systems. In: Huang, DS., Zhang, XP., Huang, GB. (eds) Advances in Intelligent Computing. ICIC 2005. Lecture Notes in Computer Science, vol 3644. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11538059_94

Download citation

  • DOI: https://doi.org/10.1007/11538059_94

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28226-6

  • Online ISBN: 978-3-540-31902-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics