Skip to main content

A New Evaluation Method for Expert Combination in Multi-expert System Designing

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1857))

Abstract

In this paper a new evaluation method for expert combination is presented. It takes into account the correlation among experts, their number and their recognition rate. An extended investigation on Majority Vote, Bayesian, Behaviour Knowledge Space and Dempster-Shafer method for abstract-level classifiers is presented. The two-way analysis of variance test and the Scheffè post-hoc comparison have been used to investigate on the factors that influence the recognition rate of the multi-expert system and to collect useful information for the multi-expert system designing.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. L. Xu, A. Krzyzak, C. Y-Suen, “Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition”, IEEE Transaction on Systems, Man and Cybernetics, Vol. 22, N. 3, 1992, pp. 418–435.

    Article  Google Scholar 

  2. F. Kimura, M. Shridhar, “Handwritten Numeral Recognition Based on Multiple Algorithm”, Pattern Recognition, vol. 24 no. 10, 1991, pp. 969–983.

    Article  Google Scholar 

  3. E. Mandler and J. Schuermann, “Combining the Classification Results of independent classifiers based on the Dempster/Shafer theory of evidence”, in Pattern Recognition and Artificial Intelligence, Eds. E.S. Gelsema and L.N. Kanal, North Holland, Amsterdam, 1988, pp. 381–393.

    Google Scholar 

  4. S.B. Cho, J.H. Kim, “Combining Multiple Neural Networks by Fuzzy Integral for Robust Classification”, IEEE Trans. Systems, Man and Cybernetics, vol. 25, no. 2, 1995, pp. 380–384.

    Article  Google Scholar 

  5. Y.S. Huang and C.Y. Suen, “A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals”. IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 17, no. 1, 1995, pp. 90–94.

    Article  Google Scholar 

  6. H.J. Kang, S.W. Lee, “Combining Classifiers Based on Minimization of a Bayes Error Rate”, Proc. of Fifth International Conference on Document Analysis and Recognition (ICDAR99), Bangalore, India, 20–22 Sept. 1999, pp. 398–401.

    Google Scholar 

  7. J. Kittler, M. Hatef, R. P.W. Duin, J. Matas, “On Combining Classifiers”, IEEE on Pattern Analysis and Machine Intelligence, vol. 20 No. 3, March 1998, pp. 226–239.

    Article  Google Scholar 

  8. N. Srihari et al, “Decision combination in multiple classifier systems”, IEEE on Pattern Analysis and Machine Intelligence, vol. 16 No. 1, Jan. 1994, pp. 66–75.

    Article  Google Scholar 

  9. G. Giacinto, F. Roli, “Methods for Dynamic Classifier Selection”, Proc. of 10th Intern. Conference on Image Analysis and Processing ICIAP’99, Venice, Italy, Sept. 27–29, 1999, pp. 659–664.

    Google Scholar 

  10. J. Kittler, “Improving Recognition rates by classifier combination: A Theoretical Framework”, Progress in Handwriting Recognition, edited by A.C. Downton and S. Impedovo, World Scientific Publishing Co. Pte. Ltd., Singapore, 1997, pp. 231–247.

    Google Scholar 

  11. G. Dimauro, S. Impedovo, G. Pirlo, A. Salzo, “Multiple Experts: a new methodology for the evaluation of the combination processes”, Progress in Handwriting Recognition, edited by A.C. Downton and S. Impedovo, World Scientific Publishing Co. Pte. Ltd., Singapore, pp. 329–335.

    Google Scholar 

  12. S. Impedovo, A. Salzo, “Evaluation of Combination Methods”, Proc. of Fifth International Conference on Document Analysis and Recognition (ICDAR99), Bangalore, India, 20–22 Sept. 1999, pp. 394–397.

    Google Scholar 

  13. C.Y. Suen, C. Nadal, R. Legault, T.A. Mai, L. Lam, “Computer Recognition of unconstrained hand-written Numerals”, Proc. IEEE, Vol. 80, N. 7, 1992, pp. 1162–1180

    Article  Google Scholar 

  14. E. Kreyszig, “Introductory Mathematical Statistics-Principle and Methods-”, John Wiley & Sons Publ., New York, 1970, pp. 262–284.

    Google Scholar 

  15. H. Scheffé, “A method for judging all contrasts in the analysis of variance”, Biometrika, 40, 1953, pp. 87–104.

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Impedovo, S., Salzo, A. (2000). A New Evaluation Method for Expert Combination in Multi-expert System Designing. In: Multiple Classifier Systems. MCS 2000. Lecture Notes in Computer Science, vol 1857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45014-9_22

Download citation

  • DOI: https://doi.org/10.1007/3-540-45014-9_22

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67704-8

  • Online ISBN: 978-3-540-45014-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics