Abstract
Diversity being inherent in classifiers is widely acknowledged as an important issue in constructing successful classifier ensembles. Although many statistics have been employed to measure diversity among classifiers to determine whether it correlates with ensemble performance in the literature, most these measures are incorporated and explained in the non-evidential context. In this paper, we first introduce a modelling for formulating classifier outputs as triplet mass functions and an unform notation for defining diversity measures, we then present our studies on the relationship between diversity obtained by four pairwise and non-pairwise diversity measures and accuracy of classifiers combined in different orders in the framework of belief functions. Our experimental results demonstrate that the negative correlation between the diversity and accuracy is stronger than the positive one, which is not in favor of the claim that increasing diversity could lead to reduction of generalization error of classifier ensembles.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kuncheva, L., Whitaker, C.J.: Measures of diversity in classifier ensembles and Their Relationship with the Ensemble Accuracy. Machine Learning 51, 181–207 (2003)
Shafer, G.: A Mathematical theory of evidence. Princeton Univ. Press, Princeton (1976)
Tang, E.K., Suganthan, P.N., Yao, X.: An analysis of diversity measures. Machine Learning 65(1), 247–271 (2006)
Schapire, R.E., Freund, Y., Bartlett, P., Lee, W.S.: Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics 26, 1651–1686 (1998)
Bi, Y., Guan, J., Bell, D.: The Combination of Multiple Classifiers Using an Evidential Approach. Artificial Intelligence 17, 1731–1751 (2008)
Kohavi, R., Wolpert, D.: Bias plus variance decomposition for zero-one loss functions. In: Saitta, L. (ed.) Machine Learning: Proc. 13th International Conference, pp. 275–283. Morgan Kaufmann, San Francisco (1996)
Fleiss, J.L., Cuzick, J.: The reliability of dichotomous judgments: unequal numbers of judgments per subject. Applied Psychological Measurement 3, 537–542 (1979)
Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann, San Francisco (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bi, Y., Wu, S. (2010). Measuring Impact of Diversity of Classifiers on the Accuracy of Evidential Ensemble Classifiers. In: Hüllermeier, E., Kruse, R., Hoffmann, F. (eds) Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Methods. IPMU 2010. Communications in Computer and Information Science, vol 80. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14055-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-14055-6_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14054-9
Online ISBN: 978-3-642-14055-6
eBook Packages: Computer ScienceComputer Science (R0)