Abstract
In this paper, we report an experimental comparison between two widely used combination methods, i.e. sum and product rules, in order to determine the relationship between their performance and classifier diversity. We focus on the behaviour of the considered combination rules for ensembles of classifiers with different performance and level of correlation. To this end, a simulation method is proposed to generate with fixed accuracies and diversity a set of two classifiers providing measurement outputs. A measure of distance is used to estimate the correlation among the pairs of classifiers. Our experimental results tend to show that with diverse classifiers providing no more than three solutions, the product rule outperforms the sum rule, whereas when classifiers provide more solutions, the sum rule becomes more interesting.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aksela, M.: Comparison of Classifier Selection Methods for Improving Committee Performance. In: Windeatt, T., Roli, F. (eds.) MCS 2003. LNCS, vol. 2709, pp. 84–93. Springer, Heidelberg (2003)
Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)
Duin, R.P.: The Combining Classifier: To Train Or Not To Train? In: Kasturi, R., Laurendeau, D., Suen, C. (eds.) ICPR16, Proceedings 16th International Conference on Pattern Recognition, Quebec City, Canada, vol. II, pp. 765–770. IEEE Computer Society Press, Los Alamitos (2002)
Fumera, G., Roli, F.: Performance analysis and comparison of linear combiners for classifier fusion. In: Inter. Workshop on Statistical Pattern Recognition, SSPR/SPR, pp. 424-432 (2002)
Giacinto, G., Roli, F.: Design of Effective Neural Network Ensembles for Image Classification Processes. Image Vision and Computing Journal 19(9/10), 699–707 (2001)
Hansen, L., Salamon, P.: Neural Network Ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 993–1001 (1990)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3) (1998)
Kuncheva, L.I., Kountchev, R.K.: Generating Classifier Outputs of Fixed Accuracy and Diversity. Pattern Recognition Letters 23, 593–600 (2002)
Lecce, V.D., Dimauro, G., Guerrierro, A., Impedovo, S., Pirlo, G., Salzo, A.: Classifier Combination: The Role of a-priori Knowledge. In: Proceedings of the 7th International Workshop on Frontiers in Handwriting Recognition, Amsterdam, The Netherlands, pp. 143–152 (2000)
Parker, J.R.: Rank And Response Combination From Confusion Matrix Data. Information Fusion 2, 113–120 (2001)
Tax, D.M.J., Breukelen, M.V., Duin, R.P.W., Kittler, J.: Combining Multiple Classifiers by Averaging or by Multiplying? Pattern Recognition 33, 1475–1485 (2000)
Tumer, K., Gosh, J.: Linear and order statistics combiners for pattern classification. In: Sharky, A. (ed.) Combining Artificial Neural Nets, pp. 127–161. Springer, London (1999)
Zouari, H., Heutte, L., Lecourtier, Y., Alimi, A.: Simulating Classifier Outputs for Evaluating Parallel Combination Method. In: Windeatt, T., Roli, F. (eds.) MCS 2003. LNCS, vol. 2709, pp. 296–305. Springer, Heidelberg (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zouari, H., Heutte, L., Lecourtier, Y., Alimi, A. (2004). Building Diverse Classifier Outputs to Evaluate the Behavior of Combination Methods: The Case of Two Classifiers. In: Roli, F., Kittler, J., Windeatt, T. (eds) Multiple Classifier Systems. MCS 2004. Lecture Notes in Computer Science, vol 3077. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25966-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-540-25966-4_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22144-9
Online ISBN: 978-3-540-25966-4
eBook Packages: Springer Book Archive