Abstract
In this paper, we report a theoretical and experimental comparison between two widely used combination rules for classifier fusion: simple average and weighted average of classifiers outputs. We analyse the conditions which affect the difference between the performance of simple and weighted averaging and discuss the relation between these conditions and the concept of classifiers’ “imbalance”. Experiments aimed at assessing some of the theoretical results for cases where the theoretical assumptions could not be hold are reported.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Lam, L., Suen, C. Y.: Application of Majority Voting to Pattern Recognition: An Analysis of Its Behavior and Performance. IEEE Trans, on Systems, Man and Cybernetics-Part A27 (1997) 553–568
Turner, K., Ghosh, J.: Analysis of Decision Boundaries in Linearly Combined Neural Classifiers. Pattern Recognition 29 (1996) 341–348
Turner, K., Ghosh, J.: Linear and Order Statistics Combiners for Pattern Classification. In: Sharkey, A. J. C. (ed.): Combining Artificial Neural Nets. Springer (1999) 127–161
Xu, L., Krzyzak, A., Suen, C. Y.: Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition. IEEE Trans, on Systems, Man, and Cybernetics 22 (1992) 418–435
Huang, Y. S., Suen, C. Y.: A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence 17 (1995) 90–94
Ueda, N.: Optimal Linear Combination of Neural Networks for Improving Classification Performance. IEEE Trans, on Pattern Analisys and Machine Int. 22(2000)207–215
Turner, K.: Linear and Order Statistics Combiners for Reliable Pattern Classification. PhD thesis. The University of Texas, Austin, TX (1996)
Perrone, M., Cooper, L. N.: When Networks Disagree: Ensemble Methods for Hybrid Neural Networks. In: Mammone, R.J. (ed.): Neural Networks for Speech and Image Processing. Chapman-Hall, New York (1993)
Roli, F.: Multisensor Image Recognition by Neural Networks with Understandable Behaviour. Int. J. of Pattern Recognition and Artificial Intelligence 10 (1996) 887–917
Kittler, J., Roli, F. (eds.): Proc. of the 1st and 2nd Int. Workshop on Multiple Classifier Systems. Springer-Verlag, LNCS, Vol. 1857 (2000), and Vol. 2096 (2001)
Turner, K., Ghosh, J.: Robust Combining of Disparate Classifiers through Order Statistics. To appear in: Pattern Analysis and Applications, special issue on “Fusion of Multiple Classifiers”
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fumera, G., Roli, F. (2002). Performance Analysis and Comparison of Linear Combiners for Classifier Fusion. In: Caelli, T., Amin, A., Duin, R.P.W., de Ridder, D., Kamel, M. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2002. Lecture Notes in Computer Science, vol 2396. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-70659-3_44
Download citation
DOI: https://doi.org/10.1007/3-540-70659-3_44
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44011-6
Online ISBN: 978-3-540-70659-5
eBook Packages: Springer Book Archive