Abstract
We propose a new classifier combination scheme for the ensemble of classifiers. The Pairwise Fusion Matrix (PFM) constructs confusion matrices based on classifier pairs and thus offers the estimated probability of each class based on each classifier pair. These probability outputs can then be combined and the final outputs of the ensemble of classifiers is reached using various fusion functions. The advantage of this approach is the flexibility of the choice of the fusion functions, and the experiments suggest that the PFM combined with the majority voting outperforms the simple majority voting scheme on most of problems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Duin, R.P.W.: The Combining Classifier: To Train or Not to Train? In: 16th International Conference on Pattern Recognition (ICPR), vol. 2, pp. 765–770 (2002)
Duin, R.P.W.: Pattern Recognition Toolbox for Matlab 5.0+. Available free at: ftp://ftp.ph.tn.tudelft.nl/pub/bob/prtools
Giacinto, G., Roli, F.: Design of effective neural network ensembles for image classification purposes. Image and Vision Computing 19(9-10), 699–707 (2001)
Hansen, L.K., Liisberg, C., Salamon, P.: The error-reject tradeoff. Open Systems and Information Dynamics 4, 159–184 (1997)
Ho, T.K.: The random space method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(8), 832–844 (1998)
Huang, Y.S., Suen, C.Y.: A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence 17, 90–93 (1995)
Kittler, J., Alkoot, F.M.: Relationship of Sum and Vote Fusion Strategies. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 339–348. Springer, Heidelberg (2001)
Kittler, J., et al.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3), 226–239 (1998)
Kuncheva, L.I., Bezdek, J.C., Duin, R.P.W.: Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recognition 34(2), 299–314 (2001)
Kuncheva, L.I., Whitaker, C.J.: Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy. Machine Learning 51(2), 181–207 (2003)
Raudys, S.: Experts’ boasting in trainable fusion rules. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(9), 1178–1182 (2003)
Ruta, D., Gabrys, B.: Analysis of the Correlation between Majority Voting Error and the Diversity Measures in Multiple Classifier Systems. In: Proceedings of the 4th International Symposium on Soft Computing (2001)
Ruta, D., Gabrys, B.: Classifier Selection for Majority Voting. International Journal of Information Fusion, 63–81 (2005)
Shipp, C.A., Kuncheva, L.I.: Relationships between combination methods and measures of diversity in combining classifiers. International Journal of Information Fusion 3(2), 135–148 (2002)
Tax, D.M.J., et al.: Combining Multiple Classifiers by Averaging or by Multiplying. Pattern Recognition 33(9), 1475–1485 (2000)
Turner, K., Ghosh, J.: Error Correlation and Error Reduction in Ensemble Classifiers. Connection Science 8(3-4), 385–404 (1996)
Wernecke, K.D.: A coupling procedure for discrimination of mixed data. Biometrics 48, 97–506 (1992)
Xu, L., Krzyzak, A., Suen, C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man and Cybernetics 22(3), 418–435 (1992)
Lecourtier, Y., et al.: Building Diverse Classifier Outputs to Evaluate the Behavior of Combination Methods: The Case of Two Classifiers. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 273–282. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Ko, A.HR., Sabourin, R., de Souza Britto, A. (2007). Applying Pairwise Fusion Matrix on Fusion Functions for Classifier Combination. In: Haindl, M., Kittler, J., Roli, F. (eds) Multiple Classifier Systems. MCS 2007. Lecture Notes in Computer Science, vol 4472. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72523-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-540-72523-7_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72481-0
Online ISBN: 978-3-540-72523-7
eBook Packages: Computer ScienceComputer Science (R0)