Abstract
Classifier Combination has been investigated as an alternative to obtain improvements in design and/or accuracy for difficult pattern recognition problems. In the literature, many combination methods and algorithms have been developed, including methods based on computational Intelligence, such as: fuzzy sets, neural networks and fuzzy neural networks. This paper presents an evaluation of how different levels of diversity reached by the choice of the components can affect the accuracy of some combination methods. The aim of this analysis is to investigate whether or not fuzzy, neural and fuzzy-neural combination methods are affected by the choice of the ensemble members.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine, CA (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Canuto, A.: Combining neural networks and fuzzy logic for applications in character recognition. PhD thesis, University of Kent (2001)
Canuto, A.M.P., Oliveira, L., Xavier Jr., J., Santos, A., Abreu, M.: Performance and Diversity Evaluation in Hybrid and non-hybrid Structures of Ensembles. In: 5th Int. Conf. on Hybrid Intelligent Systems, pp. 285–290 (2005)
Canuto, A.M.P., Abreu, M., Oliveira, L.M., Xavier Jr., J.C., Santos, A.M.: Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles. Pattern Recognition Letters 28, 472–486 (2007)
Canuto, A.M.P., Fairhurst, M., Howells, G.: Fuzzy Connectives as a Combination Tool in a Hybrid Multi-Neural System. Int. Journal of Neural Systems 13(2), 67–76 (2003)
Choquet, G.: Cooperation of modularized neural networks by fuzzy integral with owa operators. Ann. Inst. Fourier 5, 131–295 (1953)
Cho, S.-B., Kim, J.H.: Multiple network fusion using fuzzy logic. IEEE Transactions on Neural Networks 6(2), 497–501 (1995)
Czyz, J., Sadeghi, M., Kittler, J., Vandendorpe, L.: Decision fusion for face authentication. In: Proc. First Int. Conf. on Biometric Authentication, pp. 686–693 (2004)
Grabisch, M.: Fuzzy integral in multicriteria decision making. Fuzzy Sets and Systems 69, 279–298 (1995)
Kuncheva, L.I.: ‘Fuzzy’ vs ‘Non-fuzzy’ in combining classifiers designed by boosting. IEEE Transactions on Fuzzy Systems 11(6), 729–741 (2003)
Kuncheva, L.I.: Combining Pattern Classifiers. Methods and Algorithms. Wiley, Chichester (2004)
Kuncheva, L., Whitaker, C.: Measures of diversity in classifier ensembles. M. Learning 51, 181–207 (2003)
Lemieux, A., Parizeau, M.: Flexible multi-classifier architecture for face recognition systems. In: The 16th International Conference on Vision Interface (2003)
Shipp, C.A., Kuncheva, L.I.: Relationships between combination methods and measures of diversity in combining classifiers. Inf. Fusion 3(2), 135–148 (2002)
Sugeno, M.: Theory of Fuzzy Integrals and its Applications. PhD thesis, Tokyo Institute of Technology (1974)
Torres-Sospedra, J., Hernandes-Espinosa, C., Fernandes-Redondo, M.: A Comparison of Combination Methods for Ensembles of RBF Networks. In: IJCNN 2005, pp. 1137–1141 (2005)
Torres-Sospedra, J., Hernandes-Espinosa, C., Fernandes-Redondo, M.: A Research on Combination Methods for Ensembles of Multilayer Feedforward. In: IJCNN 2005, pp. 1125–1130 (2005)
Tsymbal, A., Pechenizkiy, M., Cunningham, P.: Diversity in search strategies for ensemble feature selection. Inf. Fusion, Special issue on Diversity in MCSs 6(1), 83–98 (2005)
Verikas, A., Lipnickas, A., Malmqvist, K., Bacauskiene, M., Gelzinis, A.: Soft Combination of neural classifiers: A comparative study. Pattern Recognition Letters 20, 429–444 (1999)
Zimmermann, H., Zysno, P.: Latent connectives in human decision making. Fuzzy Sets and Systems 4, 37–51 (1980)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Canuto, A.M.P., Abreu, M.C.C. (2007). Using Fuzzy, Neural and Fuzzy-Neural Combination Methods in Ensembles with Different Levels of Diversity. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D. (eds) Artificial Neural Networks – ICANN 2007. ICANN 2007. Lecture Notes in Computer Science, vol 4668. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74690-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-74690-4_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74689-8
Online ISBN: 978-3-540-74690-4
eBook Packages: Computer ScienceComputer Science (R0)