Abstract
This paper has three main goals: i) to employ an immune-based algorithm to train multi-layer perceptron (MLP) neural networks for pattern classification; ii) to combine the trained neural networks into ensembles of classifiers; and iii) to investigate the influence of diversity in the classification performance of individual and ensembles of classifiers. Two different classes of algorithms to train MLP are tested: bio-inspired, and gradient-based. Comparisons among all the training methods are presented in terms of classification accuracy and diversity of the solutions found.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing. Springer, Heidelberg
Rumelhart, D.E., McClelland, J.L.: The PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. In: Foundations, vol. 1, The MIT Press, Cambridge (1986)
Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine, CA (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Witten, I.H., Frank, E.: Data Mining: Practical Learning Tool and Techniques, 2nd edn. Morgan Kauffman Publishers, San Francisco (2005)
Kennedy, J., Eberhart, R.: Particle Swarm Optimization. In: Proc. of the IEEE Int. Conf. on Neural Networks. Perth, Australia, vol. 4, pp. 1942–1948 (1995)
Kennedy, J.: Particle Swarm: Optimization Bases on Sociocognition. In: de Castro, L.N., Von Zuben, F.J. (eds.) Capítulo do livro Recent Developments in Biologically Inspired Computing, pp. 235–268. Idea Group Publishing, Capítulo X (2004)
Tumer, K., Ghosh, J.: Error correlation and error reduction in ensemble classifiers. Connection Science, Special Issue on Combining Artificial Neural: Ensemble Approaches 8(3&4), 385–404 (1996)
Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)
de Castro, L.N., Timmis, J.: Artificial Immune Systems: A New Computational Intelligence Approach. Springer, Heidelberg (2002)
de Castro, L.N., Timmis, J.: An Artificial Immune Network for Multimodal Function Optimization. Proc. of the IEEE Congress on Evolutionary Computation 1, 674–699 (2002)
De Castro, L.N.: Fundamentals of Natural Computing: Basic Concepts, Algorithms, and Applications. CRC Press, Boca Raton, USA (2006)
Hansen, L.K., Salamon, P.: Neural Network Ensemble. IEEE Transactions On Pattern Analysis And Machine Intelligence 12, 10 (1996)
Kuncheva, L.I., Whitaker, C.J.: Measure of Diversity in Ensembles an Their Relationship with Ensemble Accuracy. Machine Learning 51, 181–207 (2003)
Prechelt, L.: Automatic Early Stopping Using Cross Validation: Quantifying the Criteria. Neural Networks 11(4), 761–767 (1998)
Prechelt, L.: Early Stopping – but when? Technical Report (1997)
Pasti, R., de Castro, L.N.: An Immune and a Gradient-Based Method to Train Multi-Layer Perceptron Neural Networks. In: Proc. International Joint Conference on Neural Networks (World Congress of Computational Intelligence), pp. 4077–4084 (2006)
Hashem, S., Schmeiser, B.: Improving Model Accuracy Using Optimal Linear Combinations of Trained Neural Networks. IEEE Transactions on Neural Networks 6, 3 (1995)
Hashem, S.: Optimal Linear Combinations of Neural Networks. Neural Networks 10(4), 599–614 (1997)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice-Hall, Englewood Cliffs (1999)
Bäck, T., Fogel, D.B., Michalewicz, Z.: Evolutionary Computation 1 Basic Algorithms and Operator. Institute of Physiscs Publishing (IOP), Bristol and Philadelphia (2000)
Bäck, T., Fogel, D.B., Michalewicz, Z.: Evolutionary Computation 2 Advanced Algorithms apnd Operators. Institute of Physiscs Publishing (IOP), Bristol and Philadelphia (2000)
Freund, Y., Shapire, R.: Experiments with new boosting algorithm. In: Proc. of the 13th International Conference on Machine Learning, pp. 149–156 (1996)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pasti, R., de Castro, L.N. (2007). The Influence of Diversity in an Immune–Based Algorithm to Train MLP Networks. In: de Castro, L.N., Von Zuben, F.J., Knidel, H. (eds) Artificial Immune Systems. ICARIS 2007. Lecture Notes in Computer Science, vol 4628. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73922-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-73922-7_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73921-0
Online ISBN: 978-3-540-73922-7
eBook Packages: Computer ScienceComputer Science (R0)