Abstract
In recent literature, the niche enabling effects of crowding and the sharing algorithms have been systematically investigated in the context of Genetic Algorithms and are now established evolutionary methods for identifying optima in multi-modal problem domains. In this work, the niching metaphor is methodically explored in the context of a simultaneous multi-population GP classifier in order to investigate which (if any) properties of traditional sharing and crowding algorithms may be portable in arriving at a naturally motivated niching GP. For this study, the niching mechanisms are implemented in Grammatical Evolution to provide multi-category solutions from the same population in the same trial. Each member of the population belongs to a different niche in the GE search space corresponding to the data classes. The set of best individuals from each niche are combined hierarchically and used for multi-class classification on the familiar multi-class UCI data sets of Iris and Wine. A distinct preference for Sharing as opposed to Crowding is demonstrated with respect to population diversity during evolution and niche classification accuracy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ghosh, A., Freitas, A.A.: Data Mining and Knowledge Discovery with Evolutionary Algorithms: Guest Editorial. IEEE Transactions on Evolutionary Computation. 7(6), 517–518 (2003)
Zhou, C., Xiao, W., Tirpak, T.M., Nelson, P.C.: Evolving Accurate and Compact Classification Rules with Gene Expression Programming. IEEE Transactions on Evolutionary Computation 7(6), 519–531 (2003)
Au, W.-H., Chan, K.C.C., Yao, X.: A Novel Evolutionary Data Mining Algorithm with Applications to Churn Prediction. IEEE Transactions on Evolutionary Computation 7(6), 532–545 (2003)
Kishore, J.K., Patnaik, L.M., Mani, V., Agrawal, V.K.: Application of Genetic Programming for Multicategory Pattern Classification. IEEE Transactions on Evolutionary Computation 4(3), 242–258 (2000)
De Jong, K.A.: An Analysis of the Behaviour of a Class of Genetic Adaptive Systems. Dissertation Abstracts International, 36(10) (1975)
Deb, K., Goldberg, D.E.: An Investigation of Niche and Species Formation in Genetic Function Optimization. In: Schaffer, J.D. (ed.) Proceedings of Third International Conference of Genetic Algorithms, pp. 42–50. Morgan Kaufmann, San Mateo (1989)
Mahfoud, S.W.: Crowding and Preselection Revisited. In: Manner, R., Manderick, B. (eds.) Parallel Problem Solving from Nature, 2, pp. 27–36. Elsevier Science, Amsterdam (1992)
Miller, B.L., Shaw, M.J.: Genetic Algorithms with dynamic Niche Sharing for Multimodal Function optimization. Uni. Of Illinois at Urbana-Champaign, Dept. General Engineering, IlliGAL Report 95010, 11 pages (1995)
Yao, X., Liu, Y., Lin, G.: Evoutionary Programming Made Faster. IEEE Transactions on Evolutionary Computation 3(2), 82–102 (1999)
O’Neill, M., Ryan, C.: Grammatical Evolution: Evolutionary Automatic Programming in an Arbitrary Language. Kluwer Academic Publishers, Dordrecht (2003)
Bojarczuk, C.C., Lopes, H.S., Freitas, A.A.: An Innovative Application of a Constrained Syntax Genetic Programming System to the Problem of Predicting Survival of Patients. In: Ryan, C., Soule, T., Keijzer, M., Tsang, E.P.K., Poli, R., Costa, E. (eds.) EuroGP 2003. LNCS, vol. 2610, pp. 11–21. Springer, Heidelberg (2003)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases. University of California, Irvine, Dept. of Information Computer Sciences (1998), http://www.ics.uci.edu/~mlearn
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McIntyre, A.R., Heywood, M.I. (2004). On Multi-class Classification by Way of Niching. In: Deb, K. (eds) Genetic and Evolutionary Computation – GECCO 2004. GECCO 2004. Lecture Notes in Computer Science, vol 3103. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24855-2_67
Download citation
DOI: https://doi.org/10.1007/978-3-540-24855-2_67
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22343-6
Online ISBN: 978-3-540-24855-2
eBook Packages: Springer Book Archive