Abstract
In this paper we propose two ensemble classifiers using expression trees as weak classifiers. The first ensemble uses the AdaBoost approach and the second makes use of Dempster’âĂŹs rule of combination and applies triplet mass functions to combine classifiers. The performance of both ensemble classifiers is evaluated experimentally. The experiment involved 9 well known datasets from the UCI Irvine Machine Learning Repository. Experiment results show that using GEP-induced expression trees allows to construct high quality ensemble classifiers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Asuncion, A., Newman, D.J.: UCI Machine Learning Repository, University of California, School of Information and Computer Science (2007) http://www.ics.uci.edu/~mlearn/MLRepository.html
Bi, Y., Guan, J., Bell, D.: The combination of multiple classifiers using an evidentional reasoning approach. Artif. Intell. 172, 1731–1751 (2008)
Centeno, P., Lawrence, N.D.: Optimising Kernel Parameters and Regularisation Coefficients for Non-linear Discriminant Analysis. Journal of Machine Learning Research 7, 455–491 (2006)
Ferreira, C.: Gene Expression Programming: a New Adaptive Algorithm for Solving Problems. Complex Systems 13(2), 87–129 (2001)
Ferreira, C.: Gene Expression Programming. Studies in Computational Intell. 21, 337–380 (2006)
Freund, Y., Schapire, R.E.: Decision-theoretic generalization of on-line learning and application to boosting. Journal of Computer and System Science 55, 119–139 (1997)
FT Datasets: http://www.grappa.univ-lille3.fr/~torre/Recherche/Experiments/Results/tables.php
Ishibuchi, H., Nojima, Y.: Analysis of Interpretability-accuracy Tradeoff of Fuzzy Systems by Multiobjective Fuzzy Genetics-based Machine Learning. Intern. Journal of Approximate Reasoning 44, 4–31 (2007)
Jedrzejowicz, J., Jedrzejowicz, P.: GEP-induced expression trees as weak classifiers. In: Perner, P. (ed.) ICDM 2008. LNCS (LNAI), vol. 5077, pp. 129–141. Springer, Heidelberg (2008)
Jedrzejowicz, J., Jedrzejowicz, P.: A Family of GEP-induced Ensemble Classifiers. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. Lecture Notes in Computer Science (LNAI), vol. 5796, pp. 641–652. Springer, Heidelberg (2009)
Kretowski, M.: SOFSEM 2008. LNCS, vol. 4910, pp. 531–540. Springer, Heidelberg (2008)
Polikar, R.: Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine 3, 22–43 (2006)
Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton (1976)
Torre, F.: Boosting Correct Least General Generalizations, Technical Report GRApp A-0104, Grenoble (2004)
Weinert, W.R., Lopes, H.S.: GEPCLASS: A Classification Rule Discovery Tool Using Gene Expression Programming. In: Li, X., Zaïane, O.R., Li, Z.-h. (eds.) ADMA 2006. LNCS (LNAI), vol. 4093, pp. 871–880. Springer, Heidelberg (2006)
Zhou, C., Xiao, W., Tirpak, T.M., Nelson, P.C.: Evolving Accurate and Compact Classification Rules with Gene Expression Programming. IEEE Transactions on Evolutionary Computation 7(6), 519–531 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jȩdrzejowicz, J., Jȩdrzejowicz, P. (2010). Two Ensemble Classifiers Constructed from GEP-Induced Expression Trees. In: Jędrzejowicz, P., Nguyen, N.T., Howlet, R.J., Jain, L.C. (eds) Agent and Multi-Agent Systems: Technologies and Applications. KES-AMSTA 2010. Lecture Notes in Computer Science(), vol 6071. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13541-5_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-13541-5_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13540-8
Online ISBN: 978-3-642-13541-5
eBook Packages: Computer ScienceComputer Science (R0)