Abstract
In this paper, starting from a collection of training examples, we show how to produce a very compact set of classification rules. The induction idea is a clustering principle based on Kohonen’s self-organizing algorithms. The function to optimize in the aggregation of examples to become rules is a classificatory quality measure called impurity level, which was previously employed in our system called Fan. The rule conditions obtained in this way are densely populated areas in the attribute space. The main goal of our system, in addition to its accuracy, is the high quality of explanations that it can provide attached to the classification decisions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aha, D. W.: A Study of Instance-based Algorithms for Supervised Learning Tasks: Mathematical, Empirical and Psychological Evaluations. Ph. D. Dissertation, University of California at Irvine (1990).
Bahamonde, A., De La Cal, E. A., Ranilla, J., & Alonso, J.: Self-organizing symbolic learned rules. In: Mira, J., Moreno-Díaz, R., Cabestany (eds.): Biological and Artificial Computation: From Neuroscience to Technology. Lecture Notes in Computer Science, Vol. 1240. Springer-Verlag, Berlin Heidelberg New York (1997) 536–545
Blake, C., Keogh, E., & Merz, C.J.: UCI Repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.htmlurl]. Irvine, CA: University of California, Department of Information and Computer Science (1998)
Clark, P., & Niblett, T.: The CN2 Induction Algorithm. Machine Learning, 3 (1988) 261–284
Cover, T. M., & Hart, P. E.: Nearest Neighbor pattern classification. IEEE Transactions on Information Theory, 13(1), (1967) 21–27
Del Coz, J. J., Luaces, O., Quevedo, J.R., Alonso, J., & Bahamonde, A.: Self-Organizing Cases to Find Paradigms. Technical Report, Artificial Intelligence Center, University of Oviedo at Gijón. January (1999). [ftp://ftp.aic.uniovi.es/publications/Machine_Learning/paradigms.ZIP]
Fisher, R.: The Use of Multiple Measurements in Taxonomic Problems. Annals of Eugenics, 7, 1, (1936) 179–188
Holte, R.C.: Very simple classification rules perform well on most commonly used datasets. Machine Learning, 11 (1993) 63–91
Kohavi, R., John, G., Long, R., Manley, D., & Pfleger, K.: MLC++: A machine learning library in C++. In: Proceedings of the Sixth International Conference on Tools with Artificial Intelligence. IEEE Computer Society Press (1994) 740–743
Kohonen, T.: Self-Organizing Maps. Springer-Verlag, Berlin Heidelberg New York (1995)
Luaces, O., Alonso, J., De La Cal, E. A., Ranilla, J., & Bahamonde, A.: Machine Learning usefulness relies on accuracy and self-maintenance. In: Pobil, A.P., Mira, J., Ali, M. (eds.): Tasks and Methods in Applied Artificial Intelligence. Lecture Notes in Artificial Intelligence, Vol. 1416. Springer-Verlag, Berlin Heidelberg New York (1998) 448–457
Murthy, S. K., Kasif, S., & Salzberg, S.: A system for induction of oblique decision trees. Journal of Artificial Intelligence Research, 2 (1994) 1–32.
Quinlan, J. R.: C4.5: Programs for Machine Learningg. Morgan Kaufmann, San Mateo, CA (1993)
Ranilla, J., & Bahamonde, A.: Fan: Finding Accurate iNductions. Technical Report, Artificial Intelligence Center, University of Oviedo at Gijón. November (1998) [ftp://ffp.aic.uniovi.es/publications/Machine_Learning/Fanprn.ZIP]
Ranilla, J., Mones, R., & Bahamonde, A.: El Nivel de Impureza de una regla de clasificación aprendida a partir de ejemplos. Revista Iberoamericana de Inteligencia Artificial, 4 (1998) 4–11.
Salzberg, S.: Learning with nested generalized exemplars. Kluwer Academic Publishers, Boston, MA (1990)
Spiegel, M. R. (1970): Estadística McGraw-Hill, Atlacomulco, México (1970)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Luaces, O., del Coz, J.J., Quevedo, J.R., Alonso, J., Ranilla, J., Bahamonde, A. (1999). Autonomous clustering for machine learning. In: Mira, J., Sánchez-Andrés, J.V. (eds) Foundations and Tools for Neural Modeling. IWANN 1999. Lecture Notes in Computer Science, vol 1606. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0098207
Download citation
DOI: https://doi.org/10.1007/BFb0098207
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66069-9
Online ISBN: 978-3-540-48771-5
eBook Packages: Springer Book Archive