Abstract
The paper presents the new algorithm of oblique rules induction. On the basis of the initial step that consists in clustering the decision class into subclasses, for every subclass the oblique hypercuboid is generated. Sides of the hypercuboid are parallel and perpendicular to the directions defined by PCA. One hypercuboid corresponds to one decision rule. Results of inducting rules in the new way were compared with other oblique and non-oblique rules sets built on the artificial and real data.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bazan, J., Szczuka, M.S., Wróblewski, J.: A New Version of Rough Set Exploration System. In: Alpigini, J.J., Peters, J.F., Skowron, A., Zhong, N. (eds.) RSCTC 2002. LNCS (LNAI), vol. 2475, pp. 397–404. Springer, Heidelberg (2002)
Bennett, K.P., Blue, J.A.: A support vector machine approach to decision trees. In: Proceedings of the IJCNN 1998, pp. 2396–2401 (1997)
Bloedorn, E., Michalski, R.S.: Data-Driven Constructive Induction. IEEE Intelligent Systems and Their Application 13(2), 30–37 (1998)
Cantu-Paz, E., Kamath, C.: Using evolutionary algorithms to induce oblique decision trees. In: Proc. of Genetic and Evolutionary Computation Conference, pp. 1053–1060 (2000)
Frank, A., Asuncion, A.: UCI Machine Learning Repository (2010), http://archive.ics.uci.edu/ml
Frank, E., Witten, I.H.: Generating Accurate Rule Sets Without Global Optimization. In: Proc. of the 15th International Conference on Machine Learning, pp. 144–151 (1998)
Kim, H., Loh, W.-Y.: Classification trees with bivariate linear discriminant node models. Journal of Computational and Graphical Statistics 12, 512–530 (2003)
Latkowski, R., Mikołajczyk, M.: Data Decomposition and Decision Rule Joining for Classification of Data with Missing Values. In: Peters, J.F., Skowron, A., Grzymała-Busse, J.W., Kostek, B.z., Swiniarski, R.W., Szczuka, M.S. (eds.) Transactions on Rough Sets I. LNCS, vol. 3100, pp. 299–320. Springer, Heidelberg (2004)
Michalak, M., Sikora, M., Ziarnik, P.: ORG - Oblique Rules Generator. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012, Part II. LNCS, vol. 7268, pp. 152–159. Springer, Heidelberg (2012)
Murthy, S.K., Kasif, S., Salzberg, S.: A system for induction of oblique decision trees. Journal of Artificial Intelligence Research 2, 1–32 (1994)
Pindur, R., Sasmuga, R., Stefanowski, J.: Hyperplane Aggregation of Dominance Decision Rules. Fundamenta Informaticae 61(2), 117–137 (2004)
Raś, Z.W., Daradzińska, A., Liu, X.: System ADReD for discovering rules based on hyperplanes. Engineering Applications of Artificial Intelligence 17(4), 401–406 (2004)
Ripley, B.D.: Pattern Recognition and Neural Networks. Cambridge University Press (1996)
Sikora, M.: An algorithm for generalization of decision rules by joining. Foundation on Computing and Decision Sciences 30(3), 227–239 (2005)
Sikora, M.: Induction and pruning of classification rules for prediction of microseismic hazards in coal mines. Expert Systems with Applications 38(6), 6748–6758 (2011)
Sikora, M., Gudyś, A.: CHIRA – Convex Hull Based Iterative Algorithm of Rules Aggregation. Fundamenta Informaticae 123(2), 143–170 (2013)
Smith, L.I.: A tutorial on Principal Components Analysis (2002), http://www.cs.otago.ac.nz/cosc453/student_tutorials/principal_components.pdf
Ślęzak, D., Wróblewski, J.: Classification Algorithms Based on Linear Combinations of Features. In: Żytkow, J.M., Rauch, J. (eds.) PKDD 1999. LNCS (LNAI), vol. 1704, pp. 548–553. Springer, Heidelberg (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Michalak, M., Nurzyńska, K. (2013). PCA Based Oblique Decision Rules Generating. In: Tomassini, M., Antonioni, A., Daolio, F., Buesser, P. (eds) Adaptive and Natural Computing Algorithms. ICANNGA 2013. Lecture Notes in Computer Science, vol 7824. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37213-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-37213-1_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37212-4
Online ISBN: 978-3-642-37213-1
eBook Packages: Computer ScienceComputer Science (R0)