Abstract
Support vector regression (SVR) is a new technique for pattern classification , function approximation and so on. In this paper we propose an new constructing approach of classification rules based on support vector regression and its derivative characteristics for the classification task of data mining. a new measure for determining the importance level of the attributes based on the trained SVR is proposed. Based on this new measure, a new approach for clas-sification rule construction using trained SVR is proposed. The performance of the new approach is demonstrated by several computing cases. The experimen-tal results prove that the approach proposed can improve the validity of the ex-tracted classification rules remarkably compared with other constructing rule approaches, especially for the complicated classification problems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Fu, L M.: Rule generation from neural network. IEEE Trans. on Sys. Man and Cybernetics 8, 1114–1124 (1994)
Towell, G., Shavlik, J.A.: The extraction of refined rules from knowledge-based neural networks. Machine Learning 1, 71–101 (1993)
Lu, H.J., Setiono, R., Liu, H.: NeuroRule: a connectionist approach to data mining. In: Proceedings of 21th International Conference on Very Large Data Bases, Zurich, Switzerland, pp. 81–106 (1995)
Zhou, Z.H., Jiang, Y., Chen, S.F.: Extracting symbolic rules from trained neural network ensembles. AI Communications 6, 3–15 (2003)
Sestito, S., Dillon, T.: Knowledge acquisition of conjunctive rules using multilayered neural networks. International Journal of Intelligent Systems 7, 779–805 (1993)
Craven, M.W., Shavlik, J.W.: Using sampling and queries to extract rules from trained neural networks. In: Proceedings of the 11th International Conference on Machine Learning, New Brunswick, NJ, pp. 37–45 (1994)
Maire, F.: Rule-extraction by backpropagation of polyhedra. Neural Networks 12, 717–725 (1999)
Setiono, R., Leow, W.K.: On mapping decision trees and neural networks. Knowledge Based Systems 12, 95–99 (1999)
Battiti, R.A.: Using mutual information for selecting featuring in supervised net neural learning. IEEE Trans. on Neural Networks 5, 537–550 (1994)
Bollacker, K.D., Ghosh, J.C.: Mutual information feature extractors for neural classifiers. In: Proceedings of 1996 IEEE international Conference on Neural Networks, Washington, pp. 1528–1533 (1996)
Dash, M., Liu, H., Yao, J.C.: Dimensionality reduction of unsupervised data. In: Proceedings of the 9th International Conference on Tools with Artificial Intelligence, Newport Beach, pp. 532–539 (1997)
Fu, X.J., Wang, L.P.: Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Transactions on Systems, Man and Cybernetics, Part B - Cybernetics 33, 399–409 (2003)
Kamarthi, S.V., Pittner, S.: Accelerating neural network training using weight extrapolation. Neural Networks 12, 1285–1299 (1999)
Blake, C., Keogh, E., Merz, C.J.: UCI repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, CA (1998), http://www.ics.uci.edu/~meearn/MLRepository.htm
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Zhang, D., Yang, Z., Fan, Y., Wang, Z. (2007). Constructing Classification Rules Based on SVR and Its Derivative Characteristics. In: Alhajj, R., Gao, H., Li, J., Li, X., Zaïane, O.R. (eds) Advanced Data Mining and Applications. ADMA 2007. Lecture Notes in Computer Science(), vol 4632. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73871-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-540-73871-8_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73870-1
Online ISBN: 978-3-540-73871-8
eBook Packages: Computer ScienceComputer Science (R0)