Abstract
Support vector machine (SVM) is applied to many research fields because of its good generalization ability and solid theoretical foundation. However, as the model generated by SVM is like a black box, it is difficult for user to interpret and understand how the model makes its decision. In this paper, a hyperrectangle rules extraction (HRE) algorithm is proposed to extract rules from trained SVM. Support vector clustering (SVC) algorithm is used to find the prototypes of each class, then hyperrectangles are constructed according to the prototypes and the support vectors (SVs) under some heuristic conditions. When the hyperrectangles are projected onto coordinate axes, the if-then rules are obtained. Experimental results indicate that HRE algorithm can extract rules efficiently from trained SVM and the number and support of obtained rules can be easily controlled according to a user-defined minimal support threshold.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)
Craven, M.W., Shavlik, J.W.: Using Sampling and Queries to Extract Rules From Trained Neural Networks. In: Proceedings of the 11th International Conference on Machine Learning, New Brunswick, NJ, pp. 37–45 (1994)
Andrews, R., Diederich, J., Tickle, A.: A Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks. Knowledge-Based Systems 8(6), 373–389 (1995)
Fu, L.: Rule learning by searching on adapted nets. In: Proceedings of the 9th National Conference on Artificial Intelligence, Anaheim, CA, pp. 590–595 (1991)
Núñez, H., Angulo, C., Catala, A.: Rule-extraction from Support Vector Machines. In: The European Symposiumon Artificial Neural Networks, Burges, pp. 107–112 (2002)
Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2(2), 1–47 (1998)
Salzberg, S.: A Nearest Hyperrectangle Learning Method. Machine Learning, 251–276 (1991)
Wettschereck, D., Dietterich, T.: An Experimental Comparison of The Nearest-Neighbor and Nearest-hyperrectangle Algorithms. Machine Learning 19(1), 5–27 (1995)
Ben-Hui, A.D., Sidgelmann, H.H.T., et al.: Support vector clustering. Journel of machine learning research, 125–137 (2001)
Tax, D.M.J., Duin, R.P.W.: Data Domain Description by Support Vectors. In: Proceedings ESANN, pp. 251–256 (1999)
Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines. In: Regularization, Optimization, and Beyond. MIT Press, Cambridge (2002)
Merz, C.J., Murphy, P.M.: UCI Repository for Machine Learning Data-Bases. Department of Information and Computer Science. University of California, Irvine (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning. Neural and Statistical Classification. Prentice Hall, Englewood Cliffs (1994), Data available at http://www.ncc.up.pt/liacc/ML/statlog/datasets.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Su, H., Jia, T., Chu, J. (2005). Rule Extraction from Trained Support Vector Machines. In: Ho, T.B., Cheung, D., Liu, H. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2005. Lecture Notes in Computer Science(), vol 3518. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11430919_9
Download citation
DOI: https://doi.org/10.1007/11430919_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26076-9
Online ISBN: 978-3-540-31935-1
eBook Packages: Computer ScienceComputer Science (R0)