Abstract
A new classification algorithm based on support vector machine and Rough set theory is proposed in the paper. We make great use of the advantages of Rough set theory in dealing with vagueness and uncertainty information, firstly select important features by attribute reduction; secondly select effective samples by rule induction; finally construct support vector classifier by the selected important features and effective samples. Thus it can reduce training samples’ dimensions, decrease training samples’ scales and noise disturbing. It can provide us with the benefits of improving support vector machine’s training speed and classification accuracy. Result of image recognition verifies its efficiency and feasibility. It also provides us an effective method to deal with the large scale and high dimensions data set.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Wang, L.P. (ed.): Support Vector Machines: Theory and Application. Springer, Berlin (2005)
Deng, N.Y., Tian, Y.J.: A New Method of Data Mining-Support Vector Machine. Science Press (2004)
Xu, Y.T., Wang, L.S.: Fault Diagnosis System Based on Rough Set Theory and Support Vector Machine. In: Wang, L., Jin, Y. (eds.) FSKD 2005. LNCS (LNAI), vol. 3614, pp. 981–988. Springer, Heidelberg (2005)
Liu, H., Motoda, H., Yu, L.: A Selective Sampling Approach to Active Feature Selection. Artificial Inelligence 159, 49–74 (2004)
Li, R.P., Wang, Z.O.: Mining Classification Rules Using Rough Sets and Neural Networks. European Journal of Operational Research 157, 439–448 (2004)
Wang, G.Y.: Decision Table Reduction Based on Conditional Information Entropy. Chinese Journal of computers 7, 759–766 (2002)
Miao, D.Q., Hu, G.R.: A Heurisitic Algorithm for Reduction of Knowledge. Journal of computer research and development 6, 681–684 (1999)
Cao, L.J., Tay, F.E.H.: Feature Selection for Support Vector Machines in Financial Time Series Forecasting. In: Leung, K.-S., Chan, L., Meng, H. (eds.) IDEAL 2000. LNCS, vol. 1983, pp. 268–273. Springer, Heidelberg (2000)
Kumar, R., Jayaraman, V.K., Kulkarni, B.D.: An SVM Classifier Incorporating Simultaneous Noise Reduction and Feature Selection: Illustrative Case Examples. Pattern Recognition 38, 41–49 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xu, Y., Zhen, L., Yang, L., Wang, L. (2009). Classification Algorithm Based on Feature Selection and Samples Selection. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01510-6_71
Download citation
DOI: https://doi.org/10.1007/978-3-642-01510-6_71
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01509-0
Online ISBN: 978-3-642-01510-6
eBook Packages: Computer ScienceComputer Science (R0)