Abstract
The problem of kernel parameters selection for one-class classifier, ν-SVM, is studied. An improved constrained particle swarm optimization (PSO) is proposed to optimize the RBF kernel parameters of the ν-SVM and two kinds of flexible RBF kernels are introduced. As a general purpose swarm intelligent and global optimization tool, PSO do not need the classifier performance criterion to be differentiable and convex. In order to handle the parameter constraints involved by the ν-SVM, the improved constrained PSO utilizes the punishment term to provide the constraints violation information. Application studies on an artificial banana dataset the efficiency of the proposed method.
This work is partially supported by National Natural Science Foundation of China with grant number 60421002 and 70471052.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vapnik, V.N.: The nature of statistical learning theory. Springer, Berlin (1995)
Tax, D.M.J.: One-class classification, PhD thesis, Delft University, Delft (2001)
Unnthorsson, R., Runarsson, T.P., Jonsson, M.T.: Model selection in one-class ν-SVM using RBF kernels (2003), http://www.hi.is/~runson/svm/paper.pdf
Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Machine Learning 46, 131–159 (2002)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proc. IEEE Int. Conf. Neural Networks, Perth, pp. 1942–1948 (1995)
Parsonpoulos, K.E.: Varhatis: Recent approaches to global optimization problems through particle swarm optimization. Natural Computing 1, 235–306 (2002)
Xie, X.F., Zhang, W.J., Yang, Z.L.: Overview of particle swarm optimization. Control and Decision 18, 129–134 (2003)
Schölkopf, B., Somla, A.J.: Learning with kernels: support vector machines, regularization, optimization and beyond. MIT press, Cambridge (2002)
Frauke, F., Igel, C.: Evolutionary tuning of multiple SVM parameters. Neurocomputing 64, 107–117 (2005)
Rudolph, G.: On correlated mutations in evolution strategies. In: Parallel problems solving from nature 2 (PPSN II), pp. 105–114. Elsevier, Amsterdam (1992)
Alpaydin, E.: Introduction to machine learning. MIT Press, Cambridge (2004)
Luban, M., Staunton, L.P.: An efficient method for generating a uniform distribution of points within a hypersphere. Computers in Physics 2, 55–60 (1988)
Chang, C., Lin, C.: LIBSVM: a library for support vector machines (2005), http://www.csie.ntu.edu.tw/~cjlin/libsvm/index.html
Tax, D.M.J., Duin, R.P.W.: Uniform object generation for optimizing one-class classifiers. Journal of Machine Learning Research 2, 15–173 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xie, L. (2006). Swarm Intelligent Tuning of One-Class ν-SVM Parameters. In: Wang, GY., Peters, J.F., Skowron, A., Yao, Y. (eds) Rough Sets and Knowledge Technology. RSKT 2006. Lecture Notes in Computer Science(), vol 4062. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11795131_80
Download citation
DOI: https://doi.org/10.1007/11795131_80
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-36297-5
Online ISBN: 978-3-540-36299-9
eBook Packages: Computer ScienceComputer Science (R0)