Abstract
Support Vector Machine (SVM) has become a popular method in machine learning in recent years. SVM is widely used as a tool in many classifiction areas. The selection optimum values of the parameters (model selection) for SVM is an important step in SVM design. This paper presents the results of research and testing method Particle Swarm Optimization (PSO) in selecting the parameters for SVM. Here we focus on the selection parameter γ of the RBF function and soft margin parameter C of SVM for classification problems. In this paper we propose a Particle Swarm Optimization variation model which combine the cognition-only model with the social-only model and use randomised low discrepancy sequences for initialising particle swarms. We then evaluate the suggested strategies with a series of experiments on 6 benchmark datasets. Experimental results demonstrate the model we proposed better than grid search and full PSO-SVM model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Engelbrecht, A.P.: Computation Intelligence, ch. 16. John Wiley & Sons, Ltd., Chichester (2007)
Chatelain, C., Adam, S., Lecourtier, Y., Heutte, L., Paquet, T.: Multi-objective optimization for SVM model selection. In: Procs. of ICDAR, pp. 427–431 (2007)
Hsu, C.-W., Chang, C.-C., Lin, C.-J.: A practical guide to Support Vector Classification, Libsvm: a library for support vector machines (2005)
Tu, C.-J., Chuang, L.-Y., Chang, J.-Y., Yang, C.-H.: Feature Selection using PSO-SVM. IAENG International Journal of Computer Science 33 (2007)
Friedrichs, F., Igel, C.: Evolutionary tuning of multiple SVM parameters. In: Proceedings of the 12th ESANN, pp. 519–524 (2004)
van den Bergh, F.: An Analysis of Particle Swarm Optimization. PhD Dissertation, Faculty of Natural and Agricultural Sciences, University of Pretoria (2002)
Frohlich, H., Zell, A.: Efficient parameter selection for support vector machine in classification and regression via model-based global optimization. In: Joint Conf. on Neural Networks (2005)
Kennedy, J.: The Particle Swarm: Social Adaptation of Knowledge. In: Proceedings of the IEEE International Conference on Evolutionary Computation, pp. 303–308 (1997)
Jiang, M., Yuan, X.: Construction and application of PSO-SVM model for personal credit scoring. In: Procs of the ICCS, pp. 158–161 (2007)
Ayat, N., Cheriet, M., Suen, C.: Automatic model selection for the optimization of SVM kernels. Pattern Recognition 38(10), 1733–1745 (2005)
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, Cambridge (2000)
Hoai, N.X., Uy, N.Q., Mckay, R.I.: Initialising PSO with Randomised Low-Discrepancy Sequences: Some Preliminary and Comparative Results. To appear in Proceedings of GECCO 2007 (2007)
Sivakumari, S., Praveena Priyadarsini, R., Amudha, P.: Performance evaluation of SVM kernels using hybrid PSO-SVM. ICGST-AIML Journal 9(1) (February 2009), ISSN: 1687-4846
Wang, Z., Durst, G.L., Eberhart, R.C.: Particle Swarm Optimization and Neural Network Application for QSAR (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Nghi, D.H., Mai, L.C. (2011). A New Model of Particle Swarm Optimization for Model Selection of Support Vector Machine. In: Nguyen, N.T., Trawiński, B., Jung, J.J. (eds) New Challenges for Intelligent Information and Database Systems. Studies in Computational Intelligence, vol 351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19953-0_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-19953-0_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19952-3
Online ISBN: 978-3-642-19953-0
eBook Packages: EngineeringEngineering (R0)