Abstract
Generalization performance of support vector machines (SVM) with Gaussian kernel is influenced by its model parameters, both the error penalty parameter and the Gaussian kernel parameter. After researching the characteristics and properties of the parameter simultaneous variation of support vector machines with Gaussian kernel by the parameter analysis table, a new area distribution model is proposed, which consists of optimal straight line, reference point of area boundary, optimal area, transition area, underfitting area, and overfitting area. In order to improve classification performance of support vector machines, a genetic algorithm based on change area search is proposed. Comparison experiments show that the test accuracy of the genetic algorithm based on change area search is better than that of the two-linear search method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Hsu C-W, Chang C-C, Lin C-J (2003) A practical guide to support vector classification. http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf
Keerthi SS, Lin C-J (2003) Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Comput 15(7):1667–1689
Ding S, Liu X (2009) Evolutionary computing optimization for parameter determination and feature selection of support vector machines. In: Proceedings of the CISE 2009 on computational intelligence and software engineering, Wuhan, China, 1–5
Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31(2):231–240
Lin S-W, Ying K-C, Chen S-C, Lee Z-J (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35:1817–1824
Ren Y, Bai G (2010) Determination of optimal SVM parameters by using GA/PSO. J Comput 5(8):1160–1168
Huang H-L, Chang F-L (2007) ESVM: evolutionary support machine for automatic feature selection and classification of microarray data. Biosystems 90:516–528
Li S, Wu X, Hu X (2008) Gene selection using genetic algorithm and support vectors machines. Soft Comput 12:693–698
Debnath R, Kurita T (2010) An evolutionary approach for gene selection and classification of microarray data based on SVM error-bound theories. Biosystems 100(1):39–46
Vapnik V (1998) Statistical learning theory. Wiley, New York
Rätsch G (1999) Benchmark data sets. http://ida.first.gmd.de/~raetsch/data/benchmarks.htm
Murphy PM, Aha DW (1994) UCI repository of machine learning database. http://www.ics.uci.edu/~mlearn/MLRepository.html
Chang C-C, Lin C-J (2001) LIBSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm
Chapelle O, Vapnik V, Bousquet O, Mukherjee S (2002) Choosing multiple parameters for support vector machines. Mach Learn 46:131–158
Keerthi SS (2002) Efficient tuning or SVM hyperparameters using radius/margin bound and iterative algorithm. IEEE Trans Neural Netw 13(5):1225–1229
Acknowledgments
The work was supported partially by the National Science Foundation (NSF) of China under the contract number 60702075, and the Doctoral Research Foundation of the Ministry of Education of China under the contract number 20090185120009, and the Fundamental Research Funds for the Central Universities under Grant No. ZYGX2009J057.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhao, M., Ren, J., Ji, L. et al. Parameter selection of support vector machines and genetic algorithm based on change area search. Neural Comput & Applic 21, 1–8 (2012). https://doi.org/10.1007/s00521-011-0603-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-011-0603-9