Abstract
In the past two decades, Support Vector Machine (SVM) has become one of the most famous classification techniques. The optimal parameters in an SVM kernel are normally obtained by cross validation, which is a time-consuming process. In this paper, we propose to learn the parameters in an SVM kernel while solving the dual optimization problem. The new optimization problem can be solved iteratively as follows:
(a) Fix the parameters in an SVM kernel; solve the variables α i in the dual optimization problem.
(b) Fix the variables α i; solve the parameters in an SVM kernel by using the Newton-Raphson method.
It can be shown that (a) can be optimized by using standard methods in training the SVM, while (b) can be solved iteratively by using the Newton-Raphson method. Experimental results conducted in this paper show that our proposed technique is feasible in practical pattern recognition applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Vapnik, V.N.: The nature of statistical learning. Springer, New York (1995)
Vapnik, V.N.: Statistical learning theory. Wiley, New York (1998)
Cortes, C., Vapnik, V.N.: Support vector networks. Machine Learning 20, 273–297 (1995)
Chen, G.Y., Dudek, G.: Auto-correlation wavelet support vector machine. Image and Vision Computing 27(8), 1040–1046 (2009)
Zhang, L., Zhou, W., Jiao, L.: Wavelet support vector machine. IEEE Transactions on Systems, Man, and Cybernetics - Part B 34(1), 34–39 (2004)
Chen, G.Y.: Dual-tree Complex Wavelet Support Vector Machine. International Journal of Tomography & Statistics 15(F10), 1–8 (2010)
Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. Journal of Applied and Computational Harmonic Analysis 10(3), 234–253 (2001)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(3) (2011), Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Candes, E.J.: Ridgelets and the representation of mutilated Sobolev functions. SIAM J. Math. Anal. 33(2), 2495–2509 (1999)
Do, M.N., Vetterli, M.: The contourlet transform: an efficient directional multiresolution image representation. IEEE Transactions on Image Processing 14(12), 2091–2106 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, G., Bui, T.D., Krzyzak, A., Liu, W. (2013). Support Vector Machine with Customized Kernel. In: Guo, C., Hou, ZG., Zeng, Z. (eds) Advances in Neural Networks – ISNN 2013. ISNN 2013. Lecture Notes in Computer Science, vol 7951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39065-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-39065-4_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39064-7
Online ISBN: 978-3-642-39065-4
eBook Packages: Computer ScienceComputer Science (R0)