Abstract
In twin support vector machines (TWSVMs), we determine pair of non-parallel planes by solving two related SVM-type problems, each of which is smaller than the one in a conventional SVM. However, similar to other classification methods, the performance of the TWSVM classifier depends on the choice of the kernel. In this paper we treat the kernel selection problem for TWSVM as an optimization problem over the convex set of finitely many basic kernels, and formulate the same as an iterative alternating optimization problem. The efficacy of the proposed classification algorithm is demonstrated with some UCI machine learning benchmark datasets.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bach, F., Lanckriet, G., Jordan, M.: Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the 21th International Conference on Machine Learning (ICML). ACM, New York (2004)
Bennett, K., Momma, M., Embrechts, J.: MARK: A boosting algorithm for heterogeneous kernel models. In: Proceedings of the Eighth SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York (2002)
Bezdek J.C., Hathaway R.J.: Convergence of alternating optimization. Neural Parallel Sci. Comput. 11(4), 351–368 (2003)
Blake, C.L., Merz, C.J.: UCI Repository for Machine Learning databases. University of California, Department of Information and Computer Sciences, Irvine, CA, 1998. On-line at http://www.ics.uci.edu/~mlearn/MLRepository.html
Burges C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discovery 2(2), 121–167 (1998)
Cortes C., Vapnik V.N.: Support vector networks. Mach. Learn. 20, 273–297 (1995)
Duda R.O., Hart P.R., Stork D.G.: Pattern Classification, 2nd edn. Wiley, New York (2002)
Fung, G., Dundar, M., Bi, J., Rao, B.: A fast iterative algorithm for Fisher discriminant using heterogeneous kernels. In: Proceedings of the 21th International Conference on Machine Learning (ICML). ACM, New York (2004)
Fung, G., Mangasarian, O.L.: Proximal Support Vector Machines. In: Proceedings of KDD-2001, San Francisco, pp. 77–86 (2001)
Guarracino M.R., Cifarelli C., Seref O., Pardalos P.M.: A classification method based on generalized eigenvalue problems. Optim. Methods Softw. 22(1), 73–81 (2007)
Hamers, B., Suykens, J., Leemans, V., Moor, B.D.: Ensemble learning of coupled parameterized kernel models. In: International Conference on Neural Information Processing, pp. 130–133 (2003)
Jayadeva, Khemchandani R., Chandra S.: Twin Support Vector Machines for Pattern Classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–911 (2007)
Lanckriet G.R.G., Cristianini N., Bartlett P., Ghaoui L.El., Jordan M.I.: Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5, 27–72 (2004)
Mangasarian O.L.: Nonlinear Programming. SIAM, Philadelphia (1994)
Mangasarian O.L., Wild E.W.: Multisurface Proximal Support Vector Classification via Generalized Eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 69–74 (2006)
Mika S., Rätsch G., Müller K.: A mathematical programming approach to the kernel Fisher algorithm. Adv. Neural Inf. Process. Syst. 13, 591–597 (2001)
Saunders, C., Gammerman, A., Vovk, V.: Ridge regression learning algorithm in dual variables” In: ICML ’98, Proceedings of the 15th International Conference on Machine Learning, Madison, WI, pp. 515–521 (1998). http://citeseer.csail.mit.edu/saunders98ridge.html
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Khemchandani, R., Jayadeva & Chandra, S. Optimal kernel selection in twin support vector machines. Optim Lett 3, 77–88 (2009). https://doi.org/10.1007/s11590-008-0092-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-008-0092-7