Abstract
The One-Class Support Vector Machine (OC-SVM) is an unsupervised learning algorithm, identifying unusual or outlying points (outliers) from a given dataset. In OC-SVM, it is required to set the regularization hyperparameter and kernel hyperparameter in order to obtain a good estimate. Generally, cross-validation is often used which requires multiple runs with different hyperparameters, making it very slow. Recently, the solution path algorithm becomes popular. It can obtain every solution for all hyperparameters in a single run rather than re-solve the optimization problem multiple times. Generalizing from previous algorithms for solution path in SVMs, this paper proposes a complete set of solution path algorithms for OC-SVM, including a ν-path algorithm and a kernel-path algorithm. In the kernel-path algorithm, a new method is proposed to avoid the failure of algorithm due to indefinite matrix . Using those algorithms, we can obtain the optimum hyperparameters by computing an entire path solution with the computational cost O(n 2 + cnm 3) on ν-path algorithm or O(cn 3 + cnm 3) on kernel-path algorithm (c: constant, n: the number of sample, m: the number of sample which on the margin).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)
Tax, D.M.J., Duin, R.P.W.: Support Vector Domain Description. Pattern Recognition Letters 20, 1191–1199 (1999)
Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J., Williamson, R.C.: Estimating the Support of a High-demensional Distribution. Neural Computation 13, 1443–1472 (2001)
Platt, J.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.) Advances in Kernel Methods - Support Vector Learning, pp. 185–208. MIT Press, Cambridge (1999)
Chang, C.C., Lin, C.J.: LIBSVM: a Library for Support Vector Machines (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm
Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least Angle Regression. Annals of Statistics 32, 407–499 (2004)
Rosset, S., Zhu, J.: Piecewise Linear Regularized Solution Paths. The Annals of Statistics 35, 1012–1030 (2007)
Zhu, J., Rosset, S., Hastie, T., Tibshirani, R.: L1 Norm Support Vector Machines. In: Advances in Neural Information Processing Systems 16. MIT Press, Cambridge (2003)
Zhu, J., Rosset, S., Hastie, T., Tibshirani, R.: The Entire Regularization Path for the Support Vector Machine. Journal of Machine Learning Research 5, 1391–1415 (2004)
Gunter, L., Zhu, J.: Computing the Solution Path for the Regularized Support Vector Regression. In: Advances in Neural Information Processing Systems 18 (NIPS 2005) (2005)
Lee, G., Scott, C.D.: The One Class Support Vector Machine Solution Path. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 521–524 (2007)
Wang, G., Yeung, D.Y., Lochovsky, F.H.: A Kernel Path Algorithm for Support Vector Machines. In: Proceedings of the 24rd International Conference on Machine Learning, pp. 951–958 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, L., Li, F., Yang, Y. (2008). Path Algorithms for One-Class SVM. In: Sun, F., Zhang, J., Tan, Y., Cao, J., Yu, W. (eds) Advances in Neural Networks - ISNN 2008. ISNN 2008. Lecture Notes in Computer Science, vol 5263. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87732-5_72
Download citation
DOI: https://doi.org/10.1007/978-3-540-87732-5_72
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87731-8
Online ISBN: 978-3-540-87732-5
eBook Packages: Computer ScienceComputer Science (R0)