Abstract
Support vector machine (SVM) is a general and powerful learning machine, which adopts supervised manner. However, for many practical machine learning and data mining applications, unlabeled training examples are readily available but labeled ones are very expensive to be obtained. Therefore, semi-supervised learning emerges as the times require. At present, the combination of SVM and semi-supervised learning principle such as transductive learning has attracted more and more attentions. Transductive support vector machine (TSVM) learns a large margin hyperplane classifier using labeled training data, but simultaneously force this hyperplane to be far away from the unlabeled data. TSVM might seem to be the perfect semi-supervised algorithm since it combines the powerful regularization of SVMs and a direct implementation of the clustering assumption, nevertheless its objective function is non-convex and then it is difficult to be optimized. This paper aims to solve this difficult problem. We apply least square support vector machine to implement TSVM, which can ensure that the objective function is convex and the optimization solution can then be easily found by solving a set of linear equations. Simulation results demonstrate that the proposed method can exploit unlabeled data to yield good performance effectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Amini M, Gallinari P (2003) Semi-supervised learning with an explicit label-error model for misclassified data. IJCAI2003
Balcan M, Blum A, Choi P, Lafferty J, Pantano B, Rwebangira M, Zhu X (2005) Person identification in webcam images: an application of semi-supervised learning. In: ICML workshop on learning with partially classified training data, Bonn
Baluja S (1998) Probabilistic modeling for face orientation discrimination: learning from labeled and unlabeled data. Neural Information Processing Systems (NIPS). MIT Press, Cambridge
Bennett K, Demiriz A (1998) Semi-supervised support vector machines. In: Advances in neural information processing systems 12, pp 368–374
Bie TD, Cristianini N (2003) Convex methods for transduction. In: Thrun S, Saul LK, Schölkopf B (eds) NIPS. MIT Press
Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th annual conference on computational learning theory
Chapelle O, Zien A (2005) Semi-supervised classification by low density separation. In: Proceedings of the 10th international workshop on artificial intelligence and statistics (AISTATS 2005), Barbados, vol 01, pp 57–64
Chapelle O, Chi M, Zien A (2006) A continuation method for semi-supervised svms. In: Cohen WW, Moore A (eds) ICML. ACM, pp 185–192
Chapelle O, Sindhwani V, Keerthi S (2007) Branch and bound for semi-supervised support vector machines. In: Schölkopf B, Platt J, Hoffman T (eds) Advances in neural information processing systems 19. MIT Press, Cambridge
Collobert R, Sinz FH, Weston J, Bottou L (2006) Large scale transductive svms. J Mach Learn Res 7: 1687–1712
Fung G, Mangasarian O (2001) Semi-supervised support vector machines for unlabeled data classification. Optim Methods Softw 15: 29–44
Joachims T (1999) Transductive inference for text classification using support vector machines. In: Bratko I, Dzeroski S (eds) Proceedings of ICML-99, 16th international conference on machine learning, Bled, SL. Morgan Kaufmann Publishers, San Francisco, pp 200–209
Joachims T (1999) Transductive inference for text classification using support vector machines. ICML1999, pp 200–209
Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifier. Neural Process Lett 9: 293–300
Sindhwani V, Keerthi SS, Chapelle O (2006) Deterministic annealing for semi-supervised kernel machines. In: Cohen WW, Moore A (eds) Proceedings of the 23rd international conference on machine learning. ACM, pp 841–848
Vapnik V (1998) Statistical learning theory. Wiley, New York
Xu L, Schuurmans D (2005) Unsupervised and semisupervised multi-class support vector machines. In: Veloso MM, Kambhampati S (eds) AAAI. AAAI Press/The MIT Press, pp 904–910
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, R., Wang, W., Ma, Y. et al. Least Square Transduction Support Vector Machine. Neural Process Lett 29, 133–142 (2009). https://doi.org/10.1007/s11063-009-9099-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-009-9099-z