Abstract
Maximum entropy discrimination (MED) is already shown to be effective for discriminative classification and regression, and can be applied to multitask learning (MTL) with some further assumptions. Self-training is a commonly used technique for semi-supervised learning. In order to integrate the merits offered by semi-supervised learning and MTL, this paper presents semi-supervised MTL via self-training and MED. We select the suitable measure metric and identify how to use unlabeled data. Experimental results on two UCI data sets demonstrate that our method yields better performance than semi-supervised single-task learning (STL) and supervised MTL.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jaakkola, T., Meila, M., Jebara, T.: Maximum Entropy Discrimination. In: Proceedings of Advances in Neural Information Processing Systems (1999)
Jebara, T.: Multitask Sparsity via Maximum Entropy Discrimination. Journal of Machine Learning Research, 75–110 (2011)
Caruana, R.: Multitask Learning. Machine Learning, 41–75 (1999)
Xue, Y., Liao, X., Carin, L., Krishnapuram, B.: Multi-task Learning for Classification with Dirichlet Process Priors. Journal of Machine Learning Research, 35–63 (2007)
Chapelle, O., Schlkopf, B., Zien, A.: Semi-supervised Learning. MIT Press (2006)
Sun, S.: Multi-view Laplacian Support Vector Machines. In: Tang, J., King, I., Chen, L., Wang, J. (eds.) ADMA 2011, Part II. LNCS, vol. 7121, pp. 209–222. Springer, Heidelberg (2011)
Liu, Q., Liao, X., Carin, L.: Semi-supervised Multi-task Learning. In: Proceedings of Advances in Neural Information Processing Systems (2007)
McClosky, D., Charniak, E., Johnson, M.: Effective Self-training for Parsing. In: Proceedings of the Human Language Technology Conference of the North American Chapter of the ACL, pp. 152–159 (2006)
Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised Self-training of Object Detection Models. In: Proceedings of Seventh IEEE Workshop on Applications of Computer Vision, pp. 29–36 (2005)
Sun, S.: Active Learning with Extremely Sparse Labeled Examples. Neurocomputing, 2980–2988 (2010)
Zhang, Q., Sun, S.: Multiple-view Multiple-learner Active Learning. Pattern Recognition, 3113–3119 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chao, G., Sun, S. (2012). Semi-supervised Multitask Learning via Self-training and Maximum Entropy Discrimination. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7665. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34487-9_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-34487-9_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34486-2
Online ISBN: 978-3-642-34487-9
eBook Packages: Computer ScienceComputer Science (R0)