Abstract
Classification systems are typically domain-specific, and the performance decreases sharply when transferred from one domain to another domain. Building these systems involves annotating a large amount of data for every domain, which needs much human labor. So, a reasonable way is to utilize labeled data in one existing (or called source) domain for classification in target domain. To address this problem, we propose a two-stage algorithm for domain adaptation. At the first transition stage, we share the information between the source domain and the target domain to get some most confidently labeled documents in the target domain, and at the second transmission stage, we exploit them to label the target-domain data via following the intrinsic structure revealed by the target domain. The experimental results on sentiment data indicate that the proposed approach could improve the performance of domain adaptation dramatically.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andreevskaia, A., Bergler, S.: When Specialists and Generalists Work Together: Overcoming Domain Dependence in Sentiment Tagging. In: ACL 2008, pp. 290–298 (2008)
Aue, A., Gamon, M.: Customizing sentiment classifiers to new domains: a case study. In: RANLP 2005 (2005)
Tan, S., Wang, Y., Wu, G., Cheng, X.: A novel scheme for domain-transfer problem in the context of sentiment analysis. In: CIKM 2007, pp. 979–982 (2007)
Cui, H., Mittal, V., Datar, M.: Comparative experiments on sentiment classification for online product reviews. In: AAAI 2006, pp. 1265–1270 (2006)
Dai, W., Xue, G., Yang, Q., Yu, Y.: Transferring Naive Bayes Classifiers for Text Classification. In: AAAI 2007, pp. 540–545 (2007)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum Likelihood from Incomplete Data via the EM algorithm. Journal of the Royal Statistical Society 39(B), 1–38 (1977)
Tan, S., Cheng, X., Ghanem, M., Wang, B., Xu, H.: A Novel Refinement Approach for Text Categorization. In: CIKM 2005, pp. 469–476 (2005)
Jiang, J., Zhai, C.X.: A Two-Stage Approach to Domain Adaptation for Statistical Classifiers. In: CIKM 2007, pp. 401–410 (2007)
Luo, P., Zhuang, F., Xiong, H., Xiong, Y., He, Q.: Transfer learning from multiple source domains via consensus regularization. In: CIKM 2008, pp. 103–112 (2008)
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: EMNLP 2002, pp. 79–86 (2002)
Tan, S., Cheng, X., Wang, Y., Xu, H.: Adapting Naïve Bayes to Domain Adaptation for Sentiment Analysis. In: ECIR 2009, pp. 337–349 (2009)
Wu, Q., Tan, S., Cheng, X.: Graph Ranking for Sentiment Transfer. In: ACL 2009, pp. 317–320 (2009)
Zhou, D., Weston, J., Gretton, A., Bousquet, O., Schölkopf, B.: Ranking on data manifolds. In: NIPS 2003, pp. 169–176 (2003)
DaumeIII, H., Marcu, D.: Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research 26, 101–126 (2006)
Xing, D., Dai, W., Xue, G.-R., Yu, Y.: Bridged refinement for transfer learning. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladenič, D., Skowron, A. (eds.) PKDD 2007. LNCS (LNAI), vol. 4702, pp. 324–335. Springer, Heidelberg (2007)
Tan, S.: An Effective Refinement Strategy for KNN Text Classifier. Expert Systems With Applications 30(2), 290–298 (2006)
Lewis, D.: Representation and Learning in Information Retrieval. PhD thesis, Amherst, MA, USA (1992)
Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13, 21–27 (1967)
Quinlan, J.R.: Induction of decision trees. Machine Learning 1, 81–106 (1986)
Carrol, S.M., Dickinson, W.: Construction of Neural Nets Using Radom Transform. In: Proc. IJCNN 1989, vol. (1), pp. 607–611 (1989)
Joachims, T.: Text Categorization with Support Vector Machines: Learning with Many Relevant Features. In: ICML 1998, pp. 137–142 (1998)
Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.: Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning 39(2-3), 103–134 (2000)
Lanquillon, C.: Learning from Labeled and Unlabeled Documents: A Comparative Study on Semi-Supervised Text Classification. In: Zighed, D.A., Komorowski, J., Żytkow, J.M. (eds.) PKDD 2000. LNCS (LNAI), vol. 1910, pp. 167–194. Springer, Heidelberg (2000)
Joachims, T.: Transductive inference for text classification using support vector machines. In: ICML 1999, pp. 200–209 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wu, Q., Tan, S., Duan, M., Cheng, X. (2010). A Two-Stage Algorithm for Domain Adaptation with Application to Sentiment Transfer Problems. In: Cheng, PJ., Kan, MY., Lam, W., Nakov, P. (eds) Information Retrieval Technology. AIRS 2010. Lecture Notes in Computer Science, vol 6458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17187-1_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-17187-1_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17186-4
Online ISBN: 978-3-642-17187-1
eBook Packages: Computer ScienceComputer Science (R0)