Skip to main content
SpringerLink
Log in

Cross lingual opinion holder extraction based on multi-kernel SVMs and transfer learning

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Fine grained opinion analysis has much higher demand for annotated corpus which makes high quality analysis difficult when there are insufficient resources. In this paper we explore the use of cross lingual resources for opinion mining for resource poor languages. This paper presents a novel approach for cross lingual opinion holder extraction through leveraging finely annotated opinion corpus selectively from a source language as the supplementary training samples for the target language. Firstly, the opinion corpus in the source language with fine grained annotations are translated and projected to the target language to generate the training samples. Then, a classifier based on multi-kernel Support Vector Machines (SVMs) is developed to identify opinion holders in the target language, which uses a tree kernel based on syntactic features and a polynomial kernel based on semantic features, respectively. The two kernels are further improved by incorporating a pivot function based on word pair similarity. To reduce the noise of low quality translated samples, a Transfer learning algorithm is applied to select high quality translated samples iteratively for training the multi-kernel classifiers on the target language. Evaluations on transferring MPQA, an English opinion corpus (as the source language), to Chinese opinion analysis (as the target language) show that the opinion holder extraction performance on NTCIR-7 MOAT dataset is improved, which is higher than the Conditional Random Fields (CRFs) based approach and most reported systems in NTCIR-7 MOAT evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Choi, Y., Cardir, C., Riloff, E., Patwardhan, S.: Identifying sources of opinions with conditional random fields and extraction patterns. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP), pp. 355–362. Vancouver, October 2005

  2. Choi, Y., Breck, E., Cardie, C.: Joint extraction of entities and relations for opinion recognition. In: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP 2006), pp. 431–439. Sydney, July 2006

  3. Choi, Y., Breck, E., Cardie, C.: Hierarchical sequential learning for extracting opinions and their attributes. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 269-274. Uppsala, Sweden, 11-16 July 2010

  4. Collins, M., Duffy, N.: New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 263–270. Philadelphia, July 2002

  5. Cortes, C., Vapnik, V.: Support – vector networks. Mach. Learn. 20, 273–297 (1995)

    MATH  Google Scholar 

  6. Johansson, R., Moschitti, A.: Syntactic and semantic structure for opinion expression detection. In: Proceedings of the Fourteenth Conference on Computational Natural Language Learning, pp. 67–76. Uppsala, Sweden, 15–16 July 2010

  7. Kim, S., Jeong, M., Lee, J., Lee, G.G.: A cross-lingual annotation projection approach for relation detection. In: Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pp. 564–571. Beijing, August 2010

  8. Kim, S., Hovy, E.: Extracting opinions, opinion holders, and topics expressed in online news media text. In Proceedings of the ACL Workshop on Sentiment and Subjectivity, pp. 1-8. Sydney, July 2006

  9. Lu, B., Tan, C., Cardie, C., Tsou, B.K.: Joint bilingual sentiment classification with unlabeled parallel corpora. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pp. 320–330. Portland, Oregon, 19–24 June 2011

  10. Meng, X., Wang, H.: Detecting opinionated sentences by extracting context information. In: Proceedings of NTCIR-7 Workshop Meeting, Tokyo, Japan, 16–19 Decebmer 2008

  11. Moschitti, A., Pighin, D., Roberto Basili: Tree kernel engineering for proposition re-ranking. In: Proceedings of Mining and Learning with Graphs (MLG 2006). Workshop held with ECML/PKDD 2006, Berlin, Germany (2006)

  12. Moschitti: A study on convolution kernels for shallow semantic parsing. In: Proceedings of the 42-th Conference on Association for Computational Linguistic (ACL-2004), Barcelona, Spain (2004)

  13. Seki, Y., Evans, D.K., Ku, L.-W., Sun, L., Chen, H.-H., Kando, N.: Overview of multilingual opinion analysis task at NTCIR-7. In: Proceedings of NTCIR-7 Workshop Meeting, Tokyo, Japan, 16–19 Decebmer 2008

  14. Wei, B., Pal, C.: Cross lingual adaptation: An experiment on sentiment classifications. In: Proceedings of the ACL 2010 Conference Short Papers, pp. 258–262, Uppsala, Sweden, 11–16 July 2010

  15. Wiegand, M., Klakow, D.: Convolution kernels for opinion holder extraction. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the ACL, pp. 795–803. Los Angeles, California, June 2010

  16. Xu, R., Wong, K.-F.: Coarse-fine opinion mining – WIA in NTCIR-7 MOAT Task. In: Proceedings of NTCIR-7 Workshop Meeting, 16–19 Decebmer 2008 Tokyo, Japan

  17. Xu, J., Xu, R., Ding, Y., Wang, X.: Cross lingual opinion analysis via transfer learning. In: Australian Journal of Intelligent Information Processing Systems, Vol 11, No 2. Computational Neuroscience and Cognitive Science (2010)

  18. Zhang, C., Wang, K., Zhu, M., Xiao, T., Zhu, J.: NEUOM: Identifying opinionated sentences in Chinese and English text. In: Proceedings of NTCIR-7 Workshop Meeting, Tokyo, Japan, 16–19 Decebmer 2008

  19. Zirn Cäcilia, Niepert, M., Stuckenschmidt, H., Strube, M.: Fine-grained sentiment analysis with structural features. In: Proceedings of 5th International Joint Conference on Natural Language Processing, pp. 336–344 (2011)

Download references

Author information

Authors and Affiliations

  1. Key Laboratory of Network Oriented Intelligent Computation, Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen, China

    Ruifeng Xu, Lin Gui & Jun Xu

  2. Department of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong

    Qin Lu

  3. Department of System Engineering and Engineering Management, The Chinese University of Hong Kong, New Territories, Hong Kong

    Kam-Fai Wong

Authors
  1. Ruifeng Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Gui
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qin Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kam-Fai Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Xu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xu, R., Gui, L., Xu, J. et al. Cross lingual opinion holder extraction based on multi-kernel SVMs and transfer learning. World Wide Web 18, 299–316 (2015). https://doi.org/10.1007/s11280-013-0246-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-013-0246-0

Keywords

Search

Navigation