Skip to main content
Springer Nature Link
Log in

Aspect-based sentiment analysis with enhanced aspect-sensitive word embeddings

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Aspect term sentiment classification (ATSC) aims at identifying sentiment polarities towards some aspect terms described in a text. One of the challenges in the ATSC is that the same word may express different sentiment polarities for distinct aspects. For instance, if the word “high” is used to describe the quality of a product, this word is most likely used to express a positive opinion towards the product. However, if the aspect term is about the price of the product, the same word “high” is quite likely used to represent a negative sentiment polarity. Such aspect-sensitive word features are also useful for the ATSC when the comparative forms are used to express opinions. What sentiment or opinion is expressed largely depends on who we compare with and how we compare. We describe a weakly supervised method to create an aspect-sensitive lexicon for each aspect, which is a relatively accurate representation of the sentiments that are related to that aspect. We also propose a sentiment analysis model enhanced with the learned aspect-sensitive word embeddings, and extensive experiments show that this model achieved state-of-the-art performances on multiple datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Bao L, Lambert P, Badia T (2019) Attention and lexicon regularized LSTM for aspect-based sentiment analysis. In: Proceedings of the 57th annual meeting of the association for computational linguistics: student research workshop, pp. 253–259

  2. Baroni M, Dinu G, Kruszewski G (2014) Don’t count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, volume 1: long papers, pp 238–247

  3. Cambria E, Schuller B, Xia Y et al (2013) New avenues in opinion mining and sentiment analysis. IEEE Intell Syst 28(2):15–21

    Article  Google Scholar 

  4. Chen P, Sun Z, Bing L, et al (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461

  5. Chen Z, Qian T (2019) Transfer capsule network for aspect level sentiment classification. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 547–556

  6. Do BT (2018) Aspect-based sentiment analysis using bitmask bidirectional long short term memory networks. In: The thirty-first international flairs conference

  7. Dong L, Wei F , Tan C, et al (2014) Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, volume 2: short papers, pp 49–54

  8. Fan F, Feng Y, Zhao D (2018) Multi-grained attention network for aspect-level sentiment classification. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3433–3442

  9. Gu S, Zhang L, Hou Y, et al (2018) A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of the 27th international conference on computational linguistics, pp 774–784

  10. He R, Lee WS, Ng HT et al (2018) Exploiting document knowledge for aspect-level sentiment classification. arXiv preprint arXiv:1806.04346

  11. He R, Lee WS, Ng HT, et al (2019) An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. arXiv preprint arXiv:1906.06906

  12. Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: International conference on social computing, behavioral-cultural modeling and prediction and behavior representation in modeling and simulation. Springer, Cham, pp 197–206

  13. Jiang L, Yu M, Zhou M, et al (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pp 151–160

  14. Kiritchenko S, Zhu X, Cherry C, et al (2014) Nrc-canada-2014: detecting aspects and sentiment in customer reviews. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), pp 437–442

  15. Li F, Wang S, Liu S, et al (2014) Suit: a supervised user-item based topic model for sentiment analysis. In: Twenty-eighth AAAI conference on artificial intelligence

  16. Li L, Liu Y, Zhou A (2018) Hierarchical attention based position-aware network for aspect-level sentiment analysis. In: Proceedings of the 22nd conference on computational natural language learning, pp 181–189

  17. Li Z, Wei Y, Zhang Y, et al (2019) Exploiting coarse-to-fine task transfer for aspect-level sentiment classification. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, No 01, pp 4253–4260

  18. Ma D, Li S, Zhang X, et al (2017) Interactive attention networks for aspect-level sentiment classification. arXiv preprint arXiv:1709.00893

  19. Majumder N, Poria S, Gelbukh A, et al (2018) IARM: inter-aspect relation modeling with memory networks in aspect-based sentiment analysis. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3402–3411

  20. Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. arXiv preprint arXiv:1308.6242

  21. Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543

  22. Pontiki M, Galanis D, Papageorgiou H, et al (2015) Semeval-2015 task 12: aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp 486–495

  23. Pontiki M, Galanis D, Papageorgiou H, et al (2016) Semeval-2016 task 5: aspect based sentiment analysis. In: International workshop on semantic evaluation, pp 19–30

  24. Qian Q, Tian B, Huang M, et al (2015) Learning tag embeddings and tag-specific composition functions in recursive neural network. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, volume 1: long papers, pp 1365–1374

  25. Socher R, Pennington J, Huang EH, et al (2011) Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the 2011 conference on empirical methods in natural language processing, pp 151–161

  26. Song Y, Wang J, Jiang T, et al (2019) Attentional encoder network for targeted sentiment classification. arXiv preprint arXiv:1902.09314

  27. Tang D, Qin B, Feng X et al (2015) Effective LSTMs for target-dependent sentiment classification. arXiv preprint arXiv:1512.01100

  28. Tang D, Qin B, Liu T (2016) Aspect level sentiment classification with deep memory network. arXiv preprint arXiv:1605.08900

  29. Tang J, Lu Z, Su J, et al (2019) Progressive self-supervised attention learning for aspect-level sentiment analysis. arXiv preprint arXiv:1906.01213

  30. Tang H, Ji D, Li C, et al (2020) Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 6578–6588

  31. Toutanova K, Klein D, Manning CD, et al (2003) Feature-rich part-of-speech tagging with a cyclic dependency network. In: Proceedings of the 2003 human language technology conference of the North American chapter of the association for computational linguistics, pp 252–259

  32. Vo DT, Zhang Y (2015) Target-dependent twitter sentiment classification with rich automatic features. In: Twenty-fourth international joint conference on artificial intelligence

  33. Vo DT, Zhang Y (2016) Don’t count, predict! an automatic approach to learning sentiment lexicons for short text. In: Proceedings of the 54th annual meeting of the association for computational linguistics, vol 2, No 2, pp 219–224

  34. Wagner J, Arora P, Cortes S, et al (2014) Dcu: aspect-based polarity classification for semeval task 4

  35. Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615

  36. Wang S, Mazumder S, Liu B, et al (2018) Target-sensitive memory networks for aspect sentiment classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics, volume 1: long papers

  37. Wang K, Shen W, Yang Y, et al (2020) Relational graph attention network for aspect-based sentiment analysis. arXiv preprint arXiv:2004.12362

  38. Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 347–354

  39. Zheng S, Xia R (2018) Left-center-right separated neural network for aspect-based sentiment analysis with rotatory attention. arXiv preprint arXiv:1802.00892

Download references

Acknowledgements

The authors would like to thank the anonymous reviewers for their valuable comments. This work was partly supported by National Natural Science Foundation of China (No. 62076068), Shanghai Municipal Science and Technology Major Project (No. 2021SHZDZX0103), and Shanghai Municipal Science and Technology Project (No. 21511102800).

Author information

Authors and Affiliations

  1. School of Computer Science, Fudan University, Shanghai, 200433, China

    Yusi Qi, Xiaoqing Zheng & Xuanjing Huang

Authors
  1. Yusi Qi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Xiaoqing Zheng
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Xuanjing Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Xiaoqing Zheng.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qi, Y., Zheng, X. & Huang, X. Aspect-based sentiment analysis with enhanced aspect-sensitive word embeddings. Knowl Inf Syst 64, 1845–1861 (2022). https://doi.org/10.1007/s10115-022-01688-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-022-01688-3

Keywords