Skip to main content
Springer Nature Link
Log in

Aspect-level sentiment classification via location enhanced aspect-merged graph convolutional networks

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Aspect-level sentiment classification (ALSC) is a fine-grained sentiment analysis task that needs to predict the sentiment polarities of the given aspect terms in the sentence. Recently, emerging research has taken syntactic dependency tree as input and used graph convolutional neural network (GCN) to process ALSC tasks. However, existing GCN-based researches only consider the syntactic connections between words, ignoring the semantic relevance within aspectual entities. To address this deficiency, we propose a graph convolutional network based on Merger aspect entities and Location-aware transformation (MLGCN). Specifically, we use a specific token to replace the aspect entity, whether single-word or multi-word. The merged syntactic dependency graph is obtained through parsing for the sentence after merging aspect words. Then, we feed the sentence into an encoder and apply a novel location-aware function designed in this paper to the encoding result to enhance the model’s attention to the opinion entities. Finally, the dependency graph and the processed sentence encoding are fed to the graph convolutional network for training. Experimental results on five benchmark datasets show that the model proposed in this paper has good performance and achieves satisfactory results, exceeding the vast majority of previous work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Availability of data and materials

The source code and preprocessing datasets used in this work are publicly available on GitHub:https://github.com/BaoSir529/MLGCN.

Notes

  1. https://github.com/BaoSir529/MLGCN

  2. In this work, we use spaCy toolkit to derive dependency tree of the sentence: https://spacy.io.

  3. We use the implementation of 1.5-entmax from https://github.com/deep-spin/entmax.

References

  1. Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 168–177

  2. Liu B (2012) Sentiment analysis and opinion mining. Synthesis lectures on human language technologies, pp 1–167

  3. Kiritchenko S, Zhu X, Cherry C, Mohammad SM (2014) Nrc-canada-2014: detecting aspects and sentiment in customer reviews. In: Proceedings of the 8th International Workshop on Semantic Evaluation, pp 437–442

  4. Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp 606–615

  5. Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c (2015) Convolutional lstm network: a machine learning approach for precipitation nowcasting. Advances in neural information processing systems

  6. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, pp 5998–6008

  7. Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp 4068–4074

  8. Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp 452–461

  9. Fan F, Feng Y, Zhao D (2018) Multi-grained attention network for aspect-level sentiment classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 3433–3442

  10. Mareček D (2016) Merged bilingual trees based on universal dependencies in machine translation. In: Proceedings of the First Conference on Machine Translation, pp 333–338

  11. Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: Proceedings of the International Conference on Web Search and Web Data Mining

  12. Tang D, Qin B, Feng X, Liu T (2016) Effective lstms for target-dependent sentiment classification. In: 26th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, pp 3298–3307

  13. Xu M, Zeng B, Yang H, Chi J, Chen J, Liu H (2022) Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification. Neurocomputing 478:49–69

    Article  Google Scholar 

  14. Peng Y, Xiao T, Yuan H (2022) Cooperative gating network based on a single BERT encoder for aspect term sentiment analysis. Appl Intell 52:5867–5879

    Article  Google Scholar 

  15. Kumar A, Gupta P, Balan R, Neti LBM, Malapati A (2021) BERT based semi-supervised hybrid approach for aspect and sentiment classification. Neural Process Lett 53:4207–4224

    Article  Google Scholar 

  16. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. CoRR abs/1609.02907

  17. Zhang C, Li Q, Song D (2019) Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 4567–4577

  18. Sun K, Zhang R, Mensah S, Mao Y, Liu X (2019) Aspect-level sentiment analysis via convolution over dependency tree. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 5679–5688

  19. Zhang M, Qian T (2020) Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp 3540–3549

  20. Chen C, Teng Z, Zhang Y (2020) Inducing target-specific latent structures for aspect sentiment classification. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp 5596–5607

  21. Liang B, Yin R, Gui L, Du J, Xu R (2020) Jointly learning aspect-focused and inter-aspect relations with graph convolutional networks for aspect sentiment analysis. In: Proceedings of the 28th International Conference on Computational Linguistics, pp 150–161

  22. Tang H, Ji D, Li C, Zhou Q (2020) Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 6578–6588

  23. Li R, Chen H, Feng F, Ma Z, Wang X, Hovy E (2021) Dual graph convolutional networks for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp 6319–6329

  24. Liang B, Su H, Gui L, Cambria E, Xu R (2022) Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks. Knowl Based Syst 235:107643

    Article  Google Scholar 

  25. Cambria E, Speer R, Havasi C, Hussain A (2010) Senticnet: a publicly available semantic resource for opinion mining. In: AAAI Fall Symposium Series

  26. Cambria E, Havasi C, Hussain A (2012) Senticnet 2: a semantic and affective resource for opinion mining and sentiment analysis. In: Twenty-Fifth International FLAIRS Conference

  27. Cambria E, Olsher D, Rajagopal D (2014) Senticnet 3: a common and common-sense knowledge base for cognition-driven sentiment analysis. In: Twenty-eighth AAAI Conference on Artificial Intelligence

  28. Cambria E, Poria S, Bajpai R, Schuller B (2016) Senticnet 4: a semantic resource for sentiment analysis based on conceptual primitives. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp 2666–2677

  29. Cambria E, Poria S, Hazarika D, Kwok K (2018) Senticnet 5: discovering conceptual primitives for sentiment analysis by means of context embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence

  30. Cambria E, Li Y, Xing FZ, Poria S, Kwok K (2020) Senticnet 6: ensemble application of symbolic and subsymbolic ai for sentiment analysis. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp 105–114

  31. Phan HT, Nguyen NT, Hwang D (2022) Convolutional attention neural network over graph structures for improving the performance of aspect-level sentiment analysis. Inf Sci 589:416–439

    Article  Google Scholar 

  32. Xiao L, Xue Y, Wang H, Hu X, Gu D, Zhu Y (2022) Exploring fine-grained syntactic information for aspect-based sentiment classification with dual graph neural networks. Neurocomputing 471:48–59

    Article  Google Scholar 

  33. Li X, Bing L, Lam W, Shi B (2018) Transformation networks for target-oriented sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp 946–956

  34. Tang D, Qin B, Liu T (2016) Aspect level sentiment classification with deep memory network. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp 214–224

  35. Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp 1532–1543

  36. Graves A (2012) Long short-term memory. In: Supervised sequence labelling with recurrent neural networks, pp 37–45

  37. Zaccarella E, Schell M, Friederici AD (2017) Reviewing the functional basis of the syntactic merge mechanism for language: a coordinate-based activation likelihood estimation meta-analysis. Neurosci Biobehav Rev 80:646–656

    Article  Google Scholar 

  38. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 7132–7141

  39. Niculae V, Martins AFT, Cardie C (2018) Towards dynamic computation graphs via sparse latent structure. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 905–911

  40. Peters B, Niculae V, Martins AFT (2019) Sparse sequence-to-sequence models. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp 1504–1519

  41. Correia GM, Niculae V, Martins AFT (2019).: Adaptively sparse transformers. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 2174–2184

  42. Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp 49–54

  43. Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) Semeval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation, pp 27–35

  44. Pontiki M, Galanis D, Papageorgiou H, Manandhar S, Androutsopoulos I (2015) Semeval-2015 task 12: aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation, pp 486–495

  45. Pontiki M, Galanis D, Papageorgiou H, Androutsopoulos I, Manandhar S, Al-Smadi M, Al-Ayyoub M, Zhao Y, Qin B, De Clercq O, et al (2016) Semeval-2016 task 5: aspect based sentiment analysis. In: International Workshop on Semantic Evaluation, pp 19–30

  46. Wang K, Shen W, Yang Y, Quan X, Wang R (2020) Relational graph attention network for aspect-based sentiment analysis. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 3229–3238

Download references

Funding

Key R & D project of Shandong Province, 2019JZZY010129. Shandong Provincial Social Science Planning Project under Award, 19BJCJ51. Shandong Provincial Social Science Planning Project under Award, 18CXWJ01. Shandong Provincial Social Science Planning Project under Award, 18BJYJ04

Author information

Author notes

  1. Guangtao Xu and Peiyu Liu have contributed equally to this work.

Authors and Affiliations

  1. School of Information Science and Engineering, Shandong Normal University, Jinan, 250300, China

    Baoxing Jiang, Guangtao Xu & Peiyu Liu

Authors
  1. Baoxing Jiang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Guangtao Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Peiyu Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Jiang Baoxing wrote the main manuscript text and Xu Guangtao prepared figures. All authors reviewed the manuscript.

Corresponding author

Correspondence to Peiyu Liu.

Ethics declarations

Conflict of interest

I declare that the authors have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.

Ethical approval

Ethical approval is not required for this work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, B., Xu, G. & Liu, P. Aspect-level sentiment classification via location enhanced aspect-merged graph convolutional networks. J Supercomput 79, 9666–9691 (2023). https://doi.org/10.1007/s11227-022-05002-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-05002-4

Keywords