Skip to main content

Advertisement

Springer Nature Link
Log in

Dynamic position weighting aspect-focused graph convolutional network for aspect-based sentiment analysis

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Aspect-based sentiment analysis (ABSA) is a fine-grained sentiment analysis task that analyzes the affective attitudes of specific aspects of a review. Recent studies have focused on using graph convolutional networks and attention mechanisms for ABSA; however, most of the existing works fail to flexibly consider the internal distance relationships between aspects and contexts when constructing dependency graphs, and their models do not pay sufficient attention to the aspects in the feature extraction process after performing graph convolution. In this paper, we propose a dynamic position weighting aspect-focused graph convolutional network (DPWAFGCN-BERT) to address the above problems. Specifically, we combine the relative distance and dependency distance measures to weight the original dependency graph and utilize dynamic coefficients to control the influence strengths of different distance types to achieve enhanced aspect sentiment feature aggregation. Furthermore, after implementing graph convolution, we design an aspect-focused attention fusion module, which includes both a retrieval-based multihead attention mechanism and an aspect-oriented multihead attention mechanism, to learn contextual sentiment features based on aspects from different feature subspaces. We conduct experiments on four public datasets, and the experimental results demonstrate the excellent performance of our proposed model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Li J, Hovy E (2017) Reflections on sentiment/opinion analysis. Springer International Publishing, Cham, pp 41–59. https://doi.org/10.1007/978-3-319-55394-8_3

  2. Ibrahim M, Bajwa IS, Ul-Amin R et al (2019) A neural network-inspired approach for improved and true movie recommendations. Computational Intelligence and Neuroscience. https://doi.org/10.1155/2019/4589060

  3. Li W, Shao W, Ji S et al (2022) Bieru: bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467:73–82. https://doi.org/10.1016/j.neucom.2021.09.057

  4. Song Y, Wang J, Jiang T, et al (2019) Targeted sentiment classification with attentional encoder network. Springer International Publishing, pp 93–103. https://doi.org/10.1007/978-3-030-30490-4_9

  5. Majumder N, Poria S, Peng H et al (2019) Sentiment and sarcasm classification with multitask learning. IEEE Intelligent Systems 34(3):38–43. https://doi.org/10.1109/MIS.2019.2904691

    Article  MATH  Google Scholar 

  6. Mao R, Li X (2021) Bridging towers of multi-task learning with a gating mechanism for aspect-based sentiment analysis and sequential metaphor identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp 13534–13542, https://doi.org/10.1609/aaai.v35i15.17596

  7. Majumder N, Poria S, Gelbukh A, et al (2018) Iarm: Inter-aspect relation modeling with memory networks in aspect-based sentiment analysis. In: Proceedings of the 2018 Conference on Empirical Methods in natural Language Processing, pp 3402–3411, https://doi.org/10.18653/v1/D18-1377

  8. Xue W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 2514–2523, https://doi.org/10.18653/v1/P18-1234

  9. Ma D, Li S, Zhang X, et al (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp 4068–4074, https://doi.org/10.5555/3171837.3171854

  10. Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: Social, Cultural, and Behavioral Modeling: 11th International Conference, SBP-BRiMS 2018, Washington, DC, USA, July 10-13, 2018, Proceedings 11, Springer, pp 197–206, https://doi.org/10.1007/978-3-319-93372-6_22

  11. Fan F, Feng Y, Zhao D (2018) Multi-grained attention network for aspect-level sentiment classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 3433–3442, https://doi.org/10.18653/v1/D18-1380

  12. Jiang N, Tian F, Li J et al (2020) Man: mutual attention neural networks model for aspect-level sentiment classification in siot. IEEE Internet of Things Journal 7(4):2901–2913. https://doi.org/10.1109/JIOT.2020.2963927

    Article  MATH  Google Scholar 

  13. Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations, https://doi.org/10.48550/arXiv.1609.02907

  14. Zhang C, Li Q, Song D (2019) Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp 4568–4578, https://doi.org/10.18653/v1/D19-1464

  15. Lu Q, Zhu Z, Zhang G et al (2021) Aspect-gated graph convolutional networks for aspect-based sentiment analysis. Applied Intelligence 51(7):4408–4419. https://doi.org/10.1007/s10489-020-02095-3

    Article  MATH  Google Scholar 

  16. Tian Y, Chen G, Song Y (2021) Aspect-based sentiment analysis with type-aware graph convolutional networks and layer ensemble. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 2910–2922, https://doi.org/10.18653/v1/2021.naacl-main.231

  17. Zhang K, Liu Q, Qian H et al (2021) Eatn: an efficient adaptive transfer network for aspect-level sentiment analysis. IEEE Transactions on Knowledge and Data Engineering 35(1):377–389. https://doi.org/10.1109/TKDE.2021.3075238

    Article  MATH  Google Scholar 

  18. Huang B, Zhang J, Ju J et al (2023) Crf-gcn: an effective syntactic dependency model for aspect-level sentiment analysis. Knowledge-Based Systems 260:110125. https://doi.org/10.1016/j.knosys.2022.110125

    Article  MATH  Google Scholar 

  19. Liang B, Su H, Gui L et al (2022) Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks. Knowledge-Based Systems 235:107643. https://doi.org/10.1016/j.knosys.2021.107643

    Article  Google Scholar 

  20. Zhang Z, Ma Z, Cai S, et al (2022) Knowledge-enhanced dual-channel gcn for aspect-based sentiment analysis. Mathematics 10(22). https://doi.org/10.3390/math10224273

  21. Ma Y, Song R, Gu X et al (2023) Multiple graph convolutional networks for aspect-based sentiment analysis. Applied Intelligence 53(10):12985–12998. https://doi.org/10.1007/s10489-022-04023-z

    Article  MATH  Google Scholar 

  22. Zeng B, Yang H, Xu R et al (2019) Lcf: a local context focus mechanism for aspect-based sentiment classification. Applied Sciences 9(16):3389. https://doi.org/10.3390/app9163389

    Article  MATH  Google Scholar 

  23. Shao D, An Q, Huang K et al (2022) Aspect-level sentiment analysis for based on joint aspect and position hierarchy attention mechanism network. Journal of Intelligent & Fuzzy Systems 42(3):2207–2218. https://doi.org/10.3233/JIFS-211515

    Article  MATH  Google Scholar 

  24. Huang B, Guo R, Zhu Y et al (2022) Aspect-level sentiment analysis with aspect-specific context position information. Knowledge-Based Systems 243:108473. https://doi.org/10.1016/j.knosys.2022.108473

    Article  Google Scholar 

  25. Dong Y, Zou Q, Shi CR (2023) Augmenting aspect-level sentiment classification with distance-related local context input. The Journal of Supercomputing. 1–20. https://doi.org/10.1007/s11227-023-05108-3

  26. Wu Y, Deng G (2023) A parallel fusion graph convolutional network for aspect-level sentiment analysis. Big Data Research 32:100378. https://doi.org/10.1016/j.bdr.2023.100378

    Article  MATH  Google Scholar 

  27. Phan MH, Ogunbona PO (2020) Modelling context and syntactical features for aspect-based sentiment analysis. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 3211–3220, https://doi.org/10.18653/v1/2020.acl-main.293

  28. Zhao Z, Tang M, Tang W et al (2022) Graph convolutional network with multiple weight mechanisms for aspect-based sentiment analysis. Neurocomputing 500:124–134. https://doi.org/10.1016/j.neucom.2022.05.045

    Article  MATH  Google Scholar 

  29. Jiang B, Xu G, Liu P (2023) Aspect-level sentiment classification via location enhanced aspect-merged graph convolutional networks. The Journal of Supercomputing. 1–26. https://doi.org/10.1007/s11227-022-05002-4

  30. Zhang R, Chen Q, Zheng Y et al (2022) Aspect-level sentiment analysis via a syntax-based neural network. IEEE/ACM Transactions on Audio, Speech, and Language Processing 30:2568–2583. https://doi.org/10.1109/TASLP.2022.3190731

    Article  MATH  Google Scholar 

  31. Liu N, Hu J, Liang W (2023) Mifinn: a novel multi-information fusion and interaction neural network for aspect-based sentiment analysis. Knowledge-Based Systems 280:110983. https://doi.org/10.1016/j.knosys.2023.110983

    Article  MATH  Google Scholar 

  32. Rao D, Ravichandran D (2009) Semi-supervised polarity lexicon induction. In: Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pp 675–682, https://doi.org/10.3115/1609067.1609142

  33. Kiritchenko S, Zhu X, Cherry C, et al (2014) Nrc-canada-2014: Detecting aspects and sentiment in customer reviews. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp 437–442, https://doi.org/10.3115/v1/s14-2076

  34. Das S, Kolya AK (2017) Sense gst: Text mining & sentiment analysis of gst tweets by naive bayes algorithm. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), IEEE, pp 239–244, https://doi.org/10.1109/ICRCICN.2017.8234513

  35. Chauhan C, Sehgal S (2018) Sentiment classification for mobile reviews using knime. In: 2018 International Conference on Computing, Power and Communication Technologies (GUCON), IEEE, pp 548–553, https://doi.org/10.1109/GUCON.2018.8674946

  36. Tang D, Qin B, Feng X, et al (2016) Effective lstms for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp 3298–3307, https://doi.org/10.48550/arXiv.1512.01100

  37. Li W, Zhu L, Shi Y et al (2020) User reviews: sentiment analysis using lexicon integrated two-channel cnn-lstm family models. Applied Soft Computing 94:106435. https://doi.org/10.1016/j.asoc.2020.106435

    Article  Google Scholar 

  38. Wang X, Li F, Zhang Z et al (2021) A unified position-aware convolutional neural network for aspect based sentiment analysis. Neurocomputing 450:91–103. https://doi.org/10.1016/j.neucom.2021.03.092

    Article  MATH  Google Scholar 

  39. Devlin J, Chang MW, Lee K, et al (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, pp 4171–4186, https://doi.org/10.18653/v1/N19-1423

  40. Xu H, Liu B, Shu L, et al (2019) Bert post-training for review reading comprehension and aspect-based sentiment analysis. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 1. https://doi.org/10.18653/v1/N19-1242

  41. Kumar A, Gupta P, Balan R et al (2021) Bert based semi-supervised hybrid approach for aspect and sentiment classification. Neural Processing Letters 53:4207–4224. https://doi.org/10.1007/s11063-021-10596-6

    Article  MATH  Google Scholar 

  42. Peng Y, Xiao T, Yuan H (2022) Cooperative gating network based on a single bert encoder for aspect term sentiment analysis. Applied Intelligence 52(5):5867–5879. https://doi.org/10.1007/s10489-021-02724-5

    Article  MATH  Google Scholar 

  43. Huang L, Ma D, Li S, et al (2019) Text level graph neural network for text classification. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp 3444–3450, https://doi.org/10.18653/v1/D19-1345

  44. Zhang Y, Qi P, Manning CD (2018) Graph convolution over pruned dependency trees improves relation extraction. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 2205–2215, https://doi.org/10.18653/v1/D18-1244

  45. Li R, Chen H, Feng F, et al (2021) Dual graph convolutional networks for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp 6319–6329, https://doi.org/10.18653/v1/2021.acl-long.494

  46. Xu L, Pang X, Wu J et al (2023) Learn from structural scope: improving aspect-level sentiment analysis with hybrid graph convolutional networks. Neurocomputing 518:373–383. https://doi.org/10.1016/j.neucom.2022.10.071

    Article  MATH  Google Scholar 

  47. Gu T, Zhao H, He Z et al (2023) Integrating external knowledge into aspect-based sentiment analysis using graph neural network. Knowledge-Based Systems 259:110025. https://doi.org/10.1016/j.knosys.2022.110025

    Article  Google Scholar 

  48. Zhao Z, Tang M, Zhao F et al (2023) Incorporating semantics, syntax and knowledge for aspect based sentiment analysis. Applied Intelligence 53(12):16138–16150. https://doi.org/10.1007/s10489-022-04307-4

    Article  MATH  Google Scholar 

  49. Yan H, Yi B, Li H et al (2022) Sentiment knowledge-induced neural network for aspect-level sentiment analysis. Neural Computing and Applications 34(24):22275–22286. https://doi.org/10.1007/s00521-022-07698-0

    Article  MATH  Google Scholar 

  50. Wang P, Tao L, Tang M et al (2023) A novel adaptive marker segmentation graph convolutional network for aspect-level sentiment analysis. Knowledge-Based Systems 270:110559. https://doi.org/10.1016/j.knosys.2023.110559

    Article  MATH  Google Scholar 

  51. Wu Z, Pan S, Chen F et al (2020) A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems 32(1):4–24. https://doi.org/10.1109/TNNLS.2020.2978386

    Article  MathSciNet  MATH  Google Scholar 

  52. Pontiki M, Galanis D, Pavlopoulos I, et al (2014) Semeval 2014 Task 4: Aspect Based Sentiment Analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) at (COLING 2014), Dublin, Ireland, pp 27–35, https://doi.org/10.3115/v1/S14-2004, http://www.aclweb.org/anthology/S14-2004

  53. Pontiki M, Galanis D, Papageorgiou H, et al (2015) Semeval-2015 task 12: aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp 486–495, https://doi.org/10.18653/v1/s15-2082

  54. Pontiki M, Galanis D, Papageorgiou H, et al (2016) Semeval-2016 task 5: aspect based sentiment analysis. In: ProWorkshop on Semantic Evaluation (SemEval-2016), Association for Computational Linguistics, pp 19–30, https://doi.org/10.18653/v1/S16-1002

  55. Zhang M, Qian T (2020) Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp 3540–3549, https://doi.org/10.18653/v1/2020.emnlp-main.286

  56. Zhou J, Huang JX, Hu QV et al (2020) Sk-gcn: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Systems 205:106292. https://doi.org/10.1016/j.knosys.2020.106292

    Article  MATH  Google Scholar 

  57. Zhu X, Zhu L, Guo J et al (2021) Gl-gcn: global and local dependency guided graph convolutional networks for aspect-based sentiment classification. Expert Systems with Applications 186:115712. https://doi.org/10.1016/j.eswa.2021.115712

    Article  MATH  Google Scholar 

  58. Tang H, Ji D, Li C, et al (2020) Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 6578–6588, https://doi.org/10.18653/v1/2020.acl-main.588

  59. Yan H, Yi B, Li H et al (2022) Sentiment knowledge-induced neural network for aspect-level sentiment analysis. Expert Systems with Applications 34(24):22275–22286. https://doi.org/10.1007/s00521-022-07698-0

    Article  MATH  Google Scholar 

  60. Feng S, Wang B, Yang Z et al (2022) Aspect-based sentiment analysis with attention-assisted graph and variational sentence representation. Knowledge Based Systems 258:109975. https://doi.org/10.1016/j.knosys.2022.109975

    Article  MATH  Google Scholar 

  61. Zhang Z, Zhou Z, Wang Y (2022) Ssegcn: Syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis. In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 4916–4925, https://doi.org/10.18653/v1/2022.naacl-main.362

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (NSFC) (No.72071061), the National Key Research and Development Program of China (No.2019YFE0110300).

Author information

Authors and Affiliations

  1. School of Management, Hefei University of Technology, Tunxi Road, Hefei, 230009, Anhui, China

    Bengong Yu, Chengwei Cao & Ying Yang

  2. Key Laboratory of Process Optimization and Intelligent Decision-making, Ministry of Education, Tunxi Road, Hefei, 230009, Anhui, China

    Bengong Yu

  3. Ministry of Education Engineering Research Center for Intelligent Decision-Making and Information System Technologies, Tunxi Road, Hefei, 230009, Anhui, China

    Ying Yang

Authors
  1. Bengong Yu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Chengwei Cao
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Ying Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Bengong Yu contributed to conceptualization, methodology, formal analysis and investigation, writing—original draft preparation, writing—review and editing, funding acquisition, and supervision. Chengwei Cao contributed to methodology, investigation, data curation, and writing—original draft. Ying Yang contributed to investigation, data curation, and writing—review and editing.

Corresponding author

Correspondence to Bengong Yu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, B., Cao, C. & Yang, Y. Dynamic position weighting aspect-focused graph convolutional network for aspect-based sentiment analysis. J Supercomput 81, 341 (2025). https://doi.org/10.1007/s11227-024-06783-6

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-024-06783-6

Keywords