Skip to main content
SpringerLink
Log in

Improving context and syntactic dependency for aspect-based sentiment analysis using a fused graph attention network

  • Special Issue
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

Aspect-based sentiment analysis is a hot research issue, which aims to determine the polarity of sentiments in a particular aspect of a review. Some recent methods adopt attention-based neural networks or graph neural networks to connect aspects implicitly with opinion words, achieving better results. However, the existing methods are usually limited to one of these. Also, multiple aspects may be present in one review, and previous methods can often confuse the connections between aspects and opinions. To address these problems, we explore a method of integrating a dependency structure with a graph attention network for sentence representation learning. For this reason, we propose a Fused Graph Attention Network model, which employs a bidirectional gated recurrent unit to learn sentence representation features, and further enhances the embedding through a graph attention layer. The experimental results demonstrate that the proposed model can better establish the relationship between the aspects and opinion words in a sentence.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Liu N, Shen B (2020) Aspect-based sentiment analysis with gated alternate neural network. Knowl Based Syst 188:105010

    Article  Google Scholar 

  2. Wu P, Li X, Ling C, Ding S, Shen S (2021) Sentiment classification using attention mechanism and bidirectional long short-term memory network. Appl Soft Comput 112:107792

    Article  Google Scholar 

  3. Chen Y, Zhuang T, Guo K (2021) Memory network with hierarchical multi-head attention for aspect-based sentiment analysis. Appl Intell 51(7):4287–4304

    Article  Google Scholar 

  4. Pang S, Xue Y, Yan Z, Huang W, Feng J (2021) Dynamic and multi-channel graph convolutional networks for aspect-based sentiment analysis. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp 2627–2636

  5. Tian Y, Chen G, Song Y (2021) Aspect-based sentiment analysis with type-aware graph convolutional networks and layer ensemble. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 2910–2922

  6. Lu Q, Zhu Z, Zhang G, Kang S, Liu P (2021) Aspect-gated graph convolutional networks for aspect-based sentiment analysis. Appl Intell 51(7):4408–4419

    Article  Google Scholar 

  7. Hou X, Huang J, Wang G, Qi P, He X, Zhou B (2021) Selective attention based graph convolutional networks for aspect-level sentiment classification. In: Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-15), pp 83–93

  8. Hu Y, Shen H, Liu W, Min F, Qiao X, Jin K (2021) A graph convolutional network with multiple dependency representations for relation extraction. IEEE Access 9:81575–81587

    Article  Google Scholar 

  9. Hong Y, Liu Y, Yang S, Zhang K, Wen A, Hu J (2020) Improving graph convolutional networks based on relation-aware attention for end-to-end relation extraction. IEEE Access 8:51315–51323

    Article  Google Scholar 

  10. Yao L, Mao C, Luo Y (2019) Graph convolutional networks for text classification. In:  Proceedings of the AAAI Conference on Artificial Intelligence, vol 33, pp 7370–7377

  11. Liu Y, Guan R, Giunchiglia F, Liang Y, Feng X (2021) Deep attention diffusion graph neural networks for text classification. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp 8142–8152

  12. Jabreel M, Hassan F, Moreno A (2018) Target-dependent sentiment analysis of tweets using bidirectional gated recurrent neural networks. In: Advances in Hybridization of Intelligent Methods: Models, Systems and Applications, pp 39–55

  13. Vo DT, Zhang Y (2015) Target-dependent twitter sentiment classification with rich automatic features. In: IJCAI International Joint Conference on Artificial Intelligence, vol 2015, pp 1347–1353

  14. Lv Y, Wei F, Cao L, Peng S, Niu J, Yu S, Wang C (2021) Aspect-level sentiment analysis using context and aspect memory network. Neurocomputing 428:195–205

    Article  Google Scholar 

  15. Chen P, Sun Z, Bing L, Yang W (2017) Recurrent Attention Network on Memory for Aspect Sentiment Analysis. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2017, pp 452–461

  16. Cho K, Merrienboer Bv, Gülçehre Ç, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014, pp 1724–1734

  17. Zhao M, Yang J, Zhang J, Wang S (2022) Aggregated graph convolutional networks for aspect-based sentiment classification. Inf Sci 600:73–93

    Article  Google Scholar 

  18. Lu G, Li J, Wei J (2022) Aspect sentiment analysis with heterogeneous graph neural networks. Inf Process Manag 59:102953

    Article  Google Scholar 

  19. Phan HT, Nguyen NT, Hwang D (2022) Convolutional attention neural network over graph structures for improving the performance of aspect-level sentiment analysis. Inf Sci 589:416–439

    Article  Google Scholar 

  20. Zhang Z, Zhou Z, Wang Y (2022) SSEGCN: syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis. In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 4916–4925

  21. Xiao L, Xue Y, Wang H, Hu X, Gu D, Zhu Y (2022) Exploring fine-grained syntactic information for aspect-based sentiment classification with dual graph neural networks. Neurocomputing 471:48–59

    Article  Google Scholar 

  22. Dai A, Hu X, Nie J, Chen J (2022) Learning from word semantics to sentence syntax by graph convolutional networks for aspect-based sentiment analysis. Int J Data Sci Anal 14:17–26

    Article  Google Scholar 

  23. Liang S, Wei W, Mao X, Wang F, He Z (2022) BiSyn-GAT+: bi-syntax aware graph attention network for aspect-based sentiment analysis. In: Findings of the Association for Computational Linguistics: ACL 2022, pp 1835–1848

  24. Wu H, Zhang Z, Shi S, Wu Q, Song H (2022) Phrase dependency relational graph attention network for aspect-based sentiment analysis. Knowl Based Syst 236:107736

    Article  Google Scholar 

  25. Misra D (2020) Mish: a self regularized non-monotonic activation function. In: 31st British Machine Vision Conference 2020

  26. Glorot X, Bordes A, Bengio Y (2011) Deep sparse rectifier neural networks. J Mach Learn Res 15:315–323

    Google Scholar 

  27. Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) SemEval-2014 Task 4: Aspect Based Sentiment Analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation, pp 27–35

  28. Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol 2, pp 49–54

  29. Jiang Q, Chen L, Xu R, Ao X, Yang M (2019) A challenge dataset and effective models for aspect-based sentiment analysis. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, pp 6279–6284

  30. Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014, pp 1532–1543

  31. Dozat T, Manning CD (2017) Deep biaffine attention for neural dependency parsing. In:  5th International Conference on Learning Representations

  32. Sun K, Zhang R, Mensah S, Mao Y, Liu X (2019) Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, pp 5678–5687

  33. Liu L, Jiang H, He P, Chen W, Liu X, Gao J, Han J (2020) On the variance of the adaptive learning rate and beyond. In: 8th International Conference on Learning Representations

  34. Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp 4068–4074

  35. Li X, Bing L, Lam W, Shi B (2018) Transformation networks for target-oriented sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 946–956

  36. Song Y, Wang J, Jiang T, Liu Z, Rao Y (2019) Targeted sentiment classification with attentional encoder network. In: Artificial Neural Networks and Machine Learning: Text and Time Series—28th International Conference on Artificial Neural Networks, pp 93–103

  37. Huang B, Ou Y, Carley KM (2018) Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 10899 LNCS, pp 197–206

  38. Yuan L, Wang J, Yu L-C, Zhang X (2020) Graph Attention Network with Memory Fusion for Aspect-level Sentiment Analysis. In: Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pp 27–36

  39. Zhang C, Li Q, Song D (2019) Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, pp 4567–4577

  40. Wang K, Shen W, Yang Y, Quan X, Wang R (2020) Relational graph attention network for aspect-based sentiment analysis. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 3229–3238

  41. Xiao Y, Zhou G (2020) Syntactic edge-enhanced graph convolutional networks for aspect-level sentiment classification with interactive attention. IEEE Access 8:157068–157080

    Article  Google Scholar 

  42. Bai X, Liu P, Zhang Y (2021) Investigating typed syntactic dependencies for targeted sentiment classification using graph attention neural network. In: IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021, vol 29, pp 503–514

  43. Vo TD, Zhang Y (2015) Target-dependent twitter sentiment classification with rich automatic features. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp 1347–1353

  44. Xing X, Yang F, Li H, Zhang J, Zhao Y, Gao M, Huang J, Yao J (2021) An interpretable multi-level enhanced graph attention network for disease diagnosis with gene expression data. In: IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2021, pp 556–561

  45. Liu Z, Zhou D, He J (2019) Towards explainable representation of time-evolving graphs via spatial-temporal graph attention networks. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp 2137–2140

  46. Shimizu R, Matsutani M, Goto M (2022) An explainable recommendation framework based on an improved knowledge graph attention network with massive volumes of side information. Knowl Based Syst 239:107970

    Article  Google Scholar 

  47. Ribeiro MT, Singh S, Guestrin C (2016) ‘Why should I trust you?’: explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 1135–1144

Download references

Author information

Authors and Affiliations

  1. School of Accounting, Shandong Management University, Jinan, 250357, China

    Peipei Wang

  2. School of Information Science and Electrical Engineering, Shandong Jiaotong University, Jinan, 250357, China

    Zhen Zhao

Authors
  1. Peipei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhen Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Zhao.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, P., Zhao, Z. Improving context and syntactic dependency for aspect-based sentiment analysis using a fused graph attention network. Evol. Intel. 17, 589–598 (2024). https://doi.org/10.1007/s12065-023-00845-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-023-00845-z

Keywords

Search

Navigation