Skip to main content

Advertisement

Springer Nature Link
Log in

A novel weight-oriented graph convolutional network for aspect-based sentiment analysis

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Aspect-based sentiment analysis (ABSA) determines the sentiment polarity of specific aspects mentioned in the review. However, some existing ABSA studies have limitations, such as the model only detecting aspect-relevant semantics when using the attention mechanism and ignoring the aspect’s long-distance dependence when introducing aspect position information. This study proposes a multiweight graph convolutional network (MWGCN) to address the above-mentioned limitations. MWGCN aims to design two weighting methods, multigrain dot-product weighting (MGDW) and the way (LCG), to create a local context weighted adjacency graph. The MGDW method retains the overall context semantics while emphasizing aspect-related features. Furthermore, the adjacency graph constructed by LCG emphasizes the importance of local context words and helps to avoid the aspect’s long-distance dependence. A multilayer graph convolutional network (GCN) is also used to extract contextual features that integrate syntactic information and capture aspect features that focus on local context words. We performed several experiments on five datasets; the experimental results verify the MWGCN generalization and further prove that with MGDW and LCG, the features extracted using GCN help improve the MWGCN effect.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Fu Y, Shi W (2018) Research on sentiment analysis of micro-blog based on enhanced supervised learning. J Intell 37(12):130–134167

    Google Scholar 

  2. Zhao J, Liu K, Xu L (2016) Sentiment analysis: Mining opinions, sentiments, and emotions. Comput Linguist 42(3):595–598. https://doi.org/10.1162/COLI_r_00259

    Article  Google Scholar 

  3. Wang Y, Zhu J, Wang Z, Gong J (2021) Review of applications of natural language processing in sentiment analysis. Journal of Computer Applications, 1–12. https://doi.org/10.11772/j.issn.1001-9081.2021071262

  4. Hameed Z, Garcia-Zapirain B (2020) Sentiment classification using a single-layered bilstm model. IEEE Access 8:73992–74001. https://doi.org/10.1109/ACCESS.2020.2988550

    Article  Google Scholar 

  5. Zhang Y, Zheng J, Jiang Y, Huang G, Chen R (2019) A text sentiment classification modeling method based on coordinated cnn-lstm-attention model. Chinese Journal of Electronics 28(2019-1-120), 120 https://doi.org/10.1049/cje.2018.11.004

  6. Pontiki M, Galanis D, Papageorgiou H, Androutsopoulos I, Manandhar S, AL-Smadi M, Al-Ayyoub M, Zhao Y, Qin B, De Clercq O, Hoste V, Apidianaki M, Tannier X, Loukachevitch N, Kotelnikov E, Bel N, Jiménez-Zafra SM, Eryiğit, G (2016) SemEval-2016 task 5: Aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pp. 19–30. Association for Computational Linguistics, San Diego, California. https://doi.org/10.18653/v1/S16-1002

  7. Kumar A, Gupta P, Balan R, Neti LBM, Malapati A (2021) Bert based semi-supervised hybrid approach for aspect and sentiment classification. Neural Process Lett 53(6):4207–4224. https://doi.org/10.1007/s11063-021-10596-6

    Article  Google Scholar 

  8. Qin H, Chen G, Tian Y, Song Y (2021) Improving federated learning for aspect-based sentiment analysis via topic memories. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 3942–3954. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic. https://doi.org/10.18653/v1/2021.emnlp-main.321

  9. Phan MH, Ogunbona PO (2020) Modelling context and syntactical features for aspect-based sentiment analysis. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3211–3220. Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.acl-main.293

  10. Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 606–615. Association for Computational Linguistics, Austin, Texas. https://doi.org/10.18653/v1/D16-1058

  11. Jiang N, Tian F, Li J, Yuan X, Zheng J (2020) Man: Mutual attention neural networks model for aspect-level sentiment classification in siot. IEEE Internet Things J 7(4):2901–2913. https://doi.org/10.1109/JIOT.2020.2963927

    Article  Google Scholar 

  12. Song Y, Wang J, Jiang T, Liu Z, Rao Y (2019) Targeted sentiment classification with attentional encoder network. In: Tetko IV, Kůrková V, Karpov P, Theis F (eds) Artificial Neural Networks and Machine Learning - ICANN 2019: Text and Time Series. Springer, Cham, pp 93–103

    Chapter  Google Scholar 

  13. Yang Y, Feng L, Dai L (2020) Context-oriented attention joint learning network for aspect-level sentiment classification. Pattern Recognit Artif Intell 33(8):753–765. https://doi.org/10.16451/j.cnki.issn1003-6059.202008009

    Article  Google Scholar 

  14. Li R, Chen H, Feng F, Ma Z, Wang X, Hovy E (2021) Dual graph convolutional networks for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 6319–6329. Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2021.acl-long.494

  15. Lu Q, Zhu Z, Zhang G, Kang S, Liu P (2021) Aspect-gated graph convolutional networks for aspect-based sentiment analysis. Appl Intell. https://doi.org/10.1007/s10489-020-02095-3

    Article  Google Scholar 

  16. Zhang C, Li Q, Song D (2019) Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 4568–4578. Association for Computational Linguistics, Hong Kong, China. https://doi.org/10.18653/v1/D19-1464

  17. Yang C, Qu T, Wu J (2021) Aspect level sentiment classification model based on bigcn and iam. Computer Engineering and Applications, 1–10 (2021). https://doi.org/10.3778/j.issn.1002-8331.2012-0573

  18. Zeng B, Yang H, Xu R, Zhou W, Han X (2019) Lcf: A local context focus mechanism for aspect-based sentiment classification. Appl Sci 9(16):3389. https://doi.org/10.3390/app9163389

    Article  Google Scholar 

  19. Akhtar MS, Garg T, Ekbal A (2020) Multi-task learning for aspect term extraction and aspect sentiment classification. Neurocomputing 398:247–256. https://doi.org/10.1016/j.neucom.2020.02.093

    Article  Google Scholar 

  20. Jin N, Wu J, Ma X, Yan K, Mo Y (2020) Multi-task learning model based on multi-scale cnn and lstm for sentiment classification. IEEE Access 8:77060–77072. https://doi.org/10.1109/ACCESS.2020.2989428

    Article  Google Scholar 

  21. Chauhan C, Sehgal S (2018) Sentiment classification for mobile reviews using knime. In: 2018 International Conference on Computing, Power and Communication Technologies (GUCON), pp. 548–553 (2018). https://doi.org/10.1109/GUCON.2018.8674946

  22. Das S, Kolya AK (2017) Sense gst: Text mining & sentiment analysis of gst tweets by naive bayes algorithm. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 239–244. https://doi.org/10.1109/ICRCICN.2017.8234513. IEEE

  23. Luo F, Li C, Cao Z (2016) Affective-feature-based sentiment analysis using svm classifier. In: 2016 IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 276–281 (2016). https://doi.org/10.1109/CSCWD.2016.7566001

  24. Guo X, Zhang H, Yang H, Xu L, Ye Z (2019) A single attention-based combination of cnn and rnn for relation classification. IEEE Access 7:12467–12475. https://doi.org/10.1109/ACCESS.2019.2891770

    Article  Google Scholar 

  25. Shao T, Guo Y, Chen H, Hao Z (2019) Transformer-based neural network for answer selection in question answering. IEEE Access 7:26146–26156. https://doi.org/10.1109/ACCESS.2019.2900753

    Article  Google Scholar 

  26. Ding L, He Y (2017) Research on domain adaption in machine translation combining domain knowledge and deep learning. Information Science 35(10), 125–132. https://doi.org/10.13833/j.cnki.is.2017.10.023

  27. Gu X, Gu Y, Wu H (2017) Cascaded convolutional neural networks for aspect-based opinion summary. Neural Process Lett 46(2):581–594. https://doi.org/10.1007/s11063-017-9605-

    Article  Google Scholar 

  28. Huang B, Carley K (2018) Parameterized convolutional neural networks for aspect level sentiment classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1091–1096. Association for Computational Linguistics, Brussels, Belgium. https://doi.org/10.18653/v1/D18-1136

  29. Tang D, Qin B, Feng X, Liu T (2016) Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 3298–3307. The COLING 2016 Organizing Committee, Osaka, Japan

  30. Tang D, Qin B, Liu, T (2016) Aspect level sentiment classification with deep memory network. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 214–224. Association for Computational Linguistics, Austin, Texas. https://doi.org/10.18653/v1/D16-1021

  31. Chen Y, Zhuang T, Guo K (2021) Memory network with hierarchical multi-head attention for aspect-based sentiment analysis. Applied Intelligence, 1–18. https://doi.org/10.1007/s10489-020-02069-5

  32. Zhang S, Xu X, Pang Y, Han J (2020) Multi-layer attention based cnn for target-dependent sentiment classification. Neural Process Lett 51(3):2089–2103. https://doi.org/10.1007/s11063-019-10017-9

    Article  Google Scholar 

  33. Xue W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 2514–2523. Association for Computational Linguistics, Melbourne, Australia. https://doi.org/10.18653/v1/P18-1234

  34. Wang X, Li F, Zhang Z, Xu G, Zhang J, Sun X (2021) A unified position-aware convolutional neural network for aspect based sentiment analysis. Neurocomputing 450:91–103. https://doi.org/10.1016/j.neucom.2021.03.092

    Article  Google Scholar 

  35. Li W, Qi F, Tang M, Yu Z (2020) Bidirectional lstm with self-attention mechanism and multi-channel features for sentiment classification. Neurocomputing 387:63–77. https://doi.org/10.1016/j.neucom.2020.01.006

    Article  Google Scholar 

  36. Gu S, Zhang L, Hou Y, Song Y (2018) A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 774–784. Association for Computational Linguistics, Santa Fe, New Mexico, USA

  37. Tay Y, Tuan LA, Hui SC (2017) Dyadic memory networks for aspect-based sentiment analysis. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 107–116. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3132847.3132936

  38. Fan C, Gao Q, Du J, Gui L, Xu R, Wong KF (2018) Convolution-based memory network for aspect-based sentiment analysis. The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval

  39. Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6450–6458. https://doi.org/10.1109/CVPR.2017.683

  40. Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, Zemel R, Bengio Y (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International Conference on Machine Learning, pp 2048–2057. PMLR

  41. Liu J, Yang Y, Lv S, Wang J, Chen H (2019) Attention-based bigru-cnn for chinese question classification. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-019-01344-9

    Article  Google Scholar 

  42. Cui L, Zhang Y (2019) Hierarchically-refined label attention network for sequence labeling. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 4115–4128. Association for Computational Linguistics, Hong Kong, China. https://doi.org/10.18653/v1/D19-1422

  43. Geng Z, Chen G, Han Y, Lu G, Li F (2020) Semantic relation extraction using sequential and tree-structured lstm with attention. Inf Sci 509:183–192. https://doi.org/10.1016/j.ins.2019.09.006

    Article  Google Scholar 

  44. Bahdanau, D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473

  45. Zhao F, Wu Z, Dai X (2020) Attention transfer network for aspect-level sentiment classification. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 811–821. International Committee on Computational Linguistics, Barcelona, Spain (Online)

  46. Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pp 4068–4074. https://doi.org/10.24963/ijcai.2017/568

  47. Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation, pp 197–206. https://doi.org/10.1007/978-3-319-93372-6_. Springer

  48. Fan F, Feng Y, Zhao D (2018) Multi-grained attention network for aspect-level sentiment classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 3433–3442. Association for Computational Linguistics, Brussels, Belgium. https://doi.org/10.18653/v1/D18-1380

  49. Li X, Bing L, Lam W, Shi B (2018) Transformation networks for target-oriented sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 946–956. Association for Computational Linguistics, Melbourne, Australia. https://doi.org/10.18653/v1/P18-1087

  50. Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 452–461. Association for Computational Linguistics, Copenhagen, Denmark. https://doi.org/10.18653/v1/D17-1047

  51. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907

  52. Sahu SK, Thomas D, Chiu B, Sengupta N, Mahdy M (2020) Relation extraction with self-determined graph convolutional network. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 2205–2208

  53. Cetoli, A., Bragaglia, S., O’Harney, A.D., Sloan, M.: Graph convolutional networks for named entity recognition. arXiv preprint arXiv:1709.10053 (2017)

  54. Zuo E, Zhao H, Chen B, Chen Q (2020) Context-specific heterogeneous graph convolutional network for implicit sentiment analysis. IEEE Access 8:37967–37975. https://doi.org/10.1109/ACCESS.2020.2975244

    Article  Google Scholar 

  55. Liang B, Yin R, Gui L, Du J, Xu R (2020) Jointly learning aspect-focused and inter-aspect relations with graph convolutional networks for aspect sentiment analysis. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 150–161. International Committee on Computational Linguistics, Barcelona, Spain (Online). https://doi.org/10.18653/v1/2020.coling-main.13

  56. Zuo E, Zhao H, Chen B, Chen Q (2021) Aspect-level sentiment classification model based on context-preserving capability. Pattern Recognit Artif Intell 34(2):157–166. https://doi.org/10.16451/j.cnki.issn1003-6059.202102007

    Article  Google Scholar 

  57. Zhao P, Hou L, Wu O (2020) Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification. Knowl-Based Syst 193:105443. https://doi.org/10.1016/j.knosys.2019.105443

    Article  Google Scholar 

  58. Pennington J, Socher R, Manning C (2014) GloVe: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543. Association for Computational Linguistics, Doha, Qatar. https://doi.org/10.3115/v1/D14-1162

  59. Devlin J, Chang MW, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. ArXiv abs/1810.04805

  60. Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent Twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 49–54. Association for Computational Linguistics, Baltimore, Maryland. https://doi.org/10.3115/v1/P14-2009

  61. Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2004) SemEval-2014 task 4: Aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35. Association for Computational Linguistics, Dublin, Ireland. https://doi.org/10.3115/v1/S14-2004

  62. Pontiki M, Galanis D, Papageorgiou H, Manandhar S, Androutsopoulos I (2015) SemEval-2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pp. 486–495. Association for Computational Linguistics, Denver, Colorado (2015). https://doi.org/10.18653/v1/S15-2082

  63. Gao Z, Feng A, Song X, Wu X (2019) Target-dependent sentiment classification with bert. IEEE Access 7:154290–154299. https://doi.org/10.1109/ACCESS.2019.2946594

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Key Research and Development Program of China, (No.2019YFE0110300), the National Natural Science Foundation of China (NSFC) (No.72071061).

Author information

Author notes

    Authors and Affiliations

    1. School of Management, Hefei University of Technology, Tunxi Road, Hefei, 230009, Anhui, China

      Bengong Yu & Shuwen Zhang

    2. Key Laboratory of Process Optimization and Intelligent Decision-making, Hefei University of Technology, Tunxi Road, Hefei, 230009, Anhui, China

      Bengong Yu

    Authors
    1. Bengong Yu
      View author publications

      You can also search for this author inPubMed Google Scholar

    2. Shuwen Zhang
      View author publications

      You can also search for this author inPubMed Google Scholar

    Contributions

    Bengong Yu: Conceptualization, Methodology, Writing - Original Draft, Writing - Original Draft, Writing - Review & Editing, Supervision, Funding acquisition. Shuwen Zhang: Methodology, Investigation, Data Curation, Writing - Original Draft.

    Corresponding author

    Correspondence to Bengong Yu.

    Additional information

    Publisher's Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Yu, B., Zhang, S. A novel weight-oriented graph convolutional network for aspect-based sentiment analysis. J Supercomput 79, 947–972 (2023). https://doi.org/10.1007/s11227-022-04689-9

    Download citation

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s11227-022-04689-9

    Keywords