Skip to main content
Log in

Enhancing aspect-based sentiment analysis with dependency-attention GCN and mutual assistance mechanism

  • Research
  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Aspect-based sentiment analysis (ABSA) has been extensively studied in recent years. It involves several subtasks for extracting one or more sentiment elements, including the aspect category, aspect term, opinion term, and sentiment polarity. In this paper, we propose two novel approaches to addressing different ABSA subtasks. Firstly, we introduce a Dependency-Attention GCN-based Aspect Opinion Extractor (DAG-AOE) for the Aspect-Opinion Pair Extraction (AOPE) task. DAG-AOE employs an improved graph convolutional network to extract syntactic structure information from text sequences, thereby effectively identifying aspect-opinion pairs in sentences. Secondly, we propose a Mutual Assistance Mechanism-based Category Sentiment Classifier (MAM-CSC) that utilizes the results of DAG-AOE to address the Aspect Sentiment Quad Prediction (ASQP) task. MAM-CSC leverages the semantic relationships between words in a sentence and addresses the two independent classification tasks through a mutual assistance approach. We conduct extensive experiments on benchmark datasets, and the experimental results demonstrate that our models have demonstrated a significant improvement over all baseline methods. Specifically, our models achieved the highest improvement of 1.4% F1 score over the baseline on the AOPE task and 1.5% F1 score on the ASQP task.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

All the datasets gathered from other sources has been publicly available.

Notes

  1. https://spacy.io/

References

  • Bekoulis, G., Deleu, J., & Demeester, T., et al (2018). Joint entity recognition and relation extraction as a multi-head selection problem. Expert Systems with Applications 114, 34–45. https://doi.org/10.1016/j.eswa.2018.07.032

  • Bu, J., Ren, L., & Zheng, S., et al (2021). Asap: A chinese review dataset towards aspect category sentiment analysis and rating prediction. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 2069–2079. https://doi.org/10.18653/v1/2021.naacl-main.167

  • Cai, H., Xia, R., & Yu, J. (2021). Aspect-category-opinion-sentiment quadruple extraction with implicit aspects and opinions. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (volume 1: Long Papers), pp 340–350. https://doi.org/10.18653/v1/2021.acl-long.29

  • Chen, S., Liu, J., & Wang, Y., et al (2020). Synchronous double–channel recurrent network for aspect–opinion pair extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 6515–6524. https://doi.org/10.18653/v1/2020.acl-main.582

  • Chen, S., Wang, Y., & Liu, J., et al (2021). Bidirectional machine reading comprehension for aspect sentiment triplet extraction. In: Proceedings of the AAAI conference on artificial intelligence, pp 12666–12674. https://doi.org/10.1609/aaai.v35i14.17500

  • Chen, Y., Keming, C., Sun, X., et al (2022). A span–level bidirectional network for aspect sentiment triplet extraction. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp 4300–4309

  • Chen, Z., & Qian, T. (2020). Relation–aware collaborative learning for unified aspect-based sentiment analysis. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3685–3694. 10.18653/v1/2020.acl-main.340

  • De Marneffe, M. C., Manning, C. D., Nivre, J., et al. (2021). Universal dependencies. Computational Linguistics, 47(2), 255–308. https://doi.org/10.1162/coli_a_00402

    Article  Google Scholar 

  • Devlin, J., Chang, M. W., & Lee, K., et al (2019). Bert: Pre–training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, volume 1 (Long and Short Papers), pp 4171–4186. https://doi.org/10.18653/v1/N19-1423

  • Fan, Z., Wu, Z., Dai, X., et al (2019). Target–oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, volume 1 (Long and Short Papers), pp 2509–2518. https://doi.org/10.18653/v1/N19-1259

  • He, R., Lee, W. S., & Ng, H. T., et al (2019). An interactive multi–task learning network for end-to-end aspect-based sentiment analysis. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 504–515. https://doi.org/10.18653/v1/P19-1048

  • Hu, M., & Liu, B. (2004). Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 168–177. https://doi.org/10.1145/1014052.1014073

  • Hu, M., Peng, Y., & Huang Z, et al (2019). Open–domain targeted sentiment analysis via span–based extraction and classification. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 537–546. https://doi.org/10.18653/v1/P19-1051

  • Kipf, T. N., & Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv:1609.02907. https://doi.org/10.48550/arXiv.1609.02907

  • Klinger, R., & Cimiano, P. (2013a). Bi–directional inter–dependencies of subjective expressions and targets and their value for a joint model. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (volume 2: Short Papers), pp 848–854

  • Klinger, R., Cimiano, P. (2013b). Joint and pipeline probabilistic models for fine–grained sentiment analysis: Extracting aspects, subjective phrases and their relations. In: 2013 IEEE 13th International Conference on Data Mining Workshops, IEEE, pp 937–944. https://doi.org/10.1109/ICDMW.2013.13

  • Li, X., Bing, L., & Li, P., et al (2019). A unified model for opinion target extraction and target sentiment prediction. In: Proceedings of the AAAI conference on artificial intelligence, pp 6714–6721, https://doi.org/10.1609/aaai.v33i01.33016714

  • Li, Y., Lin, Y., & Lin, Y., et al (2022a) .A span–sharing joint extraction framework for harvesting aspect sentiment triplets. Knowledge–Based Systems 242, 108366. https://doi.org/10.1016/j.knosys.2022.108366

  • Li, Y., Wang, C., Lin, Y., et al. (2022). Span-based relational graph transformer network for aspect-opinion pair extraction. Knowledge and Information Systems, 64(5), 1305–1322. https://doi.org/10.1007/s10115-022-01675-8

    Article  Google Scholar 

  • Liu, B. (2012). Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies, 5(1), 1–167. https://doi.org/10.2200/S00416ED1V01Y201204HLT016

    Article  Google Scholar 

  • Liu, P., Joty, S., & Meng, H. (2015). Fine–grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1433–1443. https://doi.org/10.18653/v1/D15-1168

  • Ma, D., Li, S., & Wu, F., et al (2019). Exploring sequence–to–sequence learning in aspect term extraction. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 3538–3547. https://doi.org/10.18653/v1/P19-1344

  • Nazir, A., Rao, Y. (2022). Iaotp: An interactive end–to–end solution for aspect–opinion term pairs extraction. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 1588–1598. https://doi.org/10.1145/3477495.3532085

  • Peng, H., Xu, L., & Bing, L., et al (2020). Knowing what, how and why: A near complete solution for aspect–based sentiment analysis. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp 8600–8607. https://doi.org/10.1609/aaai.v34i05.6383

  • Pontiki, M., Galanis, D., & Pavlopoulos, J., et al (2014). Semeval–2014 task 4: Aspect based sentiment analysis. In: 8th International Workshop on Semantic Evaluation August 23–24, 2014., pp 27–35. https://doi.org/10.3115/v1/s14-2004

  • Pontiki, M., Galanis, D., & Papageorgiou, H., et al (2015). Semeval–2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp 486–495. https://doi.org/10.18653/v1/s15-2082

  • Pontiki, M., Galanis, D., & Papageorgiou, H., et al (2016). Semeval–2016 task 5: Aspect based sentiment analysis. In: ProWorkshop on Semantic Evaluation (SemEval–2016), Association for Computational Linguistics, pp 19–30. https://doi.org/10.18653/v1/s16-1055

  • Popescu, A. M., & Etzioni, O. (2007). Extracting product features and opinions from reviews. Natural Language Processing and Text Mining pp 9–28. https://doi.org/10.1007/978-1-84628-754-1_2

  • Qiu, G., Liu, B., Bu, J., et al. (2011). Opinion word expansion and target extraction through double propagation. Computational Linguistics, 37(1), 9–27. https://doi.org/10.1162/coli_a_00034

    Article  Google Scholar 

  • Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv:1706.05098. https://doi.org/10.48550/arXiv.1706.05098

  • Sun, K., Zhang, R., & Mensah, S., et al (2019). Aspect–level sentiment analysis via convolution over dependency tree. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 5679–5688. https://doi.org/10.18653/v1/D19-1569

  • Tang, D., Qin, B., & Feng, X., et al (2016). Effective lstms for target–dependent sentiment classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp 3298–3307. https://doi.org/10.48550/arXiv.1512.01100

  • Veličković, P., Cucurull, G., & Casanova, A., et al (2017). Graph attention networks. arXiv:2110.08020. https://doi.org/10.48550/arXiv.1710.10903

  • Wan, H., Yang, Y., Du, J., et al (2020). Target–aspect–sentiment joint detection for aspect-based sentiment analysis. In: Proceedings of the AAAI conference on artificial intelligence, pp 9122–9129. https://doi.org/10.1609/aaai.v34i05.6447

  • Wan, Y., Chen, Y., & Shi, L., et al (2022). A knowledge–enhanced interactive graph convolutional network for aspect–based sentiment analysis. Journal of Intelligent Information Systems pp 1–23. https://doi.org/10.1007/s10844-022-00761-1

  • Wang, W., Pan, S. J., & Dahlmeier, D., et al (2017). Coupled multi–layer attentions for co–extraction of aspect and opinion terms. In: Proceedings of the Thirty–First AAAI Conference on Artificial Intelligence, pp 3316–3322. https://doi.org/10.1609/aaai.v31i1.10974

  • Wang, X., Liu, P., & Zhu, Z., et al (2022). Aspect–based sentiment analysis with graph convolutional networks over dependency awareness. In: 2022 26th International Conference on Pattern Recognition (ICPR), IEEE, pp 2238–2245. https://doi.org/10.1109/ICPR56361.2022.9956479

  • Wei, Z., Hong, Y., & Zou, B., et al (2020). Don’t eclipse your arts due to small discrepancies: Boundary repositioning with a pointer network for aspect extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3678–3684. https://doi.org/10.18653/v1/2020.acl-main.339

  • Wu, Z., Ying, C., & Zhao, F., et al (2020). Grid tagging scheme for aspect–oriented fine-grained opinion extraction. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp 2576–2585. https://doi.org/10.18653/v1/2020.findings-emnlp.234

  • Xu, H., Liu, B., & Shu, L., et al (2018). Double embeddings and cnn–based sequence labeling for aspect extraction. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (volume 2: Short Papers), pp 592–598. https://doi.org/10.18653/v1/P18-2094

  • Xu, L., Li, H., & Lu, W., et al (2020). Position–aware tagging for aspect sentiment triplet extraction. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 2339–2349. https://doi.org/10.18653/v1/2020.emnlp-main.183

  • Yan, H., Dai, J., & Ji, T., et al (2021). A unified generative framework for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (volume 1: Long Papers), pp 2416–2429. https://doi.org/10.18653/v1/2021.acl-long.188

  • Yang, B., & Cardie, C. (2012). Extracting opinion expressions with semi–markov conditional random fields. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp 1335–1345

  • Yang, B., & Cardie, C. (2013). Joint inference for fine-grained opinion extraction. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (volume 1: Long Papers), pp 1640–1649

  • Ye, H., Yan, Z., & Luo, Z., et al (2017). Dependency–tree based convolutional neural networks for aspect term extraction. In: Advances in Knowledge Discovery and Data Mining: 21st Pacific–Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings, Part II 21, Springer, pp 350–362. https://doi.org/10.1007/978-3-319-57529-2_28

  • Yin, Y., Wei, F., & Dong, L., et al (2016). Unsupervised word and dependency path embeddings for aspect term extraction. In: Proceedings of the Twenty–Fifth International Joint Conference on Artificial Intelligence, pp 2979–2985. https://doi.org/10.48550/arXiv.1605.07843

  • Yu, P., Tan, W., & Niu, W., et al (2022). Aspect–location attention networks for aspect–category sentiment analysis in social media. Journal of Intelligent Information Systems, pp 1–25. https://doi.org/10.1007/s10844-022-00760-2

  • Zhang C, Li Q, Song D, et al (2020) A multi-task learning framework for opinion triplet extraction. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp 819–828. https://doi.org/10.18653/v1/2020.findings-emnlp.72

  • Zhang, Y., Ding, Q., Zhu, Z., et al. (2022). Enhancing aspect and opinion terms semantic relation for aspect sentiment triplet extraction. Journal of Intelligent Information Systems, 59(2), 523–542. https://doi.org/10.1007/s10844-022-00710-y

    Article  Google Scholar 

  • Zhao, H., Huang, L., & Zhang, R., et al (2020). Spanmlt: A span–based multi–task learning framework for pair–wise aspect and opinion terms extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3239–3248. https://doi.org/10.18653/v1/2020.acl-main.296

  • Zhou, X., Wan, X., & Xiao, J. (2015). Representation learning for aspect category detection in online reviews. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp 417–423. https://doi.org/10.1609/aaai.v29i1.9194

  • Zhuang, L., Jing, F., Zhu, X. Y. (2006). Movie review mining and summarization. In: Proceedings of the 15th ACM international conference on Information and knowledge management, pp 43–50. https://doi.org/10.1145/1183614.1183625

Download references

Acknowledgements

This work was supported by the High Performance Computing Center of Central South University and the National Natural Science Foundation of China under Grants: Methodologies for Understanding Big Data and Knowledge Discovery (61836016).

Funding

This work was supported by the National Natural Science Foundation of China under Grants: Methodologies for Understanding Big Data and Knowledge Discovery (61836016).

Author information

Authors and Affiliations

Authors

Contributions

Jialin Feng: Conceptualization, Investigation, Methodology, Software, Formal Analysis, Writing; Hong Li: Conceptualization, Funding Acquisition, Resources, Supervision; Zhiyi Yu: Investigation, Software, Visualization.

Corresponding author

Correspondence to Jialin Feng.

Ethics declarations

Ethics Approval

Not applicable.

Competing interests

The authors declare that there is no competing interests with anybody or any institution regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Feng, J., Li, H. & Yu, Z. Enhancing aspect-based sentiment analysis with dependency-attention GCN and mutual assistance mechanism. J Intell Inf Syst 62, 163–189 (2024). https://doi.org/10.1007/s10844-023-00811-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-023-00811-2

Keywords

Navigation