Skip to main content

Deep-Learning- and GCN-Based Aspect-Level Sentiment Analysis Methods on Balanced and Unbalanced Datasets

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2023)

Abstract

With the growth of social networks, an increasing number of publicly available opinions are posted on them. Sentiment analysis, especially aspect-level sentiment analysis (ALSA), of these opinions has emerged and is a concern for many researchers. ALSA aims to gather, evaluate, and aggregate sentiments regarding the aspects of a topic of concern. Previous research has demonstrated that deep learning and graph convolutional network (GCN) methods can effectively improve the performance of ALSA methods. However, further investigation is required, especially when comparing the performance of deep learning-based and GCN-based ALSA methods on balanced and unbalanced datasets. In this study, we aimed to investigate two hypotheses: (i) the effectiveness of ALSA methods can be improved by deep learning and GCN techniques on balanced and unbalanced datasets, especially GCNs, over BERT representations, and (ii) the balanced data slightly affect the accuracy and \(F_1\) score of the deep learning and GCN-based ALSA methods. To implement this study, we first constructed balanced Laptop, Restaurant, and MAMS datasets based on their original unbalanced datasets; then, we experimented with 17 prepared methods on six unbalanced and balanced datasets; finally, we evaluated, discussed, and concluded the two hypotheses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://code.google.com/archive/p/word2vec/.

  2. 2.

    https://nlp.stanford.edu/projects/glove/.

  3. 3.

    https://fasttext.cc/docs/en/crawl-vectors.html.

  4. 4.

    https://mccormickml.com/2019/05/14/BERT-word-embeddings-tutorial/.

  5. 5.

    https://github.com/yuanxiaosc/ELMo.

  6. 6.

    https://alt.qcri.org/semeval2014/task4/index.php?id=data-and-tools.

  7. 7.

    https://github.com/siat-nlp/MAMS-for-ABSA.

  8. 8.

    https://scikit-learn.org/stable/modules/classes.html#module-sklearn.metrics.

References

  1. Alantari, H.J., Currim, I.S., Deng, Y., Singh, S.: An empirical comparison of machine learning methods for text-based sentiment analysis of online consumer reviews. Int. J. Res. Mark. 39(1), 1–19 (2022)

    Article  Google Scholar 

  2. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint: arXiv:1810.04805 (2018)

  3. Do, H.H., Prasad, P.W., Maag, A., Alsadoon, A.: Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst. Appl. 118, 272–299 (2019)

    Article  Google Scholar 

  4. Fan, F., Feng, Y., Zhao, D.: Multi-grained attention network for aspect-level sentiment classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 3433–3442 (2018)

    Google Scholar 

  5. Huang, B., Ou, Y., Carley, K.M.: Aspect level sentiment classification with attention-over-attention neural networks. In: Thomson, R., Dancy, C., Hyder, A., Bisgin, H. (eds.) SBP-BRiMS 2018. LNCS, vol. 10899, pp. 197–206. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93372-6_22

    Chapter  Google Scholar 

  6. Jiang, Q., Chen, L., Xu, R., Ao, X., Yang, M.: A challenge dataset and effective models for aspect-based sentiment analysis. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6280–6285 (2019)

    Google Scholar 

  7. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint: arXiv:1412.6980 (2014)

  8. Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint: arXiv:1609.02907 (2016)

  9. Liang, B., Su, H., Gui, L., Cambria, E., Xu, R.: Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks. Knowl.-Based Syst. 235, 107643 (2022)

    Article  Google Scholar 

  10. Liu, Q., Zhang, H., Zeng, Y., Huang, Z., Wu, Z.: Content attention model for aspect based sentiment analysis. In: Proceedings of the 2018 World Wide Web Conference, pp. 1023–1032 (2018)

    Google Scholar 

  11. Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. arXiv preprint: arXiv:1709.00893 (2017)

  12. Pedregosa, F., et al.: Scikitlearn: machine learning in Python (2011). Accessed 28 Mar 2022

    Google Scholar 

  13. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)

    Google Scholar 

  14. Phan, H.T., Nguyen, N.T., Hwang, D.: Convolutional attention neural network over graph structures for improving the performance of aspect-level sentiment analysis. Inf. Sci. 589, 416–439 (2022)

    Article  Google Scholar 

  15. Phan, H.T., Nguyen, N.T., Tran, V.C., Hwang, D.: An approach for a decision-making support system based on measuring the user satisfaction level on twitter. Inf. Sci. 561, 243–273 (2021)

    Article  MathSciNet  Google Scholar 

  16. Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: Semeval-2014 task 4: Aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35. Association for Computational Linguistics, Dublin (2014). https://doi.org/10.3115/v1/S14-2004, https://aclanthology.org/S14-2004

  17. Qaiser, S., Yusoff, N., Remli, M., Adli, H.K.: A comparison of machine learning techniques for sentiment analysis. Turk. J. Comput. Math. Educ. (2021)

    Google Scholar 

  18. Schouten, K., Frasincar, F.: Survey on aspect-level sentiment analysis. IEEE Trans. Knowl. Data Eng. 28(3), 813–830 (2015)

    Article  Google Scholar 

  19. Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMS for target-dependent sentiment classification. arXiv preprint: arXiv:1512.01100 (2015)

  20. Trisna, K.W., Jie, H.J.: Deep learning approach for aspect-based sentiment classification: a comparative review. Appl. Artif. Intell. 36(1), 2014186 (2022)

    Article  Google Scholar 

  21. Wang, J., Xu, B., Zu, Y.: Deep learning for aspect-based sentiment analysis. In: 2021 International Conference on Machine Learning and Intelligent Systems Engineering (MLISE), pp. 267–271. IEEE (2021)

    Google Scholar 

  22. Wang, Y., Huang, M., Zhu, X., Zhao, L.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 606–615 (2016)

    Google Scholar 

  23. Zeng, B., Yang, H., Xu, R., Zhou, W., Han, X.: LCF: a local context focus mechanism for aspect-based sentiment classification. Appl. Sci. 9(16), 3389 (2019)

    Article  Google Scholar 

  24. Zhang, C., Li, Q., Song, D.: Aspect-based sentiment classification with aspect-specific graph convolutional networks. arXiv preprint: arXiv:1909.03477 (2019)

  25. Zhao, P., Hou, L., Wu, O.: Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification. Knowl.-Based Syst. 193, 105443 (2020)

    Article  Google Scholar 

Download references

Acknowledgment

This research was supported by the 2020 Yeungnam University Research Grant. This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF-2023R1A2C1008134).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yeong-Seok Seo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Phan, H.T., Nguyen, N.T., Seo, YS., Hwang, D. (2023). Deep-Learning- and GCN-Based Aspect-Level Sentiment Analysis Methods on Balanced and Unbalanced Datasets. In: Nguyen, N.T., et al. Intelligent Information and Database Systems. ACIIDS 2023. Lecture Notes in Computer Science(), vol 13996. Springer, Singapore. https://doi.org/10.1007/978-981-99-5837-5_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-5837-5_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-5836-8

  • Online ISBN: 978-981-99-5837-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics