Abstract
Target Sentiment Classification (TSC) aims to judge the sentiment polarity of the specific target appearing in a sentence. Most of the existing TSC algorithms use Recurrent Neural Network (RNN) to encode and model sentences, which can mine the semantic features of sentences, but there are still some shortcomings. RNN cannot fully capture long-distance semantic information, nor can it perform parallel processing calculations. At present, some research attempts to solve the problems of RNN as an encoder, but the generalization ability and prediction ability of these models are low, and there are certain limitations. In view of the above problems, this paper proposes a PC-SCL model that combines contrastive learning and primary capsule encoder. The primary capsule encoder network is designed to extract the hidden state of the word vector of the embedding layer, which can parallel calculate and fully extract and integrate the sentiment features between context and target. In addition, the model uses supervised contrastive learning, which enables the model to extract feature representations more accurately, and improves the generalization and prediction capabilities of the model. The model is tested on three general datasets, and the experimental results prove the effectiveness of the proposed model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Taboada, M., Brooke, J., Tofiloski, M., et al.: Lexicon-based methods for sentiment analysis. Comput. Linguist. 37(2), 267–307 (2011)
Cruz, F.L., Troyano, J.A., EnrÃquez, F., et al.: ‘Long autonomy or long delay?’The importance of domain in opinion mining. Expert Syst. Appl. 40(8), 3174–3184 (2013)
Zhu, J., Wang, H., Tsou, B.K., et al.: Multi-aspect opinion polling from textual reviews. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 1799–1802 (2009)
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 79–86 (2002)
Jiang, L., Yu, M., Zhou, M., et al.: Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pp. 151–160 (2011)
Kiritchenko, S., Zhu, X., Cherry, C., et al.: Nrc-canada-2014: Detecting aspects and sentiment in customer reviews. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 437–442 (2014)
Dong, L., Wei, F., Tan, C., et al.: Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: Short papers), pp. 49–54 (2014)
Wang, Y., Sun, A., Han, J., et al.: Sentiment analysis by capsules. In: Proceedings of the 2018 world wide web conference, pp. 1165–1174 (2018)
Sundermeyer, M., Schlüter, R., Ney, H.: LSTM neural networks for language modeling. In:Thirteenth annual conference of the international speech communication association (2012)
Tang, D., Qin, B., Feng, X., et al.: Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 3298–3307 (2016)
Hu, Z., Zhao, X.: Sentiment analysis based on word vector technology and hybrid neural network . Appl. Res. Comput. 35(12), 42–45+60 (2018)
Hou, S., Zhao, X., Liu, N., Shi, X., Wang, Y., Zhang, G.: Self-adaptive context reasoning mechanism for text sentiment analysis. In: Zhao, X., Yang, S., Wang, X., Li, J. (eds.) Web Information Systems and Applications: 19th International Conference, WISA 2022, Dalian, China, September 16–18, 2022, Proceedings, pp. 194–205. Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-031-20309-1_17
Chen, P., Sun, Z., Bing, L., et al.: Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp. 452–461 (2017)
Cho, K., van Merriënboer, B., Gu̇lçehre, Ç,, et al.: Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. In: Proceedings of the 2014 Conference on Empirical Met-hods in Natural Language Processing, pp. 1724–1734 (2014)
Wang, Y., Huang, M., Zhu, X., et al.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp. 606–615 (2016)
Song, Y., Wang, J., Jiang, T., Liu, Z., Rao, Y.: Targeted sentiment classification with attentional encoder network. In: Tetko, I.V., Kůrková, V., Karpov, P., Theis, F. (eds.) ICANN 2019. LNCS, vol. 11730, pp. 93–103. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30490-4_9
Khosla, P., Teterwak, P., Wang, C., et al.: Supervised contrastive learning. Adv. Neural. Inf. Process. Syst. 33, 18661–18673 (2020)
Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)
Zhao, W., Peng, H., Eger, S., et al.: Towards scalable and reliable capsule networks for challenging NLP applications. arXiv preprint arXiv:1906.02829 (2019)
Pontiki, M., Galanis, D., Pavlopoulos, J., et al.: Semeval-2014 task 4: Aspect based sentiment analysis . In:Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35 (2014)
Pontiki, M., Galanis, D., Papageorgiou, H., et al.: Semeval-2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pp. 486–495 (2015)
Kingma, D.P., Ba, J.A.: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Yang, M., Tu, W., Wang, J., et al.: Attention based LSTM for target dependent sentiment classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31, issue 1 (2017)
Li, X., Bing, L., Lam, W., et al.: Transformation Networks for Target-Oriented Sentiment Classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 946–956 (2018)
Tang, J., Lu, Z., Su, J., et al.: Progressive self-supervised attention learning for aspect-level sentiment analysis. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 557–566 (2019)
Zhang, C., Li, Q., Song, D.: Aspect-based sentiment classification with aspect-specific graph convolutional networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 4568–4578 (2019)
Xu, L., Bing, L., Lu, W., et al.: Aspect based sentiment analysis with aspect-specific opinion spans. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3561–3567 (2020)
Zhou, J., Huang, J.X., Hu, Q.V., et al.: SK-GCN: modeling syntax and knowledge via graph convolutional Network for aspect-level sentiment classification. Knowl.-Based Syst. 205(3), 106292 (2020)
Cheng, L.C., Chen, Y.L., Liao, Y.Y.: Aspect-based sentiment analysis with component focusing multi-head co-attention networks. Neurocomputing 489, 9–17 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Deng, H., Li, Y., Ju, S., Liu, M. (2023). Combines Contrastive Learning and Primary Capsule Encoder for Target Sentiment Classification. In: Yuan, L., Yang, S., Li, R., Kanoulas, E., Zhao, X. (eds) Web Information Systems and Applications. WISA 2023. Lecture Notes in Computer Science, vol 14094. Springer, Singapore. https://doi.org/10.1007/978-981-99-6222-8_24
Download citation
DOI: https://doi.org/10.1007/978-981-99-6222-8_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6221-1
Online ISBN: 978-981-99-6222-8
eBook Packages: Computer ScienceComputer Science (R0)
