Abstract
Text Sentiment Analysis (TSA) is a classic research topic in the field of Natural Language Processing (NLP) and has important application value for downstream tasks. Previous TSA methods focus on accurately representing emotional words in the semantic space to complete the recognition of text emotions. However, traditional methods are difficult to establish the intrinsic strong connections between emotional words in fine granularity and to accurately distinguish emotional tendencies. The research work of psychologists such as Carroll Ellis Izard, David Krech, and Robert Pluchik pointed out that for humans, our emotions can be compounded from the most basic emotions to construct many types of emotional states. Based on the classic attention mechanism, this paper proposes an Emotional Polarity Attention Mechanism (EPAM), which establishes strong connections between emotional words through emotional compounding theory, to enhance the understanding and representation accuracy of emotional words. We embed EPAM as a network layer into the current mainstream text classification models to build experimental group models and then verify the effectiveness of EPAM. Comparative experiments on four standard text classification datasets confirm that our model is effective and able to mine the intrinsic connections of emotional words.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
https://www.imdb.com/interfaces/
- 2.
https://www.cs.cornell.edu/people/pabo/movie-review-data/
- 3.
https://www.imdb.com/interfaces/
- 4.
https://emilhvitfeldt.github.io/textdata/reference/dataset_sentence_polarity.html
References
Badea, L.M.: Predicting consumer behavior with artificial neural networks. Proce. Econ. Finance 15, 238–246 (2014)
Berger, A., Della Pietra, S.A., Della Pietra, V.J.: A maximum entropy approach to natural language processing. Comput. Linguist. 22(1), 39–71 (1996)
Bonab, H., Aliannejadi, M., Vardasbi, A., Kanoulas, E., Allan, J.: Cross-market product recommendation. In: CIKM, pp. 110–119 (2021)
Chang, G., Huo, H.: A method of fine-grained short text sentiment analysis based on machine learning. Neural Netw. World 28(4), 325–344 (2018)
Chen, Y.: Convolutional neural network for sentence classification. Master’s thesis, University of Waterloo (2015)
Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., Xu, K.: Adaptive recursive neural network for target-dependent twitter sentiment classification. In: ACL, pp. 49–54 (2014)
Gitau, E.: An approach for using twitter to perform sentiment analysis in Kenya. Ph.D. thesis, University of Nairobi (2011)
Hicham, N., Karim, S.: Machine learning applications for consumer behavior prediction. In: The Proceedings of the International Conference on Smart City Applications, pp. 666–675 (2022)
Hu, R., Rui, L., Zeng, P., Chen, L., Fan, X.: Text sentiment analysis: A review. In: ICCC, pp. 2283–2288. IEEE (2018)
Iftikhar, A., Ghazanfar, M.A., Ayub, M., Mehmood, Z., Maqsood, M.: An improved product recommendation method for collaborative filtering. IEEE Access 8, 123841–123857 (2020)
Izard, C.E.: The psychology of emotions. Springer Science & Business Media (1991). https://doi.org/10.1007/978-1-4899-0591-8_6
Jin, W., Ho, H.H., Srihari, R.K.: A novel lexicalized hmm-based learning framework for web opinion mining. In: ICML. vol. 10 (2009)
Joulin, A., Grave, E., Bojanowski, P., Mikolov, T.: Bag of tricks for efficient text classification. In: EACL. pp. 427–431 (2017)
Kim, Y.: Convolutional neural networks for sentence classification. In: Conference on Empirical Methods in Natural Language Processing (2014)
Krech, D., Petrinovich, L.F., McGaugh, J.L.: Knowing, thinking, and believing : Festschrift for professor david krech (1976)
Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: AAAI. vol. 29 (2015)
Li, W., Jin, B., Quan, Y.: Review of research on text sentiment analysis based on deep learning. OALib (2020)
Liu, D., et al.: Research on network public opinion analysis and monitor method based on big data technology. ICEIEC, 195–199 (2020)
Liu, P., Meng, H.: Seemgo: conditional random fields labeling and maximum entropy classification for aspect based sentiment analysis. In: SemEval, pp. 527–531 (2014)
Liu, P., Qiu, X., Huang, X.: Recurrent neural network for text classification with multi-task learning. In: IJCAI, pp. 2873–2879 (2016)
Liu, S., Li, F., Li, F., Cheng, X., Shen, H.: Adaptive co-training SVM for sentiment classification on tweets. In: CIKM, pp. 2079–2088 (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS, pp. 3111–3119 (2013)
Mnih, A., Hinton, G.E.: A scalable hierarchical distributed language model. In: NIPS (2008)
Nandwani, P., Verma, R.: A review on sentiment analysis and emotion detection from text. Soc. Netw. Anal. Min. 11(1), 81 (2021)
Plutchik, R.: Emotions and life: Perspectives from psychology, biology, and evolution. Am. Psychol. Assoc. (2003)
Raffel, C., Ellis, D.P.: Feed-forward networks with attention can solve some long-term memory problems. arXiv preprint arXiv:1512.08756 (2015)
Tang, D., Wei, F., Qin, B., Liu, T., Zhou, M.: Coooolll: a deep learning system for twitter sentiment classification. In: SemEval, pp. 208–212 (2014)
Turner, J.H.: Human emotions. Blessings for the Long Night (2022)
Vaswani, A., et al.: Attention is all you need. ArXiv abs/1706.03762 (2017)
Wankhade, M., Rao, A.C.S., Kulkarni, C.: A survey on sentiment analysis methods, applications, and challenges. Artif. Intell. Rev. 55(7), 5731–5780 (2022)
Xu, D., Tian, Z., Lai, R., Kong, X., Tan, Z., Shi, W.: Deep learning based emotion analysis of microblog texts. Inf. Fusion 64, 1–11 (2020)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: ACL, pp. 1480–1489 (2016)
Zhang, J., He, R., Guo, F.: Quantum-inspired representation for long-tail senses of word sense disambiguation. In: AAAI, pp. 13949–13957 (2023)
Zhang, J., He, R., Guo, F., Liu, C.: Quantum interference model for semantic biases of glosses in word sense disambiguation. In: AAAI, pp. 19551–19559 (2024)
Zhang, J., He, R., Guo, F., Ma, J., Xiao, M.: Disentangled representation for long-tail senses of word sense disambiguation. In: CIKM, pp. 2569–2579 (2022)
Zhang, J., Hou, Y., Li, Z., Zhang, L., Chen, X.: Strong statistical correlation revealed by quantum entanglement for supervised learning. In: ECAI. vol. 325, pp. 1650–1657 (2020)
Zhou, Z., Zhou, X., Qian, L.: Online public opinion analysis on infrastructure megaprojects: Toward an analytical framework. J. Manage. Eng. 37, 04020105 (2021)
Acknowledgements
Our work is supported by the National Key Research and Development Program of China (No. 2022YFC3600902).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, J., Wang, T., Wang, C., Bai, Y., Zhang, Y., Li, Y. (2024). Emotional Polarity Attention Mechanism for Text Sentiment Analysis. In: Onizuka, M., et al. Database Systems for Advanced Applications. DASFAA 2024. Lecture Notes in Computer Science, vol 14854. Springer, Singapore. https://doi.org/10.1007/978-981-97-5569-1_1
Download citation
DOI: https://doi.org/10.1007/978-981-97-5569-1_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5568-4
Online ISBN: 978-981-97-5569-1
eBook Packages: Computer ScienceComputer Science (R0)