Abstract
The goal of Emotion-Cause Pair Extraction is to extract the emotion clause and the corresponding cause clause from the unmarked document level text. The two steps solution has the disadvantage of error propagation and fails to make full use of context information. In this paper, we propose an end to end neural network. The model uses Transformer with different granularity to extract hierarchical text features, and uses the text capsule network to model the relationship between the local text features of emotion cause pair and the overall causal relationship. We also utilize a filter mechanism to alleviate the problem of sample imbalance of ECPE task. The experimental results show that our model has achieved great performance improvement, which is higher than most baseline methods on F1 score.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, Y., Lee, S.Y.M., Li, S., Huang, C.R.: Emotion cause detection with linguistic constructions. In: Proceedings of the 23rd International Conference on Computational Linguistics (Colling 2010), pp. 179–187 (2010)
Ding, Z., Xia, R., Yu, J.: Ecpe-2d: emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3161–3170 (2020)
Fan, C., et al.: A knowledge regularized hierarchical approach for emotion cause analysis. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5614–5624 (2019)
Fan, C., Yuan, C., Du, J., Gui, L., Yang, M., Xu, R.: Transition-based directed graph construction for emotion-cause pair extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3707–3717 (2020)
Fan, C., Yuan, C., Gui, L., Zhang, Y., Xu, R.: Multi-task sequence tagging for emotion-cause pair extraction via tag distribution refinement. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 2339–2350 (2021)
Gao, K., Xu, H., Wang, J.: A rule-based approach to emotion cause detection for Chinese micro-blogs. Expert Syst. Appl. 42(9), 4517–4528 (2015)
Gui, L., Xu, R., Wu, D., Lu, Q., Zhou, Y.: Event-driven emotion cause extraction with corpus construction. In: Social Media Content Analysis: Natural Language Processing and Beyond, pp. 145–160. World Scientific (2018)
Gui, L., Yuan, L., Xu, R., Liu, B., Lu, Q., Zhou, Yu.: Emotion cause detection with linguistic construction in Chinese Weibo text. In: Zong, C., Nie, J.-Y., Zhao, D., Feng, Y. (eds.) NLPCC 2014. CCIS, vol. 496, pp. 457–464. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45924-9_42
Lee, S.Y.M., Chen, Y., Huang, C.R.: A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pp. 45–53 (2010)
Li, X., Feng, S., Wang, D., Zhang, Y.: Context-aware emotion cause analysis with multi-attention-based neural network. Knowl.-Based Syst. 174, 205–218 (2019)
Mohammad, S.M.: Sentiment analysis: detecting valence, emotions, and other affectual states from text. In: Emotion Measurement, pp. 201–237. Elsevier, Amsterdam (2016)
Ou, G., et al.: Exploiting community emotion for microblog event detection. In: Social Media Content Analysis: Natural Language Processing and Beyond, pp. 439–456. World Scientific (2018)
Qadir, A., Riloff, E.: Learning emotion indicators from tweets: hashtags, hashtag patterns, and phrases. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1203–1209 (2014)
Russo, I., Caselli, T., Rubino, F., Boldrini, E., Martínez-Barco, P., et al.: EmoCause: an easy-adaptable approach to emotion cause contexts. In: Association for Computational Linguistics (ACL) (2011)
Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Song, H., Zhang, C., Li, Q., Song, D.: End-to-end emotion-cause pair extraction via learning to link. arXiv preprint arXiv:2002.10710 (2020)
Tang, H., Ji, D., Zhou, Q.: Joint multi-level attentional model for emotion detection and emotion-cause pair extraction. Neurocomputing 409, 329–340 (2020)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wei, P., Zhao, J., Mao, W.: Effective inter-clause modeling for end-to-end emotion-cause pair extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3171–3181 (2020)
Xia, R., Ding, Z.: Emotion-cause pair extraction: a new task to emotion analysis in texts. arXiv preprint arXiv:1906.01267 (2019)
Xia, R., Zhang, M., Ding, Z.: RTHN: a RNN-transformer hierarchical network for emotion cause extraction. arXiv preprint arXiv:1906.01236 (2019)
Xu, B., Lin, H., Lin, Y., Diao, Y., Yang, L., Xu, K.: Extracting emotion causes using learning to rank methods from an information retrieval perspective. IEEE Access 7, 15573–15583 (2019)
Yada, S., Ikeda, K., Hoashi, K., Kageura, K.: A bootstrap method for automatic rule acquisition on emotion cause extraction. In: 2017 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 414–421. IEEE (2017)
Yadollahi, A., Shahraki, A.G., Zaiane, O.R.: Current state of text sentiment analysis from opinion to emotion mining. ACM Comput. Surv. (CSUR) 50(2), 1–33 (2017)
Zhang, S., Wei, Z., Wang, Y., Liao, T.: Sentiment analysis of Chinese micro-blog text based on extended sentiment dictionary. Futur. Gener. Comput. Syst. 81, 395–403 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, C., Ding, J. (2022). Emotion-Cause Pair Extraction via Transformer-Based Interaction Model with Text Capsule Network. In: Lu, W., Huang, S., Hong, Y., Zhou, X. (eds) Natural Language Processing and Chinese Computing. NLPCC 2022. Lecture Notes in Computer Science(), vol 13551. Springer, Cham. https://doi.org/10.1007/978-3-031-17120-8_60
Download citation
DOI: https://doi.org/10.1007/978-3-031-17120-8_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17119-2
Online ISBN: 978-3-031-17120-8
eBook Packages: Computer ScienceComputer Science (R0)
