Abstract
Implicit emotional expressions, without using explicit emotion words, usually depend on rhetorics to vividly show the user’s emotions. Sentences carved with specific rhetorics tend to express certain types of emotions. Moreover, a hierarchical structure between emotional pleasure valences and categories exists in psychological sciences from coarse to fine, which helps human understand textual emotions. However, existing implicit emotion identification models ignore the hierarchy structure and the correlations between emotions and rhetorics. In this paper, we propose an implicit emotion identification model via hierarchical structure and rhetorical correlation, which consists of two major layers. Specifically, a hierarchical layer is designed to leverage hierarchical structure and provide coarse-grained emotional valences for identifying emotions, and a correlation layer to learn the latent correlation between emotions and rhetorics. Finally, supported by two layers, a novel multi-task learning model is proposed to train three related identification tasks of pleasure valences, emotions and rhetorics simultaneously, thus improving the overall performance of the emotion identification problem. Experimental results on the implicit emotion dataset demonstrate that the proposed model achieves 89.78% and 88.74% in terms of micro-F1 and weight-F1 metric respectively, outperforming the state-of-the-art methods consistently.
Similar content being viewed by others
References
Balazs J, Marrese-Taylor E, Matsuo Y (2018) Iiidyt at iest 2018: Implicit emotion classification with deep contextualized word representations. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 50–56
Chauhan DS, Dhanush S, Ekbal A, et al (2020) Sentiment and emotion help sarcasm? a multi-task learning framework for multi-modal sarcasm, sentiment and emotion analysis. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 4351–4360
Chen X, Hai Z, Li D, et al (2021) Jointly identifying rhetoric and implicit emotions via multi-task learning. In: Findings of the 59th Annual Meeting of the Association for Computational Linguistics, pp 1429–1434
Chronopoulou A, Margatina A, Baziotis C, et al (2018) Ntua-slp at iest 2018: Ensemble of neural transfer methods for implicit emotion classification. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 57–64
Dankers V, Rei M, Lewis M, et al (2019) Modelling the interplay of metaphor and emotion through multitask learning. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp 2218–2229
Devlin J, Chang MW, Lee K, et al (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 4171–4186
Kennedy GA (2009) A new history of classical rhetoric. Princeton University Press
Klinger R, De Clercq O, Mohammad S, et al (2018) Iest: Wassa-2018 implicit emotions shared task. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 31–42
Li C, Bao Z, Li L et al (2020) Exploring temporal representations by leveraging attention-based bidirectional lstm-rnns for multi-modal emotion recognition. Inform Process Manag 57(3):102–185. https://doi.org/10.1016/j.ipm.2019.102185
Liao J, Wang S, Li D (2019) Identification of fact-implied implicit sentiment based on multi-level semantic fused representation. Knowl-Based Syst 165:197–207
Liao J, Wang M, Chen X et al (2022) Dynamic commonsense knowledge fused method for chinese implicit sentiment analysis. Inform Process Manage 59(3):102. https://doi.org/10.1016/j.ipm.2022.102934
Lin TY, Goyal P, Girshick R, et al (2017) Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2980–2988
Liu L, Hu X, Song W, et al (2018) Neural multitask learning for simile recognition. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 1543–1553
Liu P, Qiu X, Huang XJ (2017) Adversarial multi-task learning for text classification. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp 1–10
Liu X, He P, Chen W, et al (2019) Multi-task deep neural networks for natural language understanding. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 4487–4496
Liu X, Wang Y, Ji J, et al (2020) The microsoft toolkit of multi-task deep neural networks for natural language understanding. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 118–126
Naderalvojoud B, Ucan A, Sezer EA (2018) Humir at iest-2018: Lexicon-sensitive and left-right context-sensitive bilstm for implicit emotion recognition. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 182–188
Niu Y, Xie R, Liu Z, et al (2017) Improved word representation learning with sememes. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp 2049–2058
Proisl T, Heinrich P, Kabashi B, et al (2018) Emotiklue at iest 2018: Topic-informed classification of implicit emotions. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 235–242
Ríssola E, Giachanou A, Crestani F (2018) Usi-ir at iest 2018: Sequence modeling and pseudo-relevance feedback for implicit emotion detection. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 231–234
Rozental A, Fleischer D, Kelrich Z (2018) Amobee at iest 2018: Transfer learning from language models. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 43–49
Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161
Song Y, Shi S, Li J, et al (2018) Directional skip-gram: Explicitly distinguishing left and right context for word embeddings. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 175–180
Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958
Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pp 1556–1566
Wang S, Zhou J, Sun C, et al (2022) Causal intervention improves implicit sentiment analysis. In: Proceedings of the 29th International Conference on Computational Linguistics, pp 6966–6977
Wei J, Liao J, Yang Z et al (2020) Bilstm with multi-polarity orthogonal attention for implicit sentiment analysis. Neurocomputing 383:165–173
Xu M, Wang D, Feng S, et al (2022) Kc-isa: An implicit sentiment analysis model combining knowledge enhancement and context features. In: Proceedings of the 29th International Conference on Computational Linguistics, pp 6906–6915
Zhang D, Lin H, Yang L, et al (2018) Construction of a chinese corpus for the analysis of the emotionality of metaphorical expressions. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp 144–150
Zhang G, Ananiadou S et al (2022) Examining and mitigating gender bias in text emotion detection task. Neurocomputing 493:422–434
Zhu M, Yue Z, Chen W, et al (2013) Fast and accurate shift-reduce constituent parsing. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pp 434–443
Acknowledgements
The authors would like to thank all anonymous reviewers for their valuable comments and suggestions which have significantly improved the quality and presentation of this paper. The works described in this paper are supported by the National Natural Science Foundation of China (No.62076158, 62106130, 62072294), the Fundamental Research Program of Shanxi Province (No.202103021223267, 20210302124084), the Scientific and Technological Innovation Programs of Higher Education Institutions in Shanxi (No.2021L297, 2021L284), the Taiyuan University of Science and Technology Scientific Reasearch Initial Funding (No.20212053, 20222107).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, X., Wang, S., Li, X. et al. Identifying implicit emotions via hierarchical structure and rhetorical correlation. Int. J. Mach. Learn. & Cyber. 14, 3753–3764 (2023). https://doi.org/10.1007/s13042-023-01862-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-023-01862-1