Abstract
The Causal Emotion Entailment (CEE) task aims to extract all potential pairs of emotions and corresponding causes from the unannotated emotion document in the conversational context. Most existing methods to solve CEE task follow a two-stage pipeline framework, in which the first stage is to identify emotional clauses and cause clauses and extract clause representation,separately. And in the second stage is to construct the final emotion and cause pairs. However, they ignore the effect of the distance between clauses on emotion-cause pair matching. Here, we construct a joint framework with Window Transformer to handle this problem. The pre-trained BERT and RoBERTa are used as the text encoder to generate a local representation of clauses in a given document. Meanwhile, we feed it into 2D Window Transformer to make the clause representation sensitive to the context within the Window and to obtain the dependencies between clauses. At the same time, the document ranks the candidate clauses to extract causal emotion entailments, which enhances the representation of clause pairs (emotion pairs and cause pairs) by kernel-based relative position embedding. Experimental results indicate that the framework acquires state-of-the-art results on the benchmark dataset.




Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
References
Alwaneen TH, Azmi AM, Aboalsamh HA, Cambria E, Hussain A (2022) Arabic question answering system: a survey. Artifi Intell Rev 55(1):207–253
Bhat A, Modi A (2022)“Multi-task learning framework for extracting emotion cause span and entailment in conversations,” arXiv preprint arXiv:2211.03742,
Cambria E, Schuller B, Xia Y, Havasi C (2013) New avenues in opinion mining and sentiment analysis. IEEE Intell Syst 28(2):15–21
Chen Y, Lee S Y M, Li S, Huang C R (2010) “Emotion cause detection with linguistic constructions,” in Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pp. 179–187
Ding Z, Xia R, Yu J (2020) “Ecpe-2d: emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3161–3170
Djordjevic V, Stojanovic V, Tao H, Song X, He S, Gao W (2022) Data-driven control of hydraulic servo actuator based on adaptive dynamic programming. Discrete Contin Dyn Syst-S 15(7):1633
Dragoni M, Donadello I, Cambria E (2022) Ontosenticnet 2: Enhancing reasoning within sentiment analysis. IEEE Intell Syst 37(2):103–110
Du J, Xu R, Wen Z (2017) “A symbolic representation approach of eeg signals for emotion recognition,” in 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC). 1 plus 0.5 minus 0.4IEEE, pp. 666–671
Fan C, Yan H, Du J, Gui L, Bing L, Yang M, Xu R, Mao R (2019) “A knowledge regularized hierarchical approach for emotion cause analysis,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5614–5624
Fan C, Yuan C, Du J, Gui L, Yang M, Xu R (2020) “Transition-based directed graph construction for emotion-cause pair extraction,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3707–3717
Fan C, Yuan C, Gui L, Zhang Y, Xu R (2021) Multi-task sequence tagging for emotion-cause pair extraction via tag distribution refinement. IEEE/ACM Transact Aud Speech Lang Process 29:2339–2350
Ghazi D, Inkpen D, Szpakowicz S (2015) “Detecting emotion stimuli in emotion-bearing sentences,” in International Conference on Intelligent Text Processing and Computational Linguistics. 1 plus 0.5 minus 0.4Springer, pp. 152–165
Gui L, Hu J, He Y, Xu R, Lu Q, Du J (2017) “A question answering approach for emotion cause extraction,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 1593–1602
Gui L, Xu R, Wu D, Lu Q, Zhou Y (2018)“Event-driven emotion cause extraction with corpus construction,” in Social Media Content Analysis: Natural Language Processing and Beyond. 1 plus 0.5 minus 0.4World Scientific, pp. 145–160
Huang D, Zhou S, Jiang D (2022) Generator-based domain adaptation method with knowledge free for cross-subject eeg emotion recognition. Cognit Comput 4:1–12
Jiang D, He Z, Lin Y, Chen Y, Xu L (2021) An improved unsupervised single-channel speech separation algorithm for processing speech sensor signals. Wireless Commun Mobile Comput 2021:1–13
Lee S Y M, Chen Y, Huang C R (2010) “A text-driven rule-based system for emotion cause detection,” in Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, pp. 45–53
Lee SYM, Chen Y, Huang C-R, Li S (2013) Detecting emotion causes with a linguistic rule-based approach 1. Comput Intell 29(3):390–416
Li W, Shao W, Ji S, Cambria E (2022) Bieru: Bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467:73–82
Li W, Xu H (2014) Text-based emotion classification using emotion cause extraction. Exp Syst App 41(4):1742–1749
Li Y, Su H, Shen X, Li W, Cao Z, Niu S (2017) “Dailydialog: A manually labelled multi-turn dialogue dataset,” in Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 986–995
Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019)“Roberta: A robustly optimized bert pretraining approach,” arXiv preprint arXiv:1907.11692
Liu Y, Du J, Li X, Xu R (2021) “Generating empathetic responses by injecting anticipated emotion,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1 plus 0.5 minus 0.4IEEE, pp. 7403–7407
Marcu D (2000)The theory and practice of discourse parsing and summarization. 1 plus 0.5 minus 0.4MIT press
Neviarouskaya A, Aono M (2013) “Extracting causes of emotions from text,” in Proceedings of the Sixth International Joint Conference on Natural Language Processing, pp. 932–936
Poria S, Cambria E, Gelbukh A (2015) “Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis,” in Proceedings of the 2015 conference on empirical methods in natural language processing, pp. 2539–2544
Poria S, Majumder N, Hazarika D, Ghosal D, Bhardwaj R, Jian SYB, Hong P, Ghosh R, Roy A, Chhaya N et al (2021) Recognizing emotion cause in conversations. Cognit Comput 13(5):1317–1332
Song H, Song D (2021) “An end-to-end multi-task learning to link framework for emotion-cause pair extraction,” in 2021 International Conference on Image, Video Processing, and Artificial Intelligence, Y. Zhang, Ed., vol. 12076, International Society for Optics and Photonics. 1 plus 0.5 minus 0.4SPIE, p. 1207604. [Online]. Available: https://doi.org/10.1117/12.2607175
Song X, Sun P, Song S, Stojanovic V (2022) Event-driven nn adaptive fixed-time control for nonlinear systems with guaranteed performance. J Franklin Inst 359(9):4138–4159
Stojanovic V, Nedic N (2016) Joint state and parameter robust estimation of stochastic nonlinear systems. Int J Robust Nonlinear Control 26(14):3058–3074
Tu G, Wen J, Liu C, Jiang D, Cambria E (2022)“Context- and sentiment-aware networks for emotion recognition in conversation,” IEEE Transactions on Artificial Intelligence, pp. 1–1
Tu G, Wen J, Liu H, Chen S, Zheng L, Jiang D (2022) Exploration meets exploitation: Multitask learning for emotion recognition based on discrete and dimensional models. Knowledge-Based Syst 235:107598
Turcan E, Wang S, Anubhai R, Bhattacharjee K, Al-Onaizan Y, Muresan S (2021) Multi-task learning and adapted knowledge models for emotion-cause extraction. Find Assoc Computat Linguistics: ACL-IJCNLP 2021:3975–3989
Valdivia A, Martinez-Camara E, Chaturvedi I, Luzon M, Cambria E, Ong Y-S, Herrera F (2020) What do people think about this monument? understanding negative reviews via deep learning, clustering and descriptive rules. J Ambient Intell Hum Comput 11(1):39–52
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Info Process Syst 30:5998–6008
Ding Z, Xia R, Yu J (2020) “End-to-end emotion-cause pair extraction based on sliding window multi-label learning,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3574–3583
Wang S, Du J, Xu R (2015) “Decision fusion for eeg-based emotion recognition,” in 2015 International Conference on Machine Learning and Cybernetics (ICMLC), vol. 2. 1 plus 0.5 minus 0.4IEEE, pp. 883–889
Wei P, Zhao J, Mao W (2020) “Effective inter-clause modeling for end-to-end emotion-cause pair extraction,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3171–3181
Wei T, Li X, Stojanovic V (2021) Input-to-state stability of impulsive reaction-diffusion neural networks with infinite distributed delays. Nonlin Dyn 103(2):1733–1755
Xia R, Zhang M, Ding Z (2019)“Rthn: A rnn-transformer hierarchical network for emotion cause extraction,” in Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19. 1 plus 0.5 minus 0.4International Joint Conferences on Artificial Intelligence Organization, 7 pp. 5285–5291. [Online]. Available: https://doi.org/10.24963/ijcai.2019/734
Xu R, Hu J, Lu Q, Wu D, Gui L (2017) An ensemble approach for emotion cause detection with event extraction and multi-kernel svms. Tsinghua Sci Technol 22(6):646–659
Yan H, Gui L, Pergola G, He Y (2021) “Position bias mitigation: A knowledge-aware graph model for emotion cause extraction,” in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 3364–3375
Yan H, Gao Q, Du J, Li B, Xu R (2019) “Adversarial training based cross-lingual emotion cause extraction,” in Proceedings of International Conference on Computational Linguistics and Intelligent Text Processing (CICLing)
Young T, Xing F, Pandelea V, Ni J, Cambria E (2022)“Fusing task-oriented and open-domain dialogues in conversational agents,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no.10, , pp. 11-622–11-629
Zhang D, Yang Z, Meng F, Chen X, Zhou J, (2022) “Tsam: A two-stream attention model for causal emotion entailment,” in Proceedings of the 29th International Conference on Computational Linguistics. 1 plus 0.5 minus 0.4Gyeongju, Republic of Korea: International Committee on Computational Linguistics, Oct. pp. 6762–6772. [Online]. Available: https://aclanthology.org/2022.coling-1.588
Zhou C, Tao H, Chen Y, Stojanovic V, Paszke W (2022) Robust point-to-point iterative learning control for constrained systems: A minimum energy approach. Int J Robust Nonlinear Control 32(18):10139–10161
Zhou S, Huang D, Liu C, Jiang D (2022) Objectivity meets subjectivity: A subjective and objective feature fused neural network for emotion recognition. Appl Soft Comput 122:108889
Acknowledgements
The authors would like to respect and thank all reviewers for their constructive and helpful review. This research is funded by the National Natural Science Foundation of China (62106136, 61902231), Natural Science Foundation of Guangdong Province (2019A1515010943), The Basic and Applied Basic Research of Colleges and Universities in Guangdong Province (Special Projects in Artificial Intelligence)(2019KZDZX1030), 2020 Li Ka Shing Foundation Cross-Disciplinary Research Grant (2020LKSFG04D), and Science and Technology Major Project of Guangdong Province (STKJ2021005).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jiang, D., Liu, H., Tu, G. et al. Window transformer for dialogue document: a joint framework for causal emotion entailment. Int. J. Mach. Learn. & Cyber. 14, 2697–2707 (2023). https://doi.org/10.1007/s13042-023-01792-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-023-01792-y