Skip to main content
SpringerLink
Log in

An effective multi-task learning model for end-to-end emotion-cause pair extraction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Emotion-cause pair extraction (ECPE), as an extended research direction of emotion cause extraction, aims to extract emotion and its corresponding causes for a given document. Previous methods solved this problem in a two-stage fashion. Nevertheless, these methods suffered from the problem of error propagation. Moreover, there exists the problem of label imbalance for the ECPE task. In order to solve the above problems, in this paper, we propose a novel end-to-end multi-task learning model which contains a shared module and a task-specific module to simultaneously perform emotion extraction, cause extraction, and emotion-cause pair extraction. The above three tasks share the shallow sharing module, and the shared information among mining tasks is realized to achieve mutual benefit. Then each task generates task-specific features and completes the corresponding tasks in the task-specific module. In addition, we propose a sampling-based method to construct the training set for the ECPE task to alleviate the problem of label imbalance and enable our model to focus on extracting the pairs with the corresponding emotion-cause relationship. Experimental results show that our model outperforms many strong baselines with 75.48%, 75.57%, and 75.03% in P, R, and F1 score, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Lee SYM, Chen Y, Huang CR (2010) A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text. Association for Computational Linguistics, pp 45–53

  2. Chen Y, Lee SYM, Li S, Huang CR (2010) Emotion cause detection with linguistic constructions. In: Proceedings of the 23rd international conference on computational linguistics (COLING), pp 179–187

  3. Gui L, Wu D, Xu R, Lu Q, Zhou Y (2016) Event-driven emotion cause extraction with corpus construction. In: Proceedings of the 2016 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, pp 1639–1649

  4. Gui L, Hu J, He Y, Xu R, Lu Q, Du J (2017) A question answering approach for emotion cause extraction. In: Proceedings of the 2017 conference on empirical methods in natural language processing (EMNLP), pp 1593–1602

  5. Li X, Song K, Feng S, Wang D, Zhang Y (2018) A co-attention neural network model for emotion cause analysis with emotional context awareness. In: Proceedings of the 2018 conference on empirical methods in natural language processing (EMNLP), pp 4752–4757

  6. Yu X, Rong W, Zhang Z, Ouyang Y, Xiong Z (2019) Multiple level hierarchical network-based clause selection for emotion cause extraction. IEEE Access 7:9071–9079

    Article  Google Scholar 

  7. Ding Z, He H, Zhang M, Xia R (2019) From independent prediction to reordered prediction: Integrating relative position and global label information to emotion cause identification. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), vol 33, pp 6343–6350

  8. Xia R, Zhang M, Ding Z (2019) RTHN: A RNN-Transformer hierarchical network for emotion cause extraction. In: Proceedings of the 28th international joint conference on artficial intelligence (IJCAI), pp 5285–5291

  9. Xia R, Ding Z (2019) Emotion-cause pair extraction: A new task to emotion analysis in texts. In: Proceedings of the 57th annual meeting of the association for computational linguistics (ACL). Association for Computational Linguistics, pp 1003–1012

  10. Wei P, Zhao J, Mao W (2020) Effective inter-clause modeling for endto-end emotion-cause pair extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics (ACL), pp 3171–3181

  11. Yuan C, Fan C, Bao J, Xu R (2020) Emotion-cause pair extraction as sequence labeling based on a novel tagging scheme. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp 3568–3573

  12. Ding Z, Xia R, Yu J (2020) ECPE-2D: Emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction. In: Proceedings of the 58th annual meeting of the association for computational linguistics (ACL), pp 3161–3170

  13. Ding Z, Xia R, Yu J (2020) End-to-end emotion-cause pair extraction based on sliding window multi-label learning. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp 3574–3583

  14. Tang H, Ji D, Zhou Q (2020) Joint multi-level attentional model for emotion detection and emotion-cause pair extraction. Neurocomputing 409:329–340

    Article  Google Scholar 

  15. Wu S, Chen F, Wu F, Huang Y, Li X (2020) A multi-task learning neural network for emotion-cause pair extraction. In: Proceedings of the 24th european conference on artificial intelligence (ECAI), pp 1–8

  16. Song H, Song D (2021) An end-to-end multi-task learning to link framework for emotion-cause pair extraction. In: Proceedings of the 2021 international conference on image, video processing and artificial intelligence (ICPAI), vol 12076, pp 13–21

  17. Chen Y, Hou W, Li S, Wu C, Zhang X (2020) End-to-end emotion-cause pair extraction with graph convolutional network. In: Proceedings of the 28th international conference on computational linguistics (COLING), pp 198–207

  18. Hu G, Lu G, Zhao Y (2021) FSS-GCN: A graph convolutional networks with fusion of semantic and structure for emotion

  19. Yu J, Liu W, He Y, Zhang C (2021) A mutually auxiliary multitask model with self-distillation for emotion-cause pair extraction. IEEE Access 9:26811–26821

    Article  Google Scholar 

  20. Devlin J, Chang MW, Lee K, Toutanova K (2019) BERT: Pre-training Of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies (NAACL), vol 1, pp 4171–4186

  21. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Proceedings of the 31st international conference on neural information processing systems (NIPS), pp 6000–6010

  22. Zhang C, Li Q, Song D, Wang B (2020) A multi-task learning framework for opinion triplet extraction. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp 819–828

  23. Wang SM, Ku LW (2016) ANTUSD: A large Chinese sentiment dictionary. In: Proceedings of the 10th international conference on language resources and evaluation (LREC), pp 2697–2702

  24. Veličković P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph Attention Networks. International conference on learning representations (ICLR)

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China under Grant number: 2020AAA0105101, the National Natural Science Foundation of China (No. 61976182), and the Sichuan Key R&D project (Nos. 2022YFH0020, 2021YFG0136).

Author information

Authors and Affiliations

  1. School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, 611756, China

    Chenbing Li, Jie Hu, Tianrui Li, Shengdong Du & Fei Teng

Authors
  1. Chenbing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tianrui Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shengdong Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fei Teng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie Hu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, C., Hu, J., Li, T. et al. An effective multi-task learning model for end-to-end emotion-cause pair extraction. Appl Intell 53, 3519–3529 (2023). https://doi.org/10.1007/s10489-022-03637-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03637-7

Keywords

Search

Navigation