Skip Abstract Section
Abstract
Modeling conversational context is an essential step for emotion recognition in conversations. Existing works still suffer from insufficient utilization of local context information and remote context information. This article designs a hypergraph neural network, namely HNN-ERC, to better utilize local and remote contextual information. HNN-ERC combines the recurrent neural network with the conventional hypergraph neural network to strengthen connections between utterances and make each utterance receive information from other utterances better. The proposed model has empirically achieved state-of-the-art results on three benchmark datasets, demonstrating the effectiveness and superiority of the new model.
- [1] . 2019. COMET: Commonsense transformers for automatic knowledge graph construction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 4762–4779.
DOI: Google Scholar
Cross Ref
- [2] . 2008. IEMOCAP: Interactive emotional dyadic motion capture database. Language Resources and Evaluation 42, 4 (2008), 335–359.
DOI: Google ScholarCross Ref - [3] . 2019. SemEval-2019 Task 3: Emocontext contextual emotion detection in text. In Proceedings of the 13th International Workshop on Semantic Evaluation. Association for Computational Linguistics, 39–48.
DOI: Google ScholarCross Ref - [4] . 2020. Be more with less: Hypergraph attention networks for inductive text classification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Online, 4927–4936.
DOI: Google ScholarCross Ref - [5] . 2019. Hypergraph neural networks. In Proceedings ofthe 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, the 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, January 27 - February 1, 2019. AAAI Press, 3558–3565.
DOI: Google ScholarDigital Library
- [6] . 2020. COSMIC: COmmonsense knowledge for emotion identification in conversations. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, Online, 2470–2481.
DOI: Google ScholarCross Ref - [7] . 2019. DialogueGCN: A graph convolutional neural network for emotion recognition in conversation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 154–164.
DOI: Google ScholarCross Ref - [8] . 2021. DialogueCRN: Contextual reasoning networks for emotion recognition in conversations. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, 7042–7052.
DOI: Google ScholarCross Ref - [9] . 2021. MMGCN: Multimodal fusion via deep graph convolution network for emotion recognition in conversation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, 5666–5675.
DOI: Google ScholarCross Ref - [10] . 2020. Relation-aware graph attention networks with relational position encodings for emotion recognition in conversations. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Online, 7360–7370.
DOI: Google ScholarCross Ref - [11] . 2021. Graph based network with contextualized representations of turns in dialogue. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 443–455.
DOI: Google ScholarCross Ref - [12] . 2021. Past, present, and future: Conversational emotion recognition through structural modeling of psychological knowledge. In Findings of the Association for Computational Linguistics: EMNLP 2021. Association for Computational Linguistics, 1204–1214.
DOI: Google ScholarCross Ref - [13] Wei Li, Wei Shao, Shaoxiong Ji, and Erik Cambria. 2022. BiERU: Bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467 (2022), 73–82. Google ScholarDigital Library
- [14] . 2017. Dailydialog: A manually labelled multi-turn dialogue dataset. In Proceedings of the 8th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Asian Federation of Natural Language Processing, 986–995. Retrieved from https://aclanthology.org/I17-1099Google Scholar
- [15] . 2019. RoBERTa: A robustly optimized BERT pretraining approach.
arxiv:1907.11692. Retrieved from http://arxiv.org/abs/1907.11692Google Scholar - [16] . 2020. An iterative emotion interaction network for emotion recognition in conversations. In Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics, 4078–4088.
DOI: Google ScholarCross Ref - [17] Hui Ma, Jian Wang, Hongfei Lin, Xuejun Pan, Yijia Zhang, and Zhihao Yang. 2022. A multi-view network for real-time emotion recognition in conversations. Knowledge-Based Systems 236 (2022), 107751. Google ScholarDigital Library
- [18] . 2019. DialogueRNN: An attentive RNN for emotion detection in conversations. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence and 31st Innovative Applications of Artificial Intelligence Conference and 9th AAAI Symposium on Educational Advances in Artificial Intelligence. AAAI Press, Article
837 , 8 pages.DOI: Google ScholarDigital Library - [19] . 2019. MELD: A multimodal multi-party dataset for emotion recognition in conversations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 527–536.
DOI: Google ScholarCross Ref - [20] Soujanya Poria, Navonil Majumder, Rada Mihalcea, and Eduard Hovy. 2019. Emotion recognition in conversation: Research challenges, datasets, and recent advances. IEEE Access 7 (16 July 2019), 100943–100953. Google ScholarCross Ref
- [21] . 2019. Towards empathetic open-domain conversation models: A new benchmark and dataset. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 5370–5381.
DOI: Google ScholarCross Ref - [22] Minjie Ren, Xiangdong Huang, Wenhui Li, Dan Song, and Weizhi Nie. 2022. LR-GCN: Latent relation-aware graph convolutional network for conversational emotion recognition. IEEE Transactions on Multimedia 24 (2022), 4422–4432. Google ScholarCross Ref
- [23] . 2007. Learning with Hypergraphs: Clustering, Classification, and Embedding. MIT Press, 1601–1608. Retrieved from https://ieeexplore.ieee.org/document/6287378Google Scholar
- [24] . 2021. Directed acyclic graph network for conversational emotion recognition. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, 1551–1560.
DOI: Google ScholarCross Ref - [25] . 2020. Summarize before aggregate: A global-to-local heterogeneous graph inference network for conversational emotion recognition. In Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics, 4153–4163.
DOI: Google ScholarCross Ref - [26] . 2017. ConceptNet 5.5: An open multilingual graph of general knowledge. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, and (Eds.). AAAI Press, 4444–4451. Retrieved from http://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14972Google ScholarCross Ref
- [27] . 2021. Heterogeneous hypergraph embedding for graph classification. In Proceedings of the WSDM ’21, The 14th ACM International Conference on Web Search and Data Mining, , , , , and (Eds.). ACM, 725–733.
DOI: Google ScholarDigital Library - [28] . 2021. A discourse-aware graph neural network for emotion recognition in multi-party conversation. In Findings of the Association for Computational Linguistics: EMNLP 2021. Association for Computational Linguistics, 2949–2958.
DOI: Google ScholarCross Ref - [29] . 2021. Session-based recommendation with hypergraph attention networks. In Proceedings of the 2021 SIAM International Conference on Data Mining, Virtual Event, April 29 - May 1, 2021, and (Eds.). SIAM, 82–90.
DOI: Google ScholarCross Ref - [30] . 2020. Contextualized emotion recognition in conversation as sequence tagging. In Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue. Association for Computational Linguistics, 1st virtual meeting, 186–195. Retrieved from https://aclanthology.org/2020.sigdial-1.23Google ScholarCross Ref
- [31] . 2021. Knowledge-interactive network with sentiment polarity intensity-aware multi-task learning for emotion recognition in conversations. In Findings of the Association for Computational Linguistics: EMNLP 2021. Association for Computational Linguistics, 2879–2889.
DOI: Google ScholarCross Ref - [32] . 2020. Hypergraph convolutional recurrent neural network. In Proceedings of the KDD ’20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, , , , and (Eds.). ACM, 3366–3376.
DOI: Google ScholarDigital Library - [33] . 2018. Emotion detection on TV show transcripts with sequence-based convolutional neural networks. In The Workshops of the The 32nd AAAI Conference on Artificial Intelligence (AAAI Technical Report), Vol. WS-18. AAAI Press, 44–52. Retrieved from https://aaai.org/ocs/index.php/WS/AAAIW18/paper/view/16434Google Scholar
- [34] . 2020. Knowledge aware emotion recognition in textual conversations via multi-task incremental transformer. In Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics, 4429–4440.
DOI: Google ScholarCross Ref - [35] . 2019. Knowledge-enriched transformer for emotion detection in textual conversations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 165–176.
DOI: Google ScholarCross Ref - [36] . 2021. Topic-driven and knowledge-aware transformer for dialogue emotion detection. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, 1571–1582.
DOI: Google ScholarCross Ref
Index Terms
- Hypergraph Neural Network for Emotion Recognition in Conversations
Recommendations
MHG-ERC: Multi-hypergraph Feature Aggregation Network for Emotion Recognition in Conversations
The modeling of conversational context is an essential step in Emotion Recognition in Conversations (ERC). To maintain high performance and a low GPU memory consumption, this article proposes a new idea of using multiple hypergraphs to model the ...
Emotion recognition using neural networks
NN'09: Proceedings of the 10th WSEAS international conference on Neural networksSpeech and emotion recognition improve the quality of human computer interaction and allow more easy to use interfaces for every level of user in software applications. In this study, we have developed the emotion recognition neural network (ERNN) to ...
Comments