Abstract
Emotion Recognition in Conversations (ERC) has recently gained much attention from the NLP community. The contextual information and the dependency information are two key factors that contribute to the ERC task. Unfortunately, most of the existing approaches concentrate on mining contextual information while neglecting the dependency information. To address this problem, we propose a Dependency-Aware Graph Convolutional Network (DA-GCN) to jointly take advantage of these two kinds of information. The core module is a proposed dependency-aware graph interaction layer where a GCN is constructed and operates directly on the dependency tree of the utterance, achieving to consider the dependency information. In addition, the proposed layer can be stacked to further enhance the embeddings with multiple steps of propagation. Experimental results on three datasets show that our model achieves the state-of-the-art performance. Furthermore, comprehensive analysis empirically verifies the effectiveness of leveraging the dependency information and the multi-step propagation mechanism.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alswaidan, N., Menai, M.E.B.: A survey of state-of-the-art approaches for emotion recognition in text. Knowl. Inf. Syst. 62(8), 2937–2987 (2020)
Ayata, D., Yaslan, Y., Kamasak, M.E.: Emotion based music recommendation system using wearable physiological sensors. IEEE Trans. Consum. Electron. 64(2), 196–203 (2018)
Busso, C., et al.: IEMOCAP: interactive emotional dyadic motion capture database. Lang. Resour. Eval. 42(4), 335–359 (2008). https://doi.org/10.1007/s10579-008-9076-6
Coleman, J.R., Lester, K.J., Keers, R., Munafò, M.R., Breen, G., Eley, T.C.: Genome-wide association study of facial emotion recognition in children and association with polygenic risk for mental health disorders. Am. J. Med. Genet. B Neuropsychiatr. Genet. 174(7), 701–711 (2017)
Ghosal, D., Majumder, N., Poria, S., Chhaya, N., Gelbukh, A.: DialogueGCN: a graph convolutional neural network for emotion recognition in conversation. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 154–164 (2019)
Gu, Y., et al.: Human conversation analysis using attentive multimodal networks with hierarchical encoder-decoder. In: Proceedings of the 26th ACM International Conference on Multimedia, pp. 537–545 (2018)
Gu, Y., et al.: Mutual correlation attentive factors in dyadic fusion networks for speech emotion recognition. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 157–166 (2019)
Hazarika, D., Poria, S., Zadeh, A., Cambria, E., Morency, L.P., Zimmermann, R.: Conversational memory network for emotion recognition in dyadic dialogue videos. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 2122–2132 (2018)
Hazarika, D., Poria, S., Zimmermann, R., Mihalcea, R.: Conversational transfer learning for emotion recognition. Inf. Fusion 65, 1–12 (2021)
Jiao, W., Lyu, M., King, I.: Exploiting unsupervised data for emotion recognition in conversations. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pp. 4839–4846 (2020)
Jiao, W., Lyu, M., King, I.: Real-time emotion recognition via attention gated hierarchical memory network. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 8002–8009 (2020)
Kratzwald, B., Ilić, S., Kraus, M., Feuerriegel, S., Prendinger, H.: Deep learning for affective computing: text-based emotion recognition in decision support. Decis. Support Syst. 115, 24–35 (2018)
Li, J., Fei, H., Ji, D.: Modeling local contexts for joint dialogue act recognition and sentiment classification with Bi-channel dynamic convolutions. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 616–626 (2020)
Li, Q., Gkoumas, D., Sordoni, A., Nie, J.Y., Melucci, M.: Quantum-inspired neural network for conversational emotion recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 13270–13278 (2021)
Li, Y., Su, H., Shen, X., Li, W., Cao, Z., Niu, S.: DailyDialog: a manually labelled multi-turn dialogue dataset. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 986–995 (2017)
Lian, Z., Liu, B., Tao, J.: CTNet: conversational transformer network for emotion recognition. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 985–1000 (2021)
Majumder, N., Poria, S., Hazarika, D., Mihalcea, R., Gelbukh, A., Cambria, E.: DialogueRNN: an attentive RNN for emotion detection in conversations. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 6818–6825 (2019)
Oramas Bustillos, R., Zatarain Cabada, R., Barrón Estrada, M.L., Hernández Pérez, Y.: Opinion mining and emotion recognition in an intelligent learning environment. Comput. Appl. Eng. Educ. 27(1), 90–101 (2019)
Poria, S., Cambria, E., Hazarika, D., Majumder, N., Zadeh, A., Morency, L.P.: Context-dependent sentiment analysis in user-generated videos. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (volume 1: Long papers), pp. 873–883 (2017)
Poria, S., Hazarika, D., Majumder, N., Naik, G., Cambria, E., Mihalcea, R.: MELD: a multimodal multi-party dataset for emotion recognition in conversations. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 527–536 (2019)
Qiu, X.P., Sun, T.X., Xu, Y.G., Shao, Y.F., Dai, N., Huang, X.J.: Pre-trained models for natural language processing: a survey. Sci. China Technol. Sci. 63(10), 1872–1897 (2020). https://doi.org/10.1007/s11431-020-1647-3
Ren, M., Huang, X., Shi, X., Nie, W.: Interactive multimodal attention network for emotion recognition in conversation. IEEE Signal Process. Lett. 28, 1046–1050 (2021)
Shaheen, S., El-Hajj, W., Hajj, H., Elbassuoni, S.: Emotion recognition from text based on automatically generated rules. In: 2014 IEEE International Conference on Data Mining Workshop, pp. 383–392. IEEE (2014)
Vaswani, A., et al.: Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 6000–6010 (2017)
Wang, Z., Wan, Z., Wan, X.: BAB-QA: a new neural model for emotion detection in multi-party dialogue. In: Yang, Q., Zhou, Z.-H., Gong, Z., Zhang, M.-L., Huang, S.-J. (eds.) PAKDD 2019. LNCS (LNAI), vol. 11439, pp. 210–221. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-16148-4_17
Zhang, D., Chen, X., Xu, S., Xu, B.: Knowledge aware emotion recognition in textual conversations via multi-task incremental transformer. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 4429–4440 (2020)
Zhang, R., Wang, Z., Huang, Z., Li, L., Zheng, M.: Predicting emotion reactions for human-computer conversation: a variational approach. IEEE Trans. Hum.-Mach. Syst. 62(8), 2937–2987 (2021)
Zhang, Y., et al.: A quantum-like multimodal network framework for modeling interaction dynamics in multiparty conversational sentiment analysis. Inf. Fusion 62, 14–31 (2020)
Zhang, Y., et al.: Learning interaction dynamics with an interactive LSTM for conversational sentiment analysis. Neural Netw. 133, 40–56 (2021)
Acknowledgments
This work was supported by the National Key R&D Program of China via grant 2020YFB1406902.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Xie, Y., Sun, C., Liu, B., Ji, Z. (2021). DA-GCN: A Dependency-Aware Graph Convolutional Network for Emotion Recognition in Conversations. In: Mantoro, T., Lee, M., Ayu, M.A., Wong, K.W., Hidayanto, A.N. (eds) Neural Information Processing. ICONIP 2021. Lecture Notes in Computer Science(), vol 13110. Springer, Cham. https://doi.org/10.1007/978-3-030-92238-2_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-92238-2_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92237-5
Online ISBN: 978-3-030-92238-2
eBook Packages: Computer ScienceComputer Science (R0)