skip to main content
10.1145/3486622.3493935acmconferencesArticle/Chapter ViewAbstractPublication PageswiConference Proceedingsconference-collections
research-article

A Label Extension Schema for Improved Text Emotion Classification

Published: 13 April 2022 Publication History

Abstract

Due to the subjectiveness and fuzziness of emotions in texts, researchers have been aware that it is ubiquitous to observe multiple emotions in a sentence, and the one-hot label approach is not informative enough in emotion-relevant text classification tasks. Therefore, to facilitate the classification task, recent works focus on generating and employing a coarse-grained emotion distribution, which is based on coarse-grained labels provided by the underlying dataset. Although such methods can alleviate the problem of overfitting and improve robustness, they may cause inter-class confusion between similar emotion categories and introduce undesirable noise during training. Meanwhile, current studies neglect the fine-grained emotions associated with these coarse-grained labels. To address the issue caused by utilizing a coarse-grained distribution, we propose in this paper a general and novel emotion label extension method based on fine-grained emotions. Specifically, we first identify a mapping function between coarse-grained emotions and fine-grained emotion concepts, and extend the original label space with specific fine-grained emotions. Then, we generate a fine-grained emotion distribution by employing a rule-based method, and utilize it as a model constraint to incorporate the dependencies among fine-grained emotions to predict the original coarse-grained emotion labels. We conduct extensive experiments to demonstrate the effectiveness of our proposed label extension method. The results indicate that our proposed method can produce notable improvements over baseline models on the applied datasets.

References

[1]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. In Proceedings of the 3rd International Conference on Learning Representations.
[2]
Erik Cambria, Yang Li, Frank Z. Xing, Soujanya Poria, and Kenneth Kwok. 2020. SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. Association for Computing Machinery, 105––114.
[3]
Junyoung Chung, Çaglar Gülçehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. CoRR abs/1412.3555(2014). arxiv:1412.3555
[4]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171–4186.
[5]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4171–4186.
[6]
Paul Ekman. 1992. An argument for basic emotions. Cognition & emotion 6, 3-4 (1992), 169–200.
[7]
Hao Fei, Yue Zhang, Yafeng Ren, and Donghong Ji. 2020. Latent Emotion Memory for Multi-Label Emotion Classification. Proceedings of the AAAI Conference on Artificial Intelligence 34, 05 (Apr. 2020), 7692–7699. https://doi.org/10.1609/aaai.v34i05.6271
[8]
Bin-Bin Gao, Chao Xing, Chen-Wei Xie, Jianxin Wu, and Xin Geng. 2017. Deep Label Distribution Learning with Label Ambiguity. IEEE Transactions on Image Processing 26, 6 (2017), 2825–2838.
[9]
Xin Geng. 2016. Label Distribution Learning. IEEE Transactions on Knowledge and Data Engineering 28, 7(2016), 1734–1748.
[10]
Sujatha Das Gollapalli, Polina Rozenshtein, and See-Kiong Ng. 2020. ESTeR: Combining Word Co-occurrences and Word Associations for Unsupervised Emotion Detection. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, 1043–1056.
[11]
A. Graves, N. Jaitly, and A. Mohamed. 2013. Hybrid speech recognition with Deep Bidirectional LSTM. In 2013 IEEE Workshop on Automatic Speech Recognition and Understanding. 273–278. https://doi.org/10.1109/ASRU.2013.6707742
[12]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computing 9, 8 (Nov. 1997), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
[13]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 1746–1751.
[14]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6980
[15]
Xianming Li, Zongxi Li, Haoran Xie, and Qing Li. 2021. Merging Statistical Feature via Adaptive Gate for Improved Text Classification. Proceedings of the AAAI Conference on Artificial Intelligence 35, 15 (May 2021), 13288–13296. https://ojs.aaai.org/index.php/AAAI/article/view/17569
[16]
Zongxi Li, Xinhong Chen, Haoran Xie, Qing Li, and Xiaohui Tao. 2020. Exploring Emotional Construction Towards Multi-Class Emotion Classification. In 2020 IEEE/WIC/ACM International Conference on Web Intelligence (WI). 1–8.
[17]
Zongxi Li, Haoran Xie, Gary Cheng, and Qing Li. 2021. Word-level emotion distribution with two schemas for short text emotion classification. Knowledge-Based Systems(2021), 107163. https://doi.org/10.1016/j.knosys.2021.107163
[18]
Weiming Liang, Haoran Xie, Yanghui Rao, Raymond Y.K. Lau, and Fu Lee Wang. 2018. Universal affective model for Readers’ emotion classification over short texts. Expert Systems with Applications 114 (2018), 322–333.
[19]
Saif M. Mohammad. 2012. Emotional Tweets. In Proceedings of the First Joint Conference on Lexical and Computational Semantics-Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation. Association for Computational Linguistics, 246–255.
[20]
Saif M. Mohammad. 2018. Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, 174–184.
[21]
Karo Moilanen and Stephen Pulman. 2007. Sentiment Composition. In Proceedings of the Recent Advances in Natural Language Processing International Conference. Association for Computational Linguistics, 378–382.
[22]
J. Pang, Y. Rao, H. Xie, X. Wang, F. L. Wang, T. L. Wong, and Q. Li. 2019. Fast Supervised Topic Models for Short Text Emotion Detection. IEEE Transactions on Cybernetics(2019), 1–14.
[23]
Robert Plutchik. 1980. Chapter 1 - A General Psychoevolutionary Theory of Emotion. In Theories of Emotion. Academic Press, 3–33.
[24]
James A. Russell. 1980. A Circumplex Model of Affect. Journal of personality and social psychology 39, 6(1980), 1161.
[25]
James A. Russell and Albert Mehrabian. 1977. Evidence for A Three-factor Theory of Emotions. Journal of research in Personality 11, 3 (1977), 273–294.
[26]
Klaus R. Scherer and Harald G. Wallbott. 1994. Evidence for Universality and Cultural Variation of Differential Emotion Response Patterning. Journal of personality and social psychology 66, 2(1994), 310–328.
[27]
Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Ng, and Christopher Potts. 2013. Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1631–1642.
[28]
Y. Susanto, A. G. Livingstone, B. C. Ng, and E. Cambria. 2020. The Hourglass Model Revisited. IEEE Intelligent Systems 35, 5 (2020), 96–102.
[29]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Proceedings of Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Vol. 30. Curran Associates, Inc., 5998–6008.
[30]
Chang Wang and Bang Wang. 2020. An End-to-End Topic-Enhanced Self-Attention Network for Social Emotion Classification. In Proceedings of The Web Conference 2020(WWW ’20). Association for Computing Machinery, 2210–2219.
[31]
Chang Wang, Bang Wang, Wei Xiang, and Minghua Xu. 2019. Encoding Syntactic Dependency and Topical Information for Social Emotion Classification. In Proceedings of the 42nd International ACM SIGIR Conference(SIGIR’19). Association for Computing Machinery, 881––884.
[32]
Ning Xu, Yun-Peng Liu, and Xin Geng. 2020. Partial Multi-Label Learning with Label Distribution. Proceedings of the AAAI Conference on Artificial Intelligence 34, 04 (Apr. 2020), 6510–6517. https://doi.org/10.1609/aaai.v34i04.6124
[33]
C. T. Yang and Y. L. Chen. 2020. DACNN: Dynamic Weighted Attention with Multi-channel Convolutional Neural Network for Emotion Recognition. In 2020 21st IEEE International Conference on Mobile Data Management (MDM). 316–321.
[34]
Xiang Zhang, Junbo Jake Zhao, and Yann LeCun. 2015. Character-level Convolutional Networks for Text Classification. In Proceedings of Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015. 649–657.
[35]
Yuxiang Zhang, Jiamei Fu, Dongyu She, Ying Zhang, Senzhang Wang, and Jufeng Yang. 2018. Text Emotion Distribution Learning via Multi-Task Convolutional Neural Network. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18. International Joint Conferences on Artificial Intelligence Organization, 4595–4601.
[36]
Chunting Zhou, Chonglin Sun, Zhiyuan Liu, and F. C. M. Lau. 2015. A C-LSTM Neural Network for Text Classification. ArXiv (2015). https://arxiv.org/abs/1511.08630
[37]
Deyu Zhou, Xuan Zhang, Yin Zhou, Quan Zhao, and Xin Geng. 2016. Emotion Distribution Learning from Texts. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 638–647.

Cited By

View all
  • (2024)Fusion and Discrimination: A Multimodal Graph Contrastive Learning Framework for Multimodal Sarcasm DetectionIEEE Transactions on Affective Computing10.1109/TAFFC.2024.338037515:4(1874-1888)Online publication date: Oct-2024
  • (2023)A Reinforcement Learning Based Two-Stage Model for Emotion Cause Pair ExtractionIEEE Transactions on Affective Computing10.1109/TAFFC.2022.321864814:3(1779-1790)Online publication date: 1-Jul-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
December 2021
698 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. emotion classification
  2. label extension
  3. sentiment analysis

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Lingnan University, Hong Kong
  • Hong Kong Research Grants Council

Conference

WI-IAT '21
Sponsor:
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence
December 14 - 17, 2021
VIC, Melbourne, Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)24
  • Downloads (Last 6 weeks)6
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Fusion and Discrimination: A Multimodal Graph Contrastive Learning Framework for Multimodal Sarcasm DetectionIEEE Transactions on Affective Computing10.1109/TAFFC.2024.338037515:4(1874-1888)Online publication date: Oct-2024
  • (2023)A Reinforcement Learning Based Two-Stage Model for Emotion Cause Pair ExtractionIEEE Transactions on Affective Computing10.1109/TAFFC.2022.321864814:3(1779-1790)Online publication date: 1-Jul-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media