Abstract
Emotion recognition in text is an important natural language processing (NLP) task whose solution can benefit several applications in different fields, including data mining, e-learning, information filtering systems, human–computer interaction, and psychology. Explicit emotion recognition in text is the most addressed problem in the literature. The solution to this problem is mainly based on identifying keywords. Implicit emotion recognition is the most challenging problem to solve because such emotion is typically hidden within the text, and thus, its solution requires an understanding of the context. There are four main approaches for implicit emotion recognition in text: rule-based approaches, classical learning-based approaches, deep learning approaches, and hybrid approaches. In this paper, we critically survey the state-of-the-art research for explicit and implicit emotion recognition in text. We present the different approaches found in the literature, detail their main features, discuss their advantages and limitations, and compare them within tables. This study shows that hybrid approaches and learning-based approaches that utilize traditional text representation with distributed word representation outperform the other approaches on benchmark corpora. This paper also identifies the sets of features that lead to the best-performing approaches; highlights the impacts of simple NLP tasks, such as part-of-speech tagging and parsing, on the performances of these approaches; and indicates some open problems.
Similar content being viewed by others
Notes
References
Abdullah M, Shaikh S (2018) TeamUNCC at SemEval-2018 task 1: emotion detection in English and Arabic tweets using deep learning. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 350–357
Agrawal A, An A (2012) Unsupervised emotion detection from text using semantic and syntactic relations. In: Proceedings of the 2012 IEEE/WIC/ACM international joint conferences on web intelligence and intelligent agent technology. IEEE Computer Society, Washington, DC, WI-IAT ’12, pp 346–353
Agrawal P, Suri A (2019) NELEC at SemEval-2019 task 3: think twice before going deep. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 266–271
Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of the conference on human language technology and empirical methods in natural language processing. Association for Computational Linguistics, Stroudsburg, PA, HLT ’05, pp 579–586
Almahdawi A, Teahan WJ (2017) Emotion recognition in text using PPM. In: Bramer M, Petridis M (eds) Artificial intelligence XXXIV, vol 10630. Lecture notes in computer science. Springer, Cham, pp 149–155
Aman S, Szpakowicz S (2007) Identifying expressions of emotion in text. In: Proceedings of the 10th international conference on text, speech and dialogue, TSD’07. Springer, Berlin, pp 196–205
Aman S, Szpakowicz S (2008) Using roget’s thesaurus for fine-grained emotion recognition. In: Proceedings of the 3rd international joint conference on natural language processing (IJCNLP), pp 312–318
Amelia W, Maulidevi NU (2016) Dominant emotion recognition in short story using keyword spotting technique and learning-based method. In: 2016 International conference on advanced informatics: concepts, theory and application (ICAICTA), pp 1–6
Anusha V, Sandhya B (2015) A learning based emotion classifier with semantic text processing. In: El-Alfy MES, Thampi MS, Takagi H, Piramuthu S, Hanne T (eds) Advances in intelligent informatics. Springer, Cham, pp 371–382
Baccianella S, Esuli A, Sebastiani F (2010) Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the seventh conference on international language resources and evaluation (LREC’10). European Language Resources Association (ELRA), Valletta, vol 25, pp 2200–2204
Badaro G, Baly R, Hajj H, Habash N, El-Hajj W (2014) A large scale arabic sentiment lexicon for arabic opinion mining. In: Proceedings of the EMNLP 2014 workshop on arabic natural language processing (ANLP). Association for Computational Linguistics, pp 165–173
Badaro G, El Jundi O, Khaddaj A, Maarouf A, Kain R, Hajj H, El-Hajj W (2018) EMA at SemEval-2018 task 1: emotion mining for arabic. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 236–244
Badaro G, Jundi H, Hajj H, El-Hajj W, Habash N (2018) Arsel: a large scale arabic sentiment and emotion lexicon. In: The 3rd workshop on open-source arabic corpora and processing tools (OSACT3) co-located with LREC 2018
Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv:1409.0473
Bandhakavi A, Wiratunga N, Padmanabhan D, Massie S (2017) Lexicon based feature extraction for emotion text classification. Pattern Recognit Lett 93:133–142
Basile A, Franco-Salvador M, Pawar N, Štajner S, Chinea Rios M, Benajiba Y (2019) SymantoResearch at SemEval-2019 task 3: combined neural models for emotion classification in human-chatbot conversations. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 330–334
Baziotis C, Pelekis N, Doulkeridis C (2017) Datastories at semeval-2017 task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017). Association for Computational Linguistics, pp 747–754
Baziotis C, Nikolaos A, Chronopoulou A, Kolovou A, Paraskevopoulos G, Ellinas N, Narayanan S, Potamianos A (2018) NTUA-SLP at SemEval-2018 task 1: predicting affective content in tweets with deep attentive rnns and transfer learning. In: Proceedings of The 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 245–255
Biagioni R (2016) Senticnet. In: The SenticNet sentiment lexicon: exploring semantic richness in multi-word concepts. Springer, Cham, pp 17–31
Binali H, Potdar V (2012) Emotion detection state of the art. In: Proceedings of the CUBE international information technology conference, CUBE’12. ACM, New York, pp 501–507
Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Trans Assoc Comput Linguist 5:135–146
Bradley MM, Lang PJ (1999) Affective norms for English words (ANEW): stimuli, instruction manual, and affective ratings. Tech. rep., Center for Research in Psychophysiology, University of Florida, Gainesville
Bravo-Marquez F, Frank E, Mohammad SM, Pfahringer B (2016) Determining word-emotion associations from tweets by multi-label classification. In: 2016 IEEE/WIC/ACM international conference on web intelligence, WI 2016. IEEE Computer Society, pp 536–539
Cambria E, Livingstone A, Hussain A (2012) The hourglass of emotions. In: Esposito A, Esposito AM, Vinciarelli A, Hoffmann R, Müller VC (eds) Cognitive behavioural systems. Springer, Berlin, pp 144–157
Canales L, Martínez-Barco P (2014) Emotion detection from text: a survey. In: Processing in the 5th information systems research working days (JISIC 2014), pp 37–43
Carlson A, Cumby C, Rosen J, Roth D (1999) The SNoW learning architecture. Tech. rep., Technical report UIUCDCS
Cer D, Yang Y, Kong S, Hua NH, Limtiaco N, St John R, Constant N, Guajardo-Cespedes M, Yuan S, Tar C, Sung Y, Strope B, Kurzweil R (2018) Universal sentence encoder. CoRR abs/1803.11175
Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Butz C, Lingras P (eds) Proceedings of the 24th Canadian conference on advances in artificial intelligence, Canadian AI’11. Springer, Berlin, pp 62–67
Chatterjee A, Narahari KN, Joshi M, Agrawal P (2019) Semeval-2019 task 3: emocontext: contextual emotion detection in text. In: Proceedings of the 13th international workshop on semantic evaluation (SemEval-2019), Minneapolis
Chen KJ, Huang CR, Chang LP, Hsu HL (1996) Sinica corpus: design methodology for balanced corpora. In: Proceedings of the 11th Pacific Asia conference on language, information and computation. Kyung Hee University, pp 167–176
Cohen WW (1995) Fast effective rule induction. In: Prieditis A, Russell S (eds) Machine learning proceedings 1995. Morgan Kaufmann, San Francisco, pp 115–123
Dai Z, Yang Z, Yang Y, Carbonell JG, Le QVL, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:1901.02860
Danisman T, Alpkocak A (2008) Feeler: emotion classification of text using vector space model. In: AISB 2008 convention communication, interaction and social intelligence, Aberdeen, vol 2, pp 53–60
Darwin C (1872) The expression of the emotions in man and animals. John Murray, London
De Bruyne L, De Clercq O, Hoste V (2018) LT3 at SemEval-2018 task 1: a classifier chain to detect emotions in tweets. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 123–127
Deborah SA, Milton R, Hannah S (2016) A survey of emotion analysis. Middle East J Sci Res 24:32–38
Deborah SA, Rajalakshmi S, Rajendram SM, Mirnalinee TT (2018) SSN MLRG1 at SemEval-2018 task 1: Emotion and sentiment intensity detection using rule based feature selection. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 324–328
Desmet B, Hoste VH (2013) Emotion detection in suicide notes. Expert Syst Appl 40(16):6351–6358
Devlin J, Chang M, Lee K, Toutanova K (2019) BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, NAACL-HLT 2019, vol 1, pp 4171–4186
Dong Z, Dong Q (1999) Hownet knowledge database
Douiji Y, Mousannif H, Al Moatassime H (2016) Using youtube comments for text-based emotion recognition. Procedia Comput Sci 83:292–299
Du P, Nie JY (2018) Mutux at SemEval-2018 task 1: exploring impacts of context information on emotion detection. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 345–349
Eisner B, Rocktäschel T, Augenstein I, Bosnjak M, Riedel S (2016) emoji2vec: learning emoji representations from their description. In: Proceedings of the fourth international workshop on natural language processing for social media. Association for Computational Linguistics, pp 48–54
Ekman P (1999) Basic emotions. In: Dalgleish T, Power M (eds) The handbook of cognition and emotion. Wiley, New York, pp 45–60
Ellsworth PC (2013) Appraisal theory: old and new questions. Emotion Rev 5(2):125–131
Esuli A, Sebastiani F (2005) Determining the semantic orientation of terms through gloss classification. In: Proceedings of the 14th ACM international conference on information and knowledge management, CIKM’05. ACM, New York, pp 617–624
Esuli A, Sebastiani F (2006) Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of the 5th conference on language resources and evaluation (LREC’06). European Language Resources Association (ELRA), Genoa, pp 417–422
Ezen-Can A, Can EF (2018) RNN for affects at SemEval-2018 task 1: formulating affect identification as a binary classification problem. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 162–166
Felbo B, Mislove A, Søgaard A, Rahwan I, Lehmann S (2017) Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm. In: Proceedings of the 2017 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 1615–1625
Fellbaum C (1998) WordNet: an electronic lexical database. Language, speech, and communication. MIT Press, Cambridge
Frijda NH (1993) Moods, emotion episodes and emotions. In: Lewis M, Haviland JM (eds) Handbook of emotions. Guilford Press, New York, pp 381–403
Gao K, Xu H, Wang J (2014) Emotion classification based on structured information. In: 2014 International conference on multisensor fusion and information integration for intelligent systems (MFI), pp 1–6
Ge S, Qi T, Wu C, Huang Y (2019) \(\text{THU}\_\text{ NGN }\) at SemEval-2019 task 3: dialog emotion classification using attentional LSTM-CNN. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 340–344
Gee G, Wang E (2018) psyML at SemEval-2018 task 1: transfer learning for sentiment and emotion analysis. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 369–376
Ghazi D, Inkpen D, Szpakowicz S (2010) Hierarchical versus flat classification of emotions in text. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, CAAGET’10. Association for Computational Linguistics, Stroudsburg, pp 140–146
Ghazi D, Inkpen D, Szpakowicz S (2014) Prior and contextual emotion of words in sentential context. Comput Speech Lang 28(1):76–92
Gievska S, Koroveshovski K, Chavdarova T (2014) A hybrid approach for emotion detection in support of affective interaction. In: 2014 IEEE international conference on data mining workshop (ICDMW), pp 352–359
Godin F, Vandersmissen B, De Neve W, Van de Walle R (2015) Multimedia lab @ ACL WNUT NER shared task: Named entity recognition for twitter microposts using distributed word representations. In: Proceedings of the workshop on noisy user-generated text. Association for Computational Linguistics, Beijing, pp 146–153
Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge
Grandjean D, Sander D, Scherer KR (2008) Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization. Conscious Cognit 17(2):484–495
Graves A, Schmidhuber J (2005) Framewise phoneme classification with bidirectional lstm and other neural network architectures. Neural Netw 18(5):602–610
Gunes H, Pantic M (2010) Automatic, dimensional and continuous emotion recognition. Int J Synth Emot (IJSE) 1(1):68–99
Haggag MH (2014) Frame semantics evolutionary model for emotion detection. Comput Inf Sci 7(1):136–161
Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. SIGKDD Explor Newsl 11(1):10–18
Herzig J, Shmueli-Scheuer M, Konopnicki D (2017) Emotion detection from text via ensemble classification using word embeddings. In: Proceedings of the ACM SIGIR international conference on theory of information retrieval, ICTIR’17. ACM, New York, pp 269–272
Ho DT, Cao TH (2012) A high-order hidden markov model for emotion detection from textual data. In: Proceedings of the 12th Pacific rim conference on knowledge management and acquisition for intelligent systems, PKAW’12. Springer, Berlin, pp 94–105
Howard J, Ruder S (2018) Universal language model fine-tuning for text classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics, vol 1. Association for Computational Linguistics, Melbourne, pp 328–339
Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD international conference on knowledge discovery and data mining, KDD’04. ACM, New York, pp 168–177
Huang CR, Chen Y, Lee SYM (2010) Textual emotion processing from event analysis. In: Proceedings of the joint conference on Chinese language processing, Beijing
Hudlicka E (2015) Computational analytical framework for affective modeling: towards guidelines for designing computational models of emotions. In: Vallverdú J (ed) Handbook of research on synthesizing human emotion in intelligent systems and robotics. IGI Global, Hershey, pp 1–62
Hume D (2012) Emotion and moods. In: Robbins SP, Judge TA (eds) Organizational behaviour. Pearson, New York, pp 258–297
Hutto C, Gilbert E (2014) Vader: a parsimonious rule-based model for sentiment analysis of social media text. In: Proceedings of the 8th international conference on weblogs and social media, ICWSM 2014, pp 216–225
Izard CE (1971) The face of emotion. Century psychology series. Appleton-Century-Crofts
Izard CE (1977) Human emotions. Plenum Press, New York
Jain U, Sandhu A (2015) A review on the emotion detection from text using machine learning techniques. Int J Curr Eng Technol 5(4):2645–2650
Jain VK, Kumar S, Fernandes SL (2017) Extraction of emotions from multilingual text using intelligent text processing and computational linguistics. J Comput Sci 21:316–326
Jarmasz M, Szpakowicz S (2001) The design and implementation of an electronic lexical knowledge base. In: Stroulia E, Matwin S (eds) Advances in artificial intelligence. Lecture notes in artificial intelligence, vol 2056. Springer, Berlin, pp 325–334
Jin X, Wang Z (2005) An emotion space model for recognition of emotions in spoken Chinese. In: Proceedings of the first international conference on affective computing and intelligent interaction, ACII’05. Springer, Berlin, pp 397–402
Kao ECC, Liu CC, Yang TH, Hsieh CT, Soo VW (2009) Towards text-based emotion detection—a survey and possible improvements. In: Proceedings of the 2009 international conference on information management and engineering, ICIME’09. IEEE Computer Society, Washington, pp 70–74
Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, Ye Q, Liu TY (2017) Lightgbm: a highly efficient gradient boosting decision tree. In: Advances in neural information processing systems. Curran Associates, Inc., pp 3146–3154
Kim SM, Valitutti A, Calvo RA (2010) Evaluation of unsupervised emotion models to textual affect recognition. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, CAAGET’10. Association for Computational Linguistics, Stroudsburg, pp 62–70
Kim Y, Lee H, Jung K (2018) AttnConvnet at SemEval-2018 task 1: attention-based convolutional neural networks for multi-label emotion classification. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 141–145
Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res (JAIR) 50(1):723–762
Kleinginna PR, Kleinginna AM (1981) A categorized list of emotion definitions, with suggestions for a consensual definition. Motiv Emotion 5(4):345–379
Kravchenko D, Pivovarova L (2018) DL Team at SemEval-2018 task 1: tweet affect detection using sentiment lexicons and embeddings. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 172–176
Lee SYM, Chen Y, Huang CR (2010) A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, CAAGET’10. Association for Computational Linguistics, Stroudsburg, pp 45–53
Li M, Dong Z, Fan Z, Meng K, Cao J, Ding G, Liu Y, Shan J, Li B (2018) ISCLAB at SemEval-2018 task 1: Uir-miner for affect in tweets. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 286–290
Li X, Pang J, Mo B, Rao Y (2016) Hybrid neural networks for social emotion detection over short text. In: 2016 International joint conference on neural networks (IJCNN), pp 537–544
Liu H, Singh P (2004) Conceptnet—a practical commonsense reasoning tool-kit. BT Technol J 22(4):211–226
Ma C, Prendinger H, Ishizuka M (2005) Emotion estimation and reasoning based on affective textual interaction. In: Tao J, Tieniu T, Picard RW (eds) Affective computing and intelligent interaction. Springer, Berlin, pp 622–628
Ma L, Zhang L, Ye W, Hu W (2019) PKUSE at SemEval-2019 task 3: emotion detection with emotion-oriented neural attention network. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 287–291
Manning C, Surdeanu M, Bauer J, Finkel J, Bethard S, McClosky D (2014) The stanford corenlp natural language processing toolkit. In: Proceedings of 52nd annual meeting of the association for computational linguistics: system demonstrations. Association for Computational Linguistics, pp 55–60
Meisheri H, Dey L (2018) TCS research at SemEval-2018 task 1: learning robust representations using multi-attention architecture. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 291–299
Merity S, Xiong C, Bradbury J, Socher R (2017) Pointer sentinel mixture models. In: 5th International conference on learning representations, ICLR 2017
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th international conference on neural information processing systems, Vol 2, NIPS’13. Curran Associates Inc., USA, pp 3111–3119
Mikolov T, Grave E, Bojanowski P, Puhrsch C, Joulin A (2018) Advances in pre-training distributed word representations. In: Proceedings of the eleventh international conference on language resources and evaluation (LREC-2018). European Languages Resources Association (ELRA), Miyazaki
Mohammad SM (2012) #Emotional tweets. In: Proceedings of the first joint conference on lexical and computational semantics—volume 1: proceedings of the main conference and the shared task, and volume 2: proceedings of the sixth international workshop on semantic evaluation, SemEval’12. Association for Computational Linguistics, Stroudsburg, pp 246–255
Mohammad SM (2018) Obtaining reliable human ratings of valence, arousal, and dominance for 20,000 english words. In: Proceedings of the annual conference of the association for computational linguistics (ACL), pp 174–184
Mohammad SM (2018) Word affect intensities. In: Proceedings of the 11th edition of the language resources and evaluation conference (LREC-2018), Miyazaki
Mohammad SM, Kiritchenko S (2015) Using hashtags to capture fine emotion categories from tweets. Comput Intell 31(2):301–326
Mohammad SM, Turney PD (2010) Emotions evoked by common words and phrases: using mechanical turk to create an emotion lexicon. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, CAAGET’10. Association for Computational Linguistics, Stroudsburg, pp 26–34
Mohammad SM, Turney PD (2013) Crowdsourcing a word-emotion association lexicon. Comput Intell 29(3):436–465
Mohammad SM, Bravo-Marquez F, Salameh M, Kiritchenko S (2018) SemEval-2018 Task 1: affect in tweets. In: Proceedings of international workshop on semantic evaluation (SemEval-2018), New Orleans
Muljono, Winarsih NAS, Supriyanto C (2016) Evaluation of classification methods for Indonesian text emotion detection. In: 2016 International seminar on application for technology of information and communication (ISemantic), pp 130–133
Mulki H, Bechikh Ali C, Haddad H, Babaoglu I (2018) Tw-StAR at SemEval-2018 task 1: preprocessing impact on multi-label emotion classification. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 167–171
Neviarouskaya A, Prendinger H, Ishizuka M (2009) Compositionality principle in recognition of fine-grained emotions from text. In: Proceedings of the third international ICWSM conference, pp 278–281
Neviarouskaya A, Prendinger H, Ishizuka M (2010) AM: textual attitude analysis model. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, CAAGET’10. Association for Computational Linguistics, Stroudsburg, pp 80–88
Nielsen FÅ (2011) A new ANEW: evaluation of a word list for sentiment analysis in microblogs. In: Proceedings of the ESWC2011 workshop on ’Making Sense of Microposts’: big things come in small packages. Heraklion, Crete, pp 93–98
Ortony A, Clore GL, Collins A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge
Owoputi O, O’Connor B, Dyer C, Gimpel K, Schneider N, Smith NA (2013) Improved part-of-speech tagging for online conversational text with word clusters. In: Proceedings of the 2013 conference of the North American chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, pp 380–390
Panksepp J (2004) Affective neuroscience: the foundations of human and animal emotions. Series in affective science. Oxford University Press, Oxford
Park JH, Xu P, Fung P (2018) PlusEmo2Vec at SemEval-2018 task 1: exploiting emotion knowledge from emoji and #hashtags. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 264–272
Parrott WG (ed) (2001) Emotions in social psychology: essential readings. Key readings in social psychology. Psychology Press, New York
Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, pp 1532–1543
Perikos I, Hatzilygeroudis I (2013) Recognizing emotion presence in natural language sentences. In: Iliadis L, Papadopoulos H, Jayne C (eds) Engineering applications of neural networks. Springer, Berlin, pp 30–39
Pestian J, Nasrallah H, Matykiewicz P, Bennett A, Leenaars A (2010) Suicide note classification using natural language processing: a content analysis. Biomed Inform Insights 3:19–28
Picard RW (1997) Affective computing. MIT Press, Cambridge
Plaza-del Arco FM, Jiménez-Zafra SM, Martin M, Ureña-López LA (2018) SINAI at SemEval-2018 task 1: emotion recognition in tweets. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 128–132
Plutchik R (2001) The nature of emotions. Am Sci 89(4):344–350
Posner J, Russell JA, Peterson BS (2005) The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 17(3):715–734
Quan C, Ren F (2010) A blog emotion corpus for emotional expression analysis in chinese. Comput Speech Lang 24(4):726–749
Radford A, Narasimhan K, Salimans T, Sutskever I (2018) Improving language understanding by generative pre-training. Tech. rep., Preprint. https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
Ragheb W, Azé J, Bringay S, Servajean M (2019) LIRMM-advanse at SemEval-2019 task 3: attentive conversation modeling for emotion detection and classification. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 251–255
Rathnayaka P, Abeysinghe S, Samarajeewa C, Manchanayake I, Walpola MJ, Nawaratne R, Bandaragoda T, Alahakoon D (2019) Gated recurrent neural network approach for multilabel emotion detection in microblogs. arXiv preprint arXiv:1907.07653
Řehůřek R, Sojka P (2010) Software framework for topic modelling with large corpora. In: Proceedings of the LREC 2010 workshop on new challenges for nlp frameworks. European Language Resources Association (ELRA), Valletta, pp 45–50
Riahi N, Safari P (2016) Implicit emotion detection from text with information fusion. J Adv Comput Res 7(2):85–99
Roseman IJ (1991) Appraisal determinants of discrete emotions. Cognit Emotion 5(3):161–200
Rosenthal S, Farra N, Nakov P (2017) SemEval-2017 task 4: sentiment analysis in twitter. In: Proceedings of the 11th international workshop on semantic evaluation. Association for Computational Linguistics, Vancouver, SemEval’17
Rozental A, Fleischer D (2018) Amobee at SemEval-2018 task 1: Gru neural network with a cnn attention mechanism for sentiment classification. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 218–225
Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161–1178
Scherer KR (2005) Appraisal theory. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Wiley, New York, pp 637–663
Scherer KR, Wallbott HG (1994) Evidence for universality and cultural variation of differential emotion response patterning. J Personal Soc Psychol 66(2):310–328
Seol YS, Kim DJ, Kim HW (2008) Emotion recognition from text using knowledge-based ann. In: Proceedings of the 32nd international technical conference on circuits/systems, computers and communications (ITC-CSCC 2008), pp 1569–1572
Seyeditabari A, Tabari N, Gholizadeh S, Zadrozny W (2019) Emotion detection in text: focusing on latent representation. arXiv preprint arXiv:1907.09369
Shaheen S, El-Hajj W, Hajj H, Elbassuoni S (2014) Emotion recognition from text based on automatically generated rules. In: 2014 IEEE international conference on data mining workshop (ICDMW), pp 383–392
Shivhare SN, Garg S, Mishra A (2015) Emotionfinder: detecting emotion from blogs and textual documents. In: International conference on computing, communication & automation (ICCCA), pp 52–57
Shrivastava K, Kumar S, Jain DK (2019) An effective approach for emotion detection in multimedia text data using sequence based convolutional neural network. Multimed Tools Appl 78:29607–29639
Sidorov G, Miranda-Jiménez S, Viveros-Jiménez F, Gelbukh A, Castro-Sánchez N, Velásquez F, Díaz-Rangel I, Suárez-Guerra S, Treviño A, Gordon J (2013) Empirical study of machine learning based approach for opinion mining in tweets. In: Batyrshin I, González Mendoza M (eds) Advances in artificial intelligence. Springer, Berlin, pp 1–14
Singh L, Singh S, Aggarwal N (2019) Two-stage text feature selection method for human emotion recognition. In: Krishna CR, Dutta M, Kumar R (eds) Proceedings of 2nd international conference on communication, computing and networking, lecture notes in networks and systems, vol 46. Springer, Singapore, pp 531–538
Smith CA, Ellsworth PC (1985) Patterns of cognitive appraisal in emotion. J Pers Soc Psychol 48(4):813–838
Smith CA, Lazarus RS (1993) Appraisal components, core relational themes, and the emotions. Cognit Emotion 7(3–4):233–269
Soliman AB, Eissa K, El-Beltagy SR (2017) Aravec: a set of Arabic word embedding models for use in Arabic NLP. Procedia Comput Sci 117:256–265
Speer R, Chin J, Havasi C (2017) Conceptnet 5.5: an open multilingual graph of general knowledge. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, AAAI’17. AAAI Press, pp 4444–4451
Staiano J, Guerini M (2014) Depechemood: a lexicon for emotion analysis from crowd-annotated news. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: short papers), pp 427–433
Steunebrink BR, Dastani M, Meyer JJC (2009) The OCC model revisitedt. In: Reichardt D (ed) Proceedings of the 4th workshop on emotion and computing—current research and future impact, Paderborn, pp 40–47
Stone PJ, Dunphy DC, Smith MS, Ogilvie DM (1966) The general inquirer: a computer approach to content analysis. MIT Press, Cambridge
Strapparava C, Mihalcea R (2007) Semeval-2007 task 14: affective text. In: Proceedings of the 4th international workshop on semantic evaluations, SemEval’07. Association for Computational Linguistics. Stroudsburg, pp 70–74
Strapparava C, Valitutti A (2004) Wordnet-affect: an affective extension of wordnet. In: Proceedings of the 4th international conference on language resources and evaluation (LREC-2004), pp 1083–1086
Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, vol 1. Association for Computational Linguistics, Baltimore, pp 1555–1565
Tao J (2004) Context based emotion detection from text input. In: Proceedings of the 8th international conference on spoken language processing (ICSLP), pp 1337–1340
Thelwall M, Buckley K, Paltoglou G (2012) Sentiment strength detection for the social web. J Assoc Inf Sci Technol (JASIST) 63(1):163–173
Thomas B, Vinod P, Dhanya KA (2014) Multiclass emotion extraction from sentences. Int J Sci Eng Res (IJSER) 5(2):12–15
Tomkins SS (1991) Affect imagery consciousness: volume III: the negative affects: anger and fear. Springer, Berlin
Udochukwu O, He Y (2015) A rule-based approach to implicit emotion detection in text. In: Biemann C, Handschuh S, Freitas A, Meziane F, Métais E (eds) Natural language processing and information systems. Lecture notes in computer science. Springer, Cham, pp 197–203
van der Goot R, van Noord G (2017) Monoise: modeling noise using a modular normalization system. Comput Linguist Neth J 7:129–144
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Proceedings of the 31st international conference on neural information processing systems, NIPS’17. Curran Associates Inc, New York, pp 6000–6010
Wang M, Liu M, Feng S, Wang D, Zhang Y (2014) A novel calibrated label ranking based method for multiple emotions detection in chinese microblogs. In: Zong C, Nie JY, Zhao D, Feng Y (eds) Natural language processing and chinese computing. Springer, Berlin, pp 238–250
Wang Y, Feng S, Wang D, Yu G, Zhang Y (2016) Multi-label chinese microblog emotion classification via convolutional neural network. In: Li F, Shim K, Zheng K, Liu G (eds) Web technologies and applications: APWeb 2016, vol 9931. Lecture notes in computer science. Springer, Cham, pp 567–580
Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 english lemmas. Behav Res Methods 45(4):1191–1207
Watson D, Tellegen A (1985) Toward a consensual structure of mood. Psychol Bull 98(2):219–235
Watson D, Tellegen A (1999) Issues in dimensional structure of affect—effects of descriptors, measurement error, and response formats: comment on russell and carroll (1999). Psychol Bull 125:601–610
Weiss HM, Cropanzano R (1996) Affective events theory: a theoretical discussion of the structure, cause and consequences of affective experiences at work. In: Staw BM, Cummings LL (eds) Research in organizational behavior: an annual series of analytical essays and critical reviews, vol 18. JAI Press Inc, Stamford, pp 1–74
Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the conference on human language technology and empirical methods in natural language processing, HLT’05. Association for Computational Linguistics, Stroudsburg, pp 347–354
Wundt WM (1904) Principles of physiological psychology. Swan Sonnenschein & Co., London
Xiao J (2019) Figure eight at SemEval-2019 task 3: ensemble of transfer learning methods for contextual emotion detection. In: May J, Shutova E, Herbelot A, Zhu XZ, Apidianaki M, Mohammad SM (eds) Proceedings of the 13th international workshop on semantic evaluation. Association for Computational Linguistics, Minneapolis, pp 220–224
Xu H, Yang W, Wang J (2015) Hierarchical emotion classification and emotion component analysis on chinese micro-blog posts. Expert Syst Appl 42(22):8745–8752
Xu H, Lan M, Wu Y (2018) ECNU at SemEval-2018 task 1: emotion intensity prediction using effective features and machine learning models. In: Proceedings of the 12th international workshop on semantic evaluation. Association for Computational Linguistics, pp 231–235
Yan JLS, Turtle HR (2016) Exploring fine-grained emotion detection in tweets. In: Proceedings of the North American chapter of the association for computational linguistics: human language technologies (NAACL-HLT). San Diego, pp 73–80
Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, San Diego, pp 1480–1489
Yenala H, Jhanwar A, Chinnakotla MK, Goyal J (2018) Deep learning for detecting inappropriate content in text. Int J Data Sci Anal 6(4):273–286
Yu C, Aoki PM, Woodruff A (2004) Detecting user engagement in everyday conversations. In: Proceedings of 8th international conference on spoken language processing (ICSLP), pp 1329–1332
Yuan Z, Purver M (2015) Predicting emotion labels for chinese microblog texts. In: Gaber MM, Cocea M, Wiratunga N, Goker A (eds) Advances in social media analysis. Springer, Cham, pp 129–149
Zhang F, Xu H, Wang J, Sun X, Deng J (2016) Grasp the implicit features: hierarchical emotion classification based on topic model and SVM. In: 2016 International joint conference on neural networks (IJCNN), pp 3592–3599
Acknowledgements
This work was supported by the Research Center of the College of Computer and Information Sciences, King Saud University. We are grateful for this support. We also would like to thank the anonymous reviewers for their valuable and insightful comments.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Human and animal rights
This article does not contain any studies with human or animal subjects performed by any of the authors.
Informed consent
Informed consent was not required, as no human or animals were involved.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alswaidan, N., Menai, M.E.B. A survey of state-of-the-art approaches for emotion recognition in text. Knowl Inf Syst 62, 2937–2987 (2020). https://doi.org/10.1007/s10115-020-01449-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-020-01449-0