Skip to main content
SpringerLink
Log in

Deep-EmoRU: mining emotions from roman urdu text using deep learning ensemble

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Detecting emotions play a vital role in our lives. In various ways, people convey their feelings, i.e., facial expressions, movements, speech, and text. This study aims to classify the emotions from Roman Urdu’s text. Much research has previously been done on different emotion detection languages, but there is minimal work done in Roman Urdu. There is also a need to explore Roman Urdu, as it is the most widely used social media site for communication. The absence of a benchmark corpus for emotion detection from text is a significant problem for Roman Urdu because language assets are essential for various tasks of natural language processing (NLP). The emotional analysis has many practical applications, such as optimizing product quality, dialog systems, investment patterns, and mental health. In this research, we build a corpus of 18k sentences collected from different domains and annotate it with six other classes to concentrate on the emotional polarity of the Roman Urdu text. We also proposed a Deep-EmoRU model for emotion detection from Roman Urdu text. Our proposed model is based on Long short-term memory (LSTM) and Convolutional neural network (CNN) feature learners. We applied different baseline algorithms like LSTM, Adaboost, XGboost, Random Forest, MLP, SVM, Decision tree, and KNN on our corpus. After experimentation and evaluation, the results showed that our model achieves a better F-measure score than LSTM, KNN, SVM, Adaboost, XGboost, MLP, Decision tree, and Random Forest. We achieve an accuracy of 82.2% and an F-measure of 0.82 on Emotion Detection for Roman Urdu.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Abdullah M, Hadzikadicy M, Shaikhz S (2018) Sedat: sentiment and emotion detection in arabic text using cnn-lstm deep learning. In: 2018 17th IEEE international conference on machine learning and applications (ICMLA). IEEE, pp 835–840

  2. Agarwal B, Mittal N (2012) , pp. 701–709. In: Proceedings of the Second International Conference on Soft Computing for Problem Solving (SocProS) December 28-30, 2012. Springer, p 2014

  3. Agrawal A, An A (2012) Unsupervised emotion detection from text using semantic and syntactic relations. In: Proceedings of the The IEEE/WIC/ACM international joint conferences on web intelligence and intelligent agent technology vol 01. IEEE Computer Society, pp 346–353, p 2012

  4. Arshad MU, Bashir MF, Majeed A, Shahzad W, Beg MO (2019) Corpus for emotion detection on roman urdu. In: 2019 22nd international multitopic conference (INMIC). IEEE, pp 1–6

  5. Bothe C, Wermter S (2019) Moongrad at semeval-2019 task 3: Ensemble birnns for contextual emotion detection in dialogues. In: Proceedings of the 13th international workshop on semantic evaluation, pp 261–265

  6. Carstensen LL, Pasupathi M, Mayr U, Nesselroade JR (2000) Emotional experience in everyday life across the adult life span. J Person Soc Psychol 79(4):644

    Article  Google Scholar 

  7. Cassell J, Pelachaud C, Badler N, Steedman M, Achorn B, Becket T, Douville B, Prevost S, Stone M (1994) Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In: Proceedings of the 21st annual conference on Computer graphics and interactive techniques. ACM, pp 413–420

  8. Crowston K, Allen EE, Heckman R (2012) Using natural language processing technology for qualitative data analysis. Int J Soc Res Methodol 15 (6):523–543

    Article  Google Scholar 

  9. Fathy S, El-Haggar N, Haggag MH (2017) A hybrid model for emotion detection from text. International Journal of Information Retrieval Research (IJIRR) 7(1):32–48

    Article  Google Scholar 

  10. Gaind B, Syal V, Padgalwar S (2019) Emotion detection and analysis on social media. arXiv:1901.08458

  11. Ghulam H, Zeng F, Li W, Xiao Y (2019) Deep learning-based sentiment analysis for roman urdu text. Procedia Computer Science 147:131–135

    Article  Google Scholar 

  12. Gilani DIS (2009) Preferred medium for communicating with others via sms. Gilani poll/gallup pakistan

  13. Hasan M, Rundensteiner E, Agu E (2019) Automatic emotion detection in text streams by analyzing twitter data. International journal of data science and analytics 7(1):35–51

    Article  Google Scholar 

  14. Kanwal S, Malik K, Shahzad K, Aslam F, Nawaz Z (2019) Urdu named entity recognition: Corpus generation and deep learning applications. ACM Trans Asian Low-Resource Language Inform Process(TALLIP) 19(1):1–13

    Google Scholar 

  15. Li B-H, Hou B-C, Yu W-T, Lu X-B, Yang C-W (2017) Applications of artificial intelligence in intelligent manufacturing: a review. Front Inform Technol Electron Eng 18(1):86–96

    Article  Google Scholar 

  16. Lu C-Y, Hsu WW, Peng H-T, Chung J-M, Ho J-M (2010) Emotion sensing for internet chatting: a web mining approach for affective categorization of events. In: 2010 13th IEEE international conference on computational science and engineering. IEEE, pp. 295–301

  17. Mahmood Z, Safder I, Nawab RMA, Bukhari F, Nawaz R, Alfakeeh AS, Aljohani NR, Hassan S-U (2020) Deep sentiments in roman urdu text using recurrent convolutional neural network model. Inform Process Manag 57 (4):102233

    Article  Google Scholar 

  18. Majeed A, Mujtaba H, Beg MO (2020) Emotion detection in roman urdu text using machine learning. In: Proceedings of the 35th IEEE/ACM international conference on automated software engineering workshops, pp 125–130

  19. Mehmood K, Essam D, Shafi K, Malik MK (2019) Sentiment analysis for a resource poor language—roman urdu. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 19(1):10

    Google Scholar 

  20. Mohammad S, Zhu X, Martin J (2014) Semantic role labeling of emotions in tweets. In: Proceedings of the 5th workshop on computational approaches to subjectivity sentiment and social media analysis, pp 32–41

  21. Mukhtar N, Khan MA (2018) Urdu sentiment analysis using supervised machine learning approach. Int J Pattern Recognit Artif Intell 32(02):1851001

    Article  MathSciNet  Google Scholar 

  22. Mukhtar N, Khan MA, Chiragh N, Nazir S (2018) Identification and handling of intensifiers for enhancing accuracy of urdu sentiment analysis. Expert Syst 35(6):e12317

    Article  Google Scholar 

  23. Nabeel Z, Mehmood M, Baqir A, Amjad A (2021) Classifying emotions in roman urdu posts using machine learning. In: Mohammad Ali Jinnah university international conference on computing (MAJICC). IEEE, pp 1–7, p 2021

  24. Naeem S, Iqbal M, Saqib M, Saad M, Raza MS, Ali Z, Akhtar N, Beg MO, Shahzad W, Arshad MU (2020) Subspace gaussian mixture model for continuous urdu speech recognition using kaldi. In: 2020 14th international conference on open source systems and technologies (ICOSST). IEEE, pp 1–7

  25. Nargis GZ, Jamil N (2016) Generating an emotion ontology for roman urdu text

  26. Rafique A, Malik MK, Nawaz Z, Bukhari F, Jalbani AH, et al. (2019) Sentiment analysis for roman urdu. Mehran University Research Journal of Engineering & Technology 38(2):463

    Article  Google Scholar 

  27. Seyeditabari A, Tabari N, Zadrozny W (2018) Emotion detection in text: a review. arXiv:1806.00674

  28. Shen Y, Li S, Zheng L, Ren X, Cheng X (2009) Emotion mining research on micro-blog. In: 2009 1st IEEE symposium on web society. IEEE, pp 71–75

  29. Shivhare SN, Garg S, Mishra A (2015) Emotionfinder: Detecting emotion from blogs and textual documents. In: International conference on computing, communication & automation. IEEE, pp 52–57

  30. Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. In: Proceedings of the ACM symposium on Applied computing. ACM, pp 1556–1560, p 2008

  31. Yang L, Lin H (2012) Construction and application of chinese emotional corpus. In: Workshop on chinese lexical semantics. Springer, pp 122–133

  32. Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. ieee Computational Intelligence Magazine 13(3):55–75

    Article  Google Scholar 

  33. Zahid R, Idrees MO, Mujtaba H, Beg MO (2020) Roman urdu reviews dataset for aspect based opinion mining. In: 2020 35th IEEE/ACM international conference on automated software engineering workshops (ASEW). IEEE, pp 138–143

  34. Zhang S-Y (2022) Deep learning method for human emotion detection and text analysis based on big data. In: International conference on cognitive based information processing and applications (CIPA 2021). Springer, pp 486–490

Download references

Author information

Authors and Affiliations

  1. Department of Software Engineering and Computer Science, Riphah International University, Islamabad, Pakistan

    Adil Majeed

  2. Department of Computer Science, National University of Computer and Emerging Sciences, Islamabad, Pakistan

    Mirza Omer Beg, Umair Arshad & Hasan Mujtaba

Authors
  1. Adil Majeed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mirza Omer Beg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Umair Arshad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hasan Mujtaba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adil Majeed.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Majeed, A., Beg, M.O., Arshad, U. et al. Deep-EmoRU: mining emotions from roman urdu text using deep learning ensemble. Multimed Tools Appl 81, 43163–43188 (2022). https://doi.org/10.1007/s11042-022-13147-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13147-w

Keywords

Search

Navigation