Skip to main content
Springer Nature Link
Log in

Comparative Analysis for Arabic Sentiment Classification

  • Conference paper
  • First Online:
Applied Computing to Support Industry: Innovation and Technology (ACRIT 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1174))

Abstract

Sentiment analysis categorizes human opinions, emotions and reactions extracted from text into positive or negative polarity. However, mining sentiments from the Arabic text is challenging due to the scarcity of Arabic datasets for training the context. To address this gap, this study builds an Arabic sentiment dataset sourced from tweets, product reviews, hotel reviews, movie reviews, product attraction, and restaurant reviews from different websites; manually labeled for training the sentiment analysis model. The dataset is then used in a comparative experiment with three machine learning algorithms, which are Support Vector Machine (SVM), Naïve Bayes (NB), and Decision Tree (DT) via a classification methodology. The best results for polarity prediction in sentiment analysis models was achieved by SVM with product attraction dataset, with the accuracy of 0.96, precision of 0.99, recall of 0.99, and F-measure of 0.98. This is followed by the average performance from NB and DT. It can be concluded that the ML classifiers need the right morphological features to enhance the classification accuracy when dealing with different words that play different roles in the sentence with the same letters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. A macrolanguage of Saudi Arabia, ISO 639-3. https://www.ethnologue.com/language/ara. Accessed 21 Oct 2018

  2. Alhumoud, S.O., Altuwaijri, M.I., Albuhairi, T.M., Alohaideb, W.M.: Survey on Arabic sentiment analysis in Twitter. Int. Sci. Index 9(1), 364–368 (2015)

    Google Scholar 

  3. Alotaibi, S.S.: Sentiment analysis in the Arabic language using machine learning (Doctoral dissertation, Colorado State University. Libraries) (2015)

    Google Scholar 

  4. Al-Twairesh, N., Al-Khalifa, H., Al-Salman, A.: Subjectivity and sentiment analysis of Arabic: trends and challenges. In: 2014 IEEE/ACS 11th International Conference on Computer Systems and Applications (AICCSA), pp. 148–155. IEEE (2014)

    Google Scholar 

  5. Rushdi-Saleh, M., Martín-Valdivia, M.T., Ureña-López, L.A., Perea-Ortega, J.M.: OCA: opinion corpus for Arabic. J. Am. Soc. Inf. Sci. Technol. 62(10), 2045–2054 (2011)

    Article  Google Scholar 

  6. Abdul-Majeed, M., Diab, M.T.: AWATIF: a multi-genre corpus for modern standard arabic subjectivity and sentiment analysis. In: LREC, pp. 3907–3914 (2012)

    Google Scholar 

  7. Pan, L.: Sentiment analysis in Chinese. (Doctoral dissertation, Brandeis University) (2012)

    Google Scholar 

  8. Siddiqui, S., Monem, A.A., Shaalan, K.: Sentiment analysis in Arabic. In: Métais, E., Meziane, F., Saraee, M., Sugumaran, V., Vadera, S. (eds.) NLDB 2016. LNCS, vol. 9612, pp. 409–414. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41754-7_41

    Chapter  Google Scholar 

  9. Mountassir, A., Benbrahim, H., Berrada, I.: Some methods to address the problem of unbalanced sentiment classification in an Arabic context. In: 2012 Colloquium in Information Science and Technology, pp. 43–48. IEEE (2012)

    Google Scholar 

  10. Akba, F., Uçan, A., Sezer, E., Sever, H.: Assessment of feature selection metrics for sentiment analyses: Turkish movie reviews. In: 8th European Conference on Data Mining (2014)

    Google Scholar 

  11. Kaya, M.: Sentiment analysis of Turkish political columns with transfer learning. (Doctoral dissertation, Middle East Technical University) (2013)

    Google Scholar 

  12. Daiyan, Md., Tiwari, S., Kumar, M., Alam, M.A.: A literature review on opinion mining and sentiment analysis. Int. J. Emerg. Technol. Adv. Eng. 5(1), 262–280 (2015)

    Google Scholar 

  13. Kharde, V., Sonawane, P.: Sentiment analysis of Twitter data: a survey of techniques. arXiv preprint arXiv:1601.06971 (2016)

  14. Nabil, M., Aly, M.A., Atiya, A.F.: LABR: A large scale Arabic book reviews dataset, CoRR, abs/1411.6718 (2014)

    Google Scholar 

  15. ElSahar, H., El-Beltagy, S.R.: Building large Arabic multi-domain resources for sentiment analysis. In: Gelbukh, A. (ed.) CICLing 2015. LNCS, vol. 9042, pp. 23–34. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18117-2_2

    Chapter  Google Scholar 

  16. Abdulla, N.A., Ahmed, N.A., Shehab, M.A., Al-Ayyoub, M.: Arabic sentiment analysis: Lexicon-based and corpus-based. In: 2013 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT), pp. 1–6. IEEE (2013)

    Google Scholar 

  17. Shoukry, A., Rafea, A.: Sentence-level Arabic sentiment analysis. In: 2012 International Conference on Collaboration Technologies and Systems (CTS), pp. 546–550. IEEE (2012)

    Google Scholar 

  18. Farra, N., Challita, E., Assi, R.A., Hajj, H.: Sentence-level and document-level sentiment mining for Arabic texts. In: 2010 IEEE International Conference on Data Mining Workshops, pp. 1114–1119. IEEE (2010)

    Google Scholar 

  19. Neethu, M.S., Rajasree, R.: Sentiment analysis in Twitter using machine learning techniques. In: 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), pp. 1–5. IEEE (2013)

    Google Scholar 

  20. Dhanalakshmi, V., Bino, D., Saravanan, A.M.: Opinion mining from student feedback data using supervised learning algorithms. In: 2016 3rd MEC International Conference on Big Data and Smart City (ICBDSC), pp. 1–5. IEEE (2016)

    Google Scholar 

  21. Altrabsheh, N., Gaber, M., Cocea, M.: SA-E: sentiment analysis for education. In: International Conference on Intelligent Decision Technologies, vol. 255, pp. 353–362 (2013)

    Google Scholar 

  22. Le, B., Nguyen, H.: Twitter sentiment analysis using machine learning techniques. In: Le Thi, H.A., Nguyen, N.T., Do, T.V. (eds.) Advanced Computational Methods for Knowledge Engineering. AISC, vol. 358, pp. 279–289. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-17996-4_25

    Chapter  Google Scholar 

  23. Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., Liu, B.: Combining lexicon-based and learning-based methods for Twitter sentiment analysis. Technical report, HP Laboratories (2011)

    Google Scholar 

  24. Elnagar, A., Lulu, L., Einea, O.: An annotated huge dataset for standard and colloquial arabic reviews for subjective sentiment analysis. Procedia Comput. Sci. 142, 182–189 (2018)

    Article  Google Scholar 

  25. Appel, O., Chiclana, F., Carter, J., Fujita, H.: A hybrid approach to the sentiment analysis problem at the sentence level. Knowl.-Based Syst. 108, 110–124 (2016)

    Article  Google Scholar 

  26. Gautam, G., Yadav, D.: Sentiment analysis of Twitter data using machine learning approaches and semantic analysis. In: 2014 Seventh International Conference on Contemporary Computing (IC3), pp. 437–442. IEEE (2014)

    Google Scholar 

  27. Al-Smadi, M., Qawasmeh, O., Al-Ayyoub, M., Jararweh, Y., Gupta, B.: Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J. Comput. Sci. 27, 386–393 (2018)

    Article  Google Scholar 

  28. Al-Azani, S., El-Alfy, E.S.M.: Emoji-based sentiment analysis of Arabic microblogs using machine learning. In: 2018 21st Saudi Computer Society National Computer Conference (NCC), pp. 1–6. IEEE, April 2018

    Google Scholar 

  29. Elhag, M.E.M., Shah, N.A.K., Balakrishnan, V., Abdelaziz, A.: Sentiment analysis algorithms: evaluation performance of the Arabic and English language. In: 2018 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE), pp. 1–5. IEEE, August 2018

    Google Scholar 

  30. Alharbi, F.R., Khan, M.B.: Identifying comparative opinions in Arabic text in social media using machine learning techniques. SN Appl. Sci. 1(3), 213 (2019)

    Article  Google Scholar 

  31. Alnawas, A., Arici, N.: Sentiment analysis of iraqi Arabic dialect on Facebook based on distributed representations of documents. ACM Trans. Asian Low-Resource Lang. Inf. Process. (TALLIP) 18(3), 20 (2019)

    Google Scholar 

  32. Mohammed, M.A., Gunasekaran, S.S., Mostafa, S.A., Mustafa, A., Ghani, M.K.A.: Implementing an agent-based multi-natural language anti-spam model. In: 2018 International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR), pp. 1–5. IEEE, August 2018

    Google Scholar 

  33. Mohammed, M.A., et al.: An anti-spam detection model for emails of multi-natural language. J. Southwest Jiaotong Univ. 54(3) (2019)

    Google Scholar 

Download references

Acknowledgments

This work is supported by Universiti Tun Hussein Onn Malaysia.

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, 86400, Parit Raja, Batu Pahat, Johor, Malaysia

    Mohammed Abbas Algburi, Aida Mustapha, Salama A. Mostafa & Mohd. Zainuri Saringatb

Authors
  1. Mohammed Abbas Algburi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aida Mustapha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Salama A. Mostafa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohd. Zainuri Saringatb
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Abbas Algburi .

Editor information

Editors and Affiliations

  1. Al Maaref University College, Ramadi, Iraq

    Mohammed I. Khalaf

  2. Liverpool John Moores University, Liverpool, UK

    Dhiya Al-Jumeily

  3. University of Liverpool, Liverpool, UK

    Alexei Lisitsa

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Algburi, M.A., Mustapha, A., Mostafa, S.A., Saringatb, M.Z. (2020). Comparative Analysis for Arabic Sentiment Classification. In: Khalaf, M., Al-Jumeily, D., Lisitsa, A. (eds) Applied Computing to Support Industry: Innovation and Technology. ACRIT 2019. Communications in Computer and Information Science, vol 1174. Springer, Cham. https://doi.org/10.1007/978-3-030-38752-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-38752-5_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-38751-8

  • Online ISBN: 978-3-030-38752-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics