Abstract
Recently, the world has witnessed an exponential growth of social networks which have opened a venue for online users to express and share their opinions in different life aspects. Sentiment analysis has become a hot-trend research topic in the field of natural language processing due to its significant roles in analyzing the public’s opinion and deriving effective opinion-based decisions. Arabic is one of the widely used languages across social networks. However, its morphological complexities and varieties of dialects make it a challenging language for sentiment analysis. Therefore, inspired by the success of deep learning algorithms, in this paper, we propose a novel deep learning model for Arabic language sentiment analysis based on one layer CNN architecture for local feature extraction, and two layers LSTM to maintain long-term dependencies. The feature maps learned by CNN and LSTM are passed to SVM classifier to generate the final classification. This model is supported by FastText words embedding model. Extensive experiments carried out on a multi-domain corpus demonstrate the outstanding classification performance of this model with an accuracy of 90.75%. Furthermore, the proposed model is validated using different embedding models and classifiers. The results show that FastText skip-gram model and SVM classifier are more valuable alternatives for the Arabic sentiment analysis. The proposed model outperforms several well-established state-of-the-art approaches on relevant corpora with up to \(+\,20.71\%\) accuracy improvement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ain QT, Ali M, Riaz A, Noureen A, Kamran M, Hayat B, Rehman A (2017) Sentiment analysis using deep learning techniques: a review. Int J Adv Comput Sci 8(6):424
Al-ayyoub M, Nuseir A (2016) Hierarchical classifiers for multi-way sentiment analysis of Arabic reviews. Int J Adv Comput Sci Appl 7(2):531–539
Al-kabi MN, Gigieh AH, Alsmadi IM, Wahsheh HA (2014) Opinion mining and analysis for Arabic language. Int J Adv Comput Sci Appl 5(5):181–195
Al-Smadi M, Talafha B, Al-Ayyoub M, Jararweh Y (2018) Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. Int J Mach Learn Cybern. https://doi.org/10.1007/s13042-018-0799-4
Alayba AM, Palade V, England M, Iqbal R (2018) Improving sentiment analysis in Arabic using word representation. In: 2nd international workshop on Arabic and derived script analysis and recognition (ASAR), pp 13–18
Alowaidi S, Saleh M, Abulnaja O (2017) Semantic sentiment analysis of Arabic texts. Int J Adv Comput Sci Appl 8(2):256–262
Alsmearat K, Shehab M, Al-Ayyoub M, Al-Shalabi R, Kanaan G (2015) Emotion analysis of Arabic articles and its impact on identifying the author’s gender
Altowayan AA (2017) Improving Arabic sentiment analysis with sentiment-specific embeddings. In: IEEE international conference on big data (BIGDATA) improving, pp 4314–4320
Altowayan AA, Tao L (2016) Word embeddings for Arabic sentiment analysis. In: IEEE international conference on big data (big data) word, pp 3820–3825. http://tanzil.net
Altrabsheh N, El-Masri M, Mansour H (2017) Successes and challenges of Arabic sentiment analysis research: a literature review. Soc Netw Anal Min. https://doi.org/10.1007/s13278-017-0474-x
Aly M, Atiya A (2013) LABR: a large scale Arabic book reviews dataset. In: Proceedings of the 51st annual meeting of the association for computational linguistics, pp 494–498. https://doi.org/10.13140/2.1.3960.5761. https://www.aclweb.org/anthology-new/P/P13/P13-2088.pdf
Birjali M, Beni-hssane A, Erritali M (2017) Machine learning and semantic sentiment analysis based algorithms for suicide sentiment prediction in social networks. Procedia Comput Sci 113:65–72. https://doi.org/10.1016/j.procs.2017.08.290
Blair SJ, Bi Y, Mulvenna MD (2017) Unsupervised sentiment classification: a hybrid sentiment-topic model approach. https://doi.org/10.1109/ICTAI.2017.00076
Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information, vol 5, no 3, pp 729–734. arXiv:160704606. https://doi.org/10.1039/c2ay25919b
Chen Y, Zhang Z (2018) Research on text sentiment analysis based on CNNs and SVM. In: Proceedings of the 13th IEEE conference on industrial electronics and applications, ICIEA 2018, pp 2731–2734. https://doi.org/10.1109/ICIEA.2018.8398173
Chiu JPC, Nichols E (2015) Named entity recognition with bidirectional LSTM-CNNs (2003). https://doi.org/10.3115/1119176.1119204. arXiv:1511.08308
Claypo N, Jaiyen S (2014) Opinion mining for Thai restaurant reviews using neural networks and mRMR feature selection. In: 2014 international computer science and engineering conference. ICSEC 2014, pp 394–397. https://doi.org/10.1109/ICSEC.2014.6978229
Dahou A, Xiong S, Zhou J, Haddoud MH, Duan P (2016) Word embeddings and convolutional neural network for Arabic sentiment classification. In: Proceedings of the COLING 2016, 26th international conference on computational linguistics :technical papers, pp 2418–2427. https://www.aclweb.org/anthology/C/C16/C16-1228.pdf
Dellavale D, Urdapilleta E, Cámpora N, Velarde OM, Kochen S, Mato G (2020) Prediction of epileptic seizures based on mean phase coherence. BioArXiv, pp 1–60
Eirinaki M, Pisal S, Singh J (2012) Feature-based opinion mining and ranking. J Comput Syst Sci 78(4):1175–1184. https://doi.org/10.1016/j.jcss.2011.10.007
Elhawary M, Elfeky M (2010) Mining Arabic business reviews.In: Proceedings—IEEE international conference on data mining, ICDM, pp 1108–1113. https://doi.org/10.1109/ICDMW.2010.24
Elouardighi A, Maghfour M, Hammia H, Aazi Fz (2017) Analysis in the standard or dialectal Arabic. In: 2017 3rd international conference of cloud computing technologies and applications (CloudTech)
ElSahar H, El-Beltagy SR (2011) Building large Arabic multi-domain resources for sentiment analysis, vol 9042. Springer, Berlin, pp 23–34. https://doi.org/10.1007/978-3-319-18117-2_2
Ghosh R, Ravi K, Ravi V (2016) A novel deep learning architecture for sentiment classification. In: 3rd international conference on recent advances in information technology—RAIT-2016—A, vol 27, pp 1102–1111. https://doi.org/10.1007/978-3-319-68195-5_122. arXiv:1707.05809
Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning, no 1, pp 513–520. http://www.icml-2011.org/papers/342_icmlpaper.pdf
Graves A, Rahman Mohamed A, Hinton GE (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE international conference on acoustics, speech and signal processing, no 6, pp 6645–6649. https://doi.org/10.1109/ICASSP.2013.6638947
Guellil I, Azouaou F, Mendoza M (2019) Arabic sentiment analysis: studies, resources, and tools. Soc Netw Anal Min 9(1):1–17. https://doi.org/10.1007/s13278-019-0602-x
Hassan A, Mahmood A (2017) Deep learning approach for sentiment analysis of short texts. In: 2017 3rd international conference on control, automation and robotics (ICCAR), pp 705–710. https://doi.org/10.1109/ICCAR.2017.7942788. http://ieeexplore.ieee.org/document/7942788/
Hassan A, Mahmood A (2018) Convolutional recurrent deep learning model for sentence classification. IEEE Access 6:13949–13957. https://doi.org/10.1109/ACCESS.2018.2814818
Haydar MS, Helal MA, Hossain SA (2018) Sentiment extraction from bangla text: a character level supervised recurrent neural network approach. In: 2018 international conference on computer, communication, chemical, material and electronic engineering (IC4ME2), pp 1–4. https://doi.org/10.1109/IC4ME2.2018.8465606
Hemmatian F, Sohrabi MK (2017) A survey on classification techniques for opinion mining and sentiment analysis. Artif Intell Rev. https://doi.org/10.1007/s10462-017-9599-6
Huang F, Zhang S, Zhang J, Yu G (2017a) Multimodal learning for topic sentiment analysis in microblogging. Neurocomputing 253:144–153. https://doi.org/10.1016/j.neucom.2016.10.086
Huang Q, Chen R, Zheng X, Dong Z (2017b) Deep sentiment representation based on CNN and LSTM. In: Proceedings—2017 international conference on green informatics, ICGI 2017, pp 30–33. https://doi.org/10.1109/ICGI.2017.45
Keyvanpour M, Karimi Zandian Z, Heidarypanah M (2020) OMLML: a helpful opinion mining method based on lexicon and machine learning in social networks. Soc Netw Anal Min. https://doi.org/10.1007/s13278-019-0622-6
Kim Y (2014) Convolutional neural networks for sentence classification, pp 1746–1751. https://doi.org/10.3115/v1/D14-1181. arXiv:1408.5882
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1–9. https://doi.org/10.1016/j.protcy.2014.09.007
Lalji TK, Deshmukh SN (2016) Twitter sentiment analysis using hybrid approach. Int Res J Eng Technol (IRJET) 3:2887–2890
Li X, Rao Y, Xie H, Lau RYK, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 3045(c):1–16. https://doi.org/10.1109/TAFFC.2017.2716930
Lu Y, Kong X, Quan X, Liu W, Xu Y (2010) Exploring the sentiment strength of user reviews. LNCS, vol 6184. Springer, Berlin, pp 471–482. https://doi.org/10.1007/978-3-642-14246-8_46
Lu Y, Y Rao, JYang, JYin (2018) Incorporating lexicons into LSTM for sentiment classification. In: 2018 international joint conference on neural networks (IJCNN), p 1. http://mendeley.csuc.cat/fitxers/0f093fd3fff6230dab142add74997c48
Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality, pp 1–9. arXiv:13104546v1. http://arxiv.org/abs/1310.4546
Mikolov T, Grave E, Bojanowski P, Puhrsch C, Joulin A (2017) Advances in pre-training distributed word representations Tomas, vol 28, no 7, pp 2114–2118. arXiv:171209405[csCL]. https://doi.org/10.1589/jpts.28.2114. http://arxiv.org/abs/1712.09405
Mostafa AM (2017) An evaluation of sentiment analysis and classification algorithms for Arabic textual data. Int J Comput Appl 158(3):975–8887
Nabil M, Aly M, Atiya A (2015) ASTD: Arabic sentiment tweets dataset. iN: Proceedings of the 2015 conference on empirical methods in natural language processing (September), pp 2515–2519. https://doi.org/10.18653/v1/D15-1299. http://aclweb.org/anthology/D15-1299
Na A, Na A, Ma S, Al-ayyoub M (2013) Arabic sentiment analysis. In: Jordan conference on applied electrical engineering and computing technologies (AEECT13), vol 6, no 12, pp 1–6. https://doi.org/10.1109/AEECT.2013.6716448
Ombabi AH, Lazzez O, Ouarda W, Alimi AM (2017) Deep learning framework based on Word2Vec and CNN for users interests classification. In: 2017 Sudan conference on computer science and information technology (SCCSIT), pp 1–7
Ouyang X, Zhou P, Li CH, Liu L (2015) Sentiment analysis using convolutional neural network. In: 2015 IEEE international conference on computer and information technology; ubiquitous computing and communications; dependable, autonomic and secure computing; pervasive intelligence and computing, pp 2359–2364. https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.349. http://ieeexplore.ieee.org/document/7363395/
Pal S, Ghosh S, Nag A (2018) Sentiment analysis in the light of LSTM recurrent neural networks. Int J Synth Emot 9(1):33–39. https://doi.org/10.4018/ijse.2018010103
Pawar KK, Deshmukh RR (2015) Twitter sentiment classification on sanders data using hybrid approach. IOSR J Comput Eng 17(4):118–123. https://doi.org/10.9790/0661-1741118123
Preethi G, Krishna PV (2017) Application of deep learning to sentiment analysis for recommender system on cloud
Ravi K, Ravi V (2015) A survey on opinion mining and sentiment analysis: tasks, approaches and applications, vol 89. Elsevier, Amsterdam. https://doi.org/10.1016/j.knosys.2015.06.015
Ravuri S, Stoicke A (2016) A comparative study of neural network models for lexical intent classification. In: 2015 IEEE workshop on automatic speech recognition and understanding, ASRU 2015—proceedings, vol 2, pp 368–374. https://doi.org/10.1109/ASRU.2015.7404818
Sasmita DH, Wicaksono AF, Louvan S, Adriani M (2017) Unsupervised aspect-based sentiment analysis on Indonesian restaurant reviews. In: Proceedings of the 2017 international conference on Asian language processing, IALP 2017 2018-Janua, pp 383–386. https://doi.org/10.1109/IALP.2017.8300623
Shickel B, Tighe PJ, Bihorac A, Rashidi P (2018) Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis. IEEE J Biomed Health Inform 22(5):1589–1604. https://doi.org/10.1109/JBHI.2017.2767063
Sohangir S, Wang D, Pomeranets A, Khoshgoftaar TM (2018) Big data: deep learning for financial sentiment analysis. J Big Data. https://doi.org/10.1186/s40537-017-0111-6
Soliman AB, Eissa K, El-Beltagy SR (2017) AraVec: a set of Arabic word embedding models for use in Arabic NLP. Procedia Comput Sci 117:256–265. https://doi.org/10.1016/j.procs.2017.10.117
Sze V, Chen YH, Yang TJ, Emer JS (2017) Efficient processing of deep neural networks: a tutorial and survey. Proc IEEE 105(12):2295–2329. https://doi.org/10.1109/JPROC.2017.2761740
Taj S, Shaikh BB, Fatemah Meghji A (2019) Sentiment analysis of news articles: a lexicon based approach. In: 2019 2nd international conference on computing, mathematics and engineering technologies, iCoMET 2019, pp 1–5. https://doi.org/10.1109/ICOMET.2019.8673428
Tarwani KM, Edem S (2017) Survey on recurrent neural network in natural language processing. Int J Eng Trends Technol 48(6):301–304
Vateekul P, Koomsubha T (2016) A study of sentiment analysis using deep learning techniques on Thai Twitter data. In: 2016 13th international joint conference on computer science and software engineering, JCSSE 2016, pp 1–6. https://doi.org/10.1109/JCSSE.2016.7748849. http://ieeexplore.ieee.org/document/7748849/
Wang J, Cao Z (2017) Chinese text sentiment analysis using LSTM network based on L2 and Nadam, pp 1891–1895
Wint ZZ, Manabe Y, Aritsugi M (2018) Deep learning based sentiment classification in social network services datasets. In: 2018 IEEE international conference on big data, cloud computing, data science & engineering (BCD), pp 91–96. https://doi.org/10.1109/BCD2018.2018.00022. https://ieeexplore.ieee.org/document/8530698/
Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing [review article]. IEEE Comput Intell Mag 13(3):55–75. https://doi.org/10.1109/MCI.2018.2840738
Yuan S, Wu X, Xiang Y (2018) Incorporating pre-training in long short-term memory networks for tweet classification. Soc Netw Anal Min. https://doi.org/10.1007/s13278-018-0530-1
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ombabi, A.H., Ouarda, W. & Alimi, A.M. Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks. Soc. Netw. Anal. Min. 10, 53 (2020). https://doi.org/10.1007/s13278-020-00668-1
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13278-020-00668-1