Skip to main content
SpringerLink
Log in

A MapReduce Improved ID3 Decision Tree for Classifying Twitter Data

  • Conference paper
  • First Online:
Book cover Business Intelligence (CBI 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 416))

Included in the following conference series:

Abstract

In this contribution, we introduce an innovative classification approach for opinion mining. We have used the feature extractor Fast Text to detect and capture the given tweets’ relevant data efficiently. Then, we have applied the feature selector Information Gain to reduce the dimensionality of the high feature. Finally, we have employed the obtained features to carry out the classification task using our improved ID3 decision tree classifier, which aims to calculate the weighted information gain instead of information gain used in traditional ID3. In other words, to measure the weighted information gain for the current conditioned feature, we follow two steps: First, we compute the weighted correlation function of the current conditioned feature. Second, we multiply the obtained weighted correlation function by the information gain of this current conditioned feature. This work is implemented in a distributed environment using the Hadoop framework, with its programming framework MapReduce and its distributed file system HDFS. Its primary goal is to enhance the performance of a well-known ID3 classifier in terms of accuracy, execution time, and ability to handle massive datasets. We have performed several experiments that aim to evaluate our suggested classifier’s effectiveness compared to some other contributions chosen from the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tang, D., Qin, B., Liu, T.: Deep learning for sentiment analysis: successful approaches and future challenges. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 5(6), 292–303 (2015). https://doi.org/10.1002/widm.1171

    Article  Google Scholar 

  2. Severyn, A., Moschitti, A.: Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 959–962. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2766462.2767830

  3. Han, J., Kamber, M., Pei, J.: Getting to know your data. In: Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco (2006)

    Google Scholar 

  4. Daeli, N.O.F., Adiwijaya, A.: Sentiment analysis on movie reviews using information gain and K-nearest neighbor. J. Data Sci. Appl. 3(1), 1–7 (2020). https://doi.org/10.34818/jdsa.2020.3.22

    Article  Google Scholar 

  5. Zainuddin, N., Selamat, A.: Sentiment analysis using support vector machine. In: 2014 International Conference on Computer, Communications, and Control Technology (I4CT), Langkawi, Malaysia, pp. 333–337 (2014). https://doi.org/10.1109/I4CT.2014.6914200

  6. Rathi, M., Malik, A., Varshney, D., Sharma, R., Mendiratta, S.: Sentiment analysis of tweets using machine learning approach. In: 2018 Eleventh International Conference on Contemporary Computing (IC3), Noida, India, pp. 1–3 (2018). https://doi.org/10.1109/IC3.2018.8530517

  7. Ramadhan, W.P., Novianty, S.T.M.T.A., Setianingsih, S.T.M.T.C.: Sentiment analysis using multinomial logistic regression. In: 2017 International Conference on Control, Electronics, Renewable Energy and Communications (ICCREC), Yogyakarta, Indonesia, pp. 46–49 (2017). https://doi.org/10.1109/ICCEREC.2017.8226700

  8. Troussas, C., Virvou, M., Espinosa, K.J., Llaguno, K., Caro, J.: Sentiment analysis of Facebook statuses using Naive Bayes classifier for language learning. In: 2013 International Conference on Information, Intelligence, Systems and Applications (IISA), Piraeus, Greece, pp. 1–6 (2013). https://doi.org/10.1109/IISA.2013.6623713

  9. Al Amrani, Y., Lazaar, M., El Kadiri, K.E.: Random forest and support vector machine based hybrid approach to sentiment analysis. Proc. Comput. Sci. 127, 511–520 (2018). https://doi.org/10.1016/j.procs.2018.01.150

    Article  Google Scholar 

  10. Neethu, M.S., Rajasree, R.: Sentiment analysis in twitter using machine learning techniques. In: 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), Tiruchengode, India, pp. 1–5 (2013). https://doi.org/10.1109/ICCCNT.2013.6726818

  11. Boiy, E., Moens, M.-F.: A machine learning approach to sentiment analysis in multilingual web texts. Inf. Retr. Boston 12(5), 526–558 (2009). https://doi.org/10.1007/s10791-008-9070-z

    Article  Google Scholar 

  12. Gautam, G., Yadav, D.: Sentiment analysis of twitter data using machine learning approaches and semantic analysis. In: 2014 Seventh International Conference on Contemporary Computing (IC3), Noida, India, pp. 437–442 (2014).https://doi.org/10.1109/IC3.2014.6897213

  13. Hasan, A., Moin, S., Karim, A., Shamshirband, S.: Machine learning-based sentiment analysis for Twitter accounts. Math. Comput. Appl. 23(1), 11 (2018). https://doi.org/10.3390/mca23010011

    Article  Google Scholar 

  14. Sharma, A., Dey, S.: A comparative study of feature selection and machine learning techniques for sentiment analysis. In: Proceedings of the 2012 ACM Research in Applied Computation Symposium, San Antonio, Texas, pp. 1–7 (2012). https://doi.org/10.1145/2401603.2401605

  15. Es-Sabery, F., Hair, A.: An improved ID3 classification algorithm based on correlation function and weighted attribute*. In: 2019 International Conference on Intelligent Systems and Advanced Computing Sciences (ISACS), Taza, Morocco, pp. 1–8 (2019). https://doi.org/10.1109/ISACS48493.2019.9068891

  16. Patil, G., Galande, V., Kekan, M.V., Dange, K.: Sentiment analysis using support vector. Int. J. Innov. Res. Comput. Commun. Eng. 2(1), 2607–2612 (2014). https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1084.6923&rep=rep1&type=pdf

  17. Shein, K.P.P., Nyunt, T.T.S.: Sentiment classification based on ontology and SVM classifier. In: 2010 Second International Conference on Communication Software and Networks, Singapore, pp. 169–172 (2010). https://doi.org/10.1109/ICCSN.2010.35

  18. Gamallo, P., Garcia, M., Fernandez-Lanza, S.: TASS: a Naive-Bayes strategy for sentiment analysis on Spanish tweets. In: XXIX Congreso de la Sociedad Española de Procesamiento de Lenguaje Natural, Spain, pp. 126–132 (2013). https://gramatica.usc.es/~gamallo/artigos-web/TASS2013.pdf

  19. Anjaria, M., Guddeti, R.M.R.: A novel sentiment analysis of social networks using supervised learning. Soc. Netw. Anal. Min. 4, 181 (2014). https://doi.org/10.1007/s13278-014-0181-9

    Article  Google Scholar 

  20. Duwairi, R.M.: Sentiment analysis for dialectical Arabic. In: 2015 6th International Conference on Information and Communication Systems (ICICS), Amman, Jordan, pp. 166–170 (2015). https://doi.org/10.1109/IACS.2015.7103221

  21. Soni, V.K., Pawar, S.: Emotion based social media text classification using optimized improved ID3 classifier. In: 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), Chennai, India, pp. 1500–1505 (2017). https://doi.org/10.1109/ICECDS.2017.8389696

  22. Ngoc, P.V., Ngoc, C.V.T., Ngoc, T.V.T., Duy, D.N.: A C4.5 algorithm for English emotional classification. Evol. Syst. 10(3), 425–451 (2019). https://doi.org/10.1007/s12530-017-9180-1

    Article  Google Scholar 

  23. Lakshmi Devi, B., Varaswathi Bai, V., Ramasubbareddy, S., Govinda, K.: Sentiment analysis on movie reviews. In: Venkata Krishna, P., Obaidat, M.S. (eds.) Emerging Research in Data Engineering Systems and Computer Communications. AISC, vol. 1054, pp. 321–328. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-0135-7_31

    Chapter  Google Scholar 

  24. Guerreiro, J., Rita, P.: How to predict explicit recommendations in online reviews using text mining and sentiment analysis. J. Hosp. Tour. Manag. 43, 269–272 (2020). https://doi.org/10.1016/j.jhtm.2019.07.001

    Article  Google Scholar 

  25. Mehta, R.P., Sanghvi, M.A., Shah, D.K., Singh, A.: Sentiment analysis of tweets using supervised learning algorithms. In: Luhach, A.K., Kosa, J.A., Poonia, R.C., Gao, X.-Z., Singh, D. (eds.) First International Conference on Sustainable Technologies for Computational Intelligence. AISC, vol. 1045, pp. 323–338. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-0029-9_26

    Chapter  Google Scholar 

  26. Zhang, J.: Sentiment analysis of movie reviews in Chinese. Uppsala University (2020). https://www.diva-portal.org/smash/get/diva2:1438431/FULLTEXT01.pdf

  27. López-Chau, A., Valle-Cruz, D., Sandoval-Almazán, R.: Sentiment analysis of Twitter data through machine learning techniques. In: Ramachandran, M., Mahmood, Z. (eds.) Software Engineering in the Era of Cloud Computing. CCN, pp. 185–209. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-33624-0_8

    Chapter  Google Scholar 

  28. Addi, H.A., Ezzahir, R., Mahmoudi, A.: Three-level binary tree structure for sentiment classification in Arabic text. In: Proceedings of the 3rd International Conference on Networking, Information Systems & Security (NISS2020), Marrakech, Moroccopp. 1–8 (2020). https://doi.org/10.1145/3386723.3387844

  29. Patel, R., Passi, K.: Sentiment analysis on twitter data of world cup soccer tournament using machine learning. IoT 1(2), 218–239 (2020). https://doi.org/10.3390/iot1020014

    Article  Google Scholar 

  30. Wang, Y., Chen, Q., Shen, J., Hou, B., Ahmed, M., Li, Z.: Aspect-level sentiment analysis based on gradual machine learning. Knowl.-Based Syst. 212, 106509–106521 (2021). https://doi.org/10.1016/j.knosys.2020.106509

    Article  Google Scholar 

  31. Es-sabery, F., Hair, A.: A MapReduce C4.5 decision tree algorithm based on fuzzy rule-based system. Fuzzy Inf. Eng. 1–28 (2020). https://doi.org/10.1080/16168658.2020.1756099

  32. Es-Sabery, F., Hair, A., Qadir, J., Sainz-De-Abajo, B., García-Zapirain, B., Torre-Díez, I.D.L.: Sentence-level classification using parallel fuzzy deep learning classifier. IEEE Access 9, 17943–17985 (2021). https://doi.org/10.1109/ACCESS.2021.3053917

    Article  Google Scholar 

  33. Es-Sabery, F., Hair, A.: Big data solutions proposed for cluster computing systems challenges: a survey. In: Proceedings of the 3rd International Conference on Networking, Information Systems & Security, Marrakech, Morocco, pp. 1–7 (2020). https://doi.org/10.1145/3386723.3387826

  34. Uysal, A.K., Gunal, S.: The impact of preprocessing on text classification. Inf. Process. Manag. 50(1), 104–112 (2014). https://doi.org/10.1016/j.ipm.2013.08.006

  35. Vijayarani, S., Ilamathi, J., Nithya: Preprocessing techniques for text mining - an overview. Int. J. Comput. Sci. Commun. Netw. 5(1), 7–16 (2015)

    Google Scholar 

  36. Abel, J., Teahan, W.: Universal text preprocessing for data compression. IEEE Trans. Comput. 54(5), 497–507 (2005). https://doi.org/10.1109/TC.2005.85

  37. Yao, Z., Ze-wen, C.: Research on the construction and filter method of stop-word list in text preprocessing. In: Proceedings 2011 Fourth International Conference on Intelligent Computation Technology and Automation, March 2011, vol. 1, pp. 217–221 (2011). https://doi.org/10.1109/ICICTA.2011.64

  38. Kruse, H., Mukherjee, A.: Preprocessing text to improve compression ratios. In: Proceedings DCC 1998 Data Compression Conference (Cat. No. 98TB100225), March 1998. https://doi.org/10.1109/DCC.1998.672295

  39. Anandarajan, M., Hill, C., Nolan, T.: Text preprocessing. In: Anandarajan, M., Hill, C., Nolan, T. (eds.) Practical Text Analytics. AADS, vol. 2, pp. 45–59. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-95663-3_4

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of computer science, Faculty of Sciences and Technology, Sultan Moulay Slimane University, 23000, Beni Mellal, Morocco

    Fatima Es-sabery & Abdellatif Hair

  2. Department of computer science, National School of Applied Sciences, Cadi Ayyad University, 40000, Marrakech, Morocco

    Khadija Es-sabery

Authors
  1. Fatima Es-sabery
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Khadija Es-sabery
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdellatif Hair
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Université Sultan Moulay Slimane, Beni-Mellal, Morocco

    Mohamed Fakir

  2. Université Sultan Moulay Slimane, Beni-Mellal, Morocco

    Mohamed Baslam

  3. Université Sultan Moulay Slimane, Beni-Mellal, Morocco

    Rachid El Ayachi

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Es-sabery, F., Es-sabery, K., Hair, A. (2021). A MapReduce Improved ID3 Decision Tree for Classifying Twitter Data. In: Fakir, M., Baslam, M., El Ayachi, R. (eds) Business Intelligence. CBI 2021. Lecture Notes in Business Information Processing, vol 416. Springer, Cham. https://doi.org/10.1007/978-3-030-76508-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-76508-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-76507-1

  • Online ISBN: 978-3-030-76508-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation