Skip to main content

Classification of Documents Using Machine Learning and Genetic Algorithms

  • Conference paper
  • First Online:
Business Intelligence (CBI 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 416))

Included in the following conference series:

  • 1034 Accesses

Abstract

In the past few years, there has been rampant growth in the amount of complex documents that stand in need of a deeper understanding of machine learning methods to classify them in many applications. The success of these methods depends on their ability to understand complex patterns and nonlinear relationships in data. Yet, finding the right structures, architectures, and techniques for text classification is often a challenge for researchers. In this article, we present an automated document classification system based on two axes; the first regard the processing of natural language (NLP), along with the second that focuses on Machine Learning (ML) algorithms. In addition, a hybrid system that combines the best of classification models in a single strong system with a very high percentage of accuracy that we came to give rise to with the genetic algorithms (GA).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aas, K., Eikvil, L.: Text categorisation: A survey Technical report, Norwegian Computing Center (1999)

    Google Scholar 

  2. Aggarwal, C.C., Zhai, C.: A survey of text classification algorithms. In: Aggarwal, C., Zhai, C. (eds.) mining Text Data, pp. 163–222. Springer, Boston (2012). https://doi.org/10.1007/978-1-4614-3223-4_6

    Chapter  Google Scholar 

  3. Colas, F., Brazdil, P.: Comparison of SVM and some older classification algorithms in text classification tasks. In: Bramer, M. (ed.) Artificial Intelligence in Theory and Practice. IFIP International Federation for Information Processing, vol. 217, pp. 169–178. Springer, Boston (2006). https://doi.org/10.1007/978-0-387-34747-9_18

    Chapter  Google Scholar 

  4. An, Y., Tang, X., Xie, B.: Sentiment analysis for short Chinese text based on character-level methods. In: Proceedings of the 9th International Conference on Knowledge and Smart Technology (KST). IEEE. Chonburi, Thailand (2016)

    Google Scholar 

  5. Li, Y.H., Jain, A.K.: Classification of text documents. Comput. J. 41, 537–546 (1998)

    Article  Google Scholar 

  6. Brown, E.W., Chong, H.A.: The GURU system in TREC-6. In: The Sixth Text Retrieval Conference (TREC-6), pp. 535–540. National Institute of Standards and Technology (NIST) (1998)

    Google Scholar 

  7. Sebastiani, F.: A tutorial on automated text categorization. In: Proceedings of ASAI-99, 1st Argentinian Symposium on Artificial Intelligence. Buenos Aires, AR (1999)

    Google Scholar 

  8. HuilGol, P.: Quick Introduction to Bag-of-Words (BoW) and TF-IDF for Creating Features from Text, 28 February 2020

    Google Scholar 

  9. Rajaraman, A., Ullman, J.D.: Mining of Massive Datasets, pp. 1–17 (2011)

    Google Scholar 

  10. Hakim, A.A., Erwin, A., Eng, K.I., Galinium, M., Muliady, W.: Automated document classification for news article in Bahasa Indonesia based on term frequency inverse document frequency (TF-IDF) approach (2015)

    Google Scholar 

  11. Yiu, T.: Understanding random forest. Towardsdatascience.com, 12 June 2019

    Google Scholar 

  12. Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, New York (1973)

    MATH  Google Scholar 

  13. Gandhi, R.: Support vector Machine-Introduction to Machine learning Algorithms, 7 June 2018

    Google Scholar 

  14. Tam, V., Santoso, A., Setiono, R.: A comparative study of centroid-based, neighborhood-based and statistical approaches for effective document categorization. In: Object Recognition Supported by User Interaction for Service Robots, vol. 4. IEEE (2002)

    Google Scholar 

  15. https://archive.ics.uci.edu/ml/datasets/SMS+Spam+Collection

  16. https://ai.stanford.edu/~amaas/data/sentiment/

  17. https://mlg.ucd.ie/datasets/bbc.html

  18. https://www.kaggle.com/zarajamshaid/language-identification-datasst

  19. McCall, J.: Genetic algorithms for modelling and optimisation. J. Comput. Appl. Math. 184(1), 205–222 (2005)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ahle Touate, C., Zougagh, H. (2021). Classification of Documents Using Machine Learning and Genetic Algorithms. In: Fakir, M., Baslam, M., El Ayachi, R. (eds) Business Intelligence. CBI 2021. Lecture Notes in Business Information Processing, vol 416. Springer, Cham. https://doi.org/10.1007/978-3-030-76508-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-76508-8_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-76507-1

  • Online ISBN: 978-3-030-76508-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics