Abstract
Text Categorization is a process of categorizing or labeling an unstructured Natural Language (NL) text to related categories with the help of a predefined set. In text categorization, pre-processing is a crucial step which is used for extracting non-trivial, interesting and useful input for further stages of the process of text categorization. As the words in text usually contains a lot of structural variations, so before accessing the information from documents, pre-processing techniques are applied on the data to minimize the size of the data which may increase efficacy of the result and better categorize the text. The main objective of this research is to Survey about the pre-processing techniques like Tokenization, Stop-words removing and Stemming. We’ll see how these techniques affect text categorization in good or may be bad ways.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Vijayarani, S., Ilamathi, M.J., Nithya, M.: Preprocessing techniques for text mining-an overview. Int. J. Comput. Sci. Commun. Netw. 5(1), 7–16 (2015)
Srividhya, V., Anitha, R.: Evaluating preprocessing techniques in text categorization. Int. J. Comput. Sci. Appl. 47(11), 49–51 (2010)
Dale, R., Moisl, H., Somers, H.: Handbook of Natural Language Processing. CRC Press, Boca Raton (2000)
Gurusamy, V., Kannan, S.: Preprocessing techniques for text mining. In: Conference Paper (2014)
Rajput, B.S., NilayKhare, A.: A survey of stemming algorithms for information retrieval. IOSR J. Comput. Eng. 17(3), 76–80 (2015)
Lovins, J.B.: Development of a stemming algorithm. Mech. Translat. Comp. Linguist. 11(1–2), 22–31 (1968)
Al-Shalabi, R., Kannan, G., Hilat, I., Ababneh, A., Al-Zubi, A.: Experiments with the successor variety algorithm using the cutoff and entropy methods. Inf. Technol. J. 4(1), 55–62 (2005)
Palmer, D.D.: Tokenisation and sentence segmentation. In: Handbook of Natural Language Processing, pp. 11–35 (2000)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Malik, S., Sani, S.A., Baqir, A., Ahmad, U., Mustafa, F.u. (2020). Preprocessing Techniques in Text Categorization: A Survey. In: Bajwa, I., Sibalija, T., Jawawi, D. (eds) Intelligent Technologies and Applications. INTAP 2019. Communications in Computer and Information Science, vol 1198. Springer, Singapore. https://doi.org/10.1007/978-981-15-5232-8_43
Download citation
DOI: https://doi.org/10.1007/978-981-15-5232-8_43
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-5231-1
Online ISBN: 978-981-15-5232-8
eBook Packages: Computer ScienceComputer Science (R0)