Abstract
In this paper we deal with the main aspect of the problem of extracting meaning from documents, namely, with the problem of text categorization, outlining a novel and systematic approach to its solution. We present a text categorization system for non-domain specific full-text documents. The main contribution of this paper lies on the feature extraction methodology which, first, involves word semantic categories and not raw words as other rival approaches. As a consequence of coping with the problem of dimensionality reduction, the proposed approach introduces a novel second and third order feature extraction approach for text categorization by considering word semantic categories cooccurrence analysis. The suggested methodology compares favorably to widely accepted, raw word frequency based techniques in a collection of documents concerning the Dewey Decimal Classification (DDC) system. In these comparisons different Multilayer Perceptrons (MLP) algorithms, the LVQ and the conventional k-NN technique are involved.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Merkl, D.: Text Classification with Self-Organizing Maps: Some lessons learned. Neurocomputing 21, 61–77 (1998)
Chen, H., et al.: Information Visualization for Collaborative Computing. IEEE Computer, 75–82 (August 1998)
Kohonen, T., et al.: Self-Organization of a Massive Document Collection. IEEE Trans. Neural Networks 11(3), 574–585 (2000)
Cohen, W.J., Singer, Y.: Context-sensitive learning methods for text categorization. In: SIGIR 1996: Proc. 19th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 307–315 (1996)
Yang, Y., Pedersen, J.P.: Feature selection in statistical learning of text categorization. In: The 14th Int. Conf. on Machine Learning, pp. 412–420 (1997)
Lewis, D., Ringuette, M.: A comparison of two learning algorithms for text classification. In: 3rd Annual Symposium on Document Analysis and Information Retrieval, pp. 81–93 (1994)
Joachims, T.: Text categorization with support vector machines: Learning with many relevant features. In: Proc. 10th European Conference on Machine Learning (ECML), Springer, Heidelberg (1998)
Wiener, E., Pedersen, J.O., Weigend, A.S.: A neural network approach to topic spotting. In: 4th annual symposium on document analysis and Information retrieval, pp. 22–34 (1993)
Salton, G., McGill, M.J.: An Introduction to Modern Information Retrieval. McGraw-Hill, New York (1983)
Aas, K., Eikvil, L.: Text Categorisation: A Survey, Technical Report, Norwegian Computing Center, P.B. 114 Blindern, N-0314 Oslo, Norway (1999)
Chan, M.L., Comaromi, J.P., Satija, M.P.: Dewey Decimal Classification: a practical guide. Forest Press, Albany (1994)
Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural Features for Image Classification. IEEE Trans. Syst., Man and Cybern. SMC-3(6), 610–621 (1973)
Haykin, S.: Neural Networks. A comprehensive foundation. Prentice-Hall, Englewood Cliffs (1999)
Zell, A., Mamier, G., Vogt, M., et al.: SNNS Stuttgart Neural Network Simulator, User Manual Version 4.1., Report No 6/95, University of Stuttgart, http://www-ra.informatik.uni-tuebingen.de/SNNS/UserManual/UserManual.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Karras, D.A. (2006). An Improved Text Categorization Methodology Based on Second and Third Order Probabilistic Feature Extraction and Neural Network Classifiers. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4251. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11892960_2
Download citation
DOI: https://doi.org/10.1007/11892960_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46535-5
Online ISBN: 978-3-540-46536-2
eBook Packages: Computer ScienceComputer Science (R0)