Abstract
In this paper, we mainly study and propose an approach to improve document classification using domain knowledge. First we introduce a domain knowledge dictionary NEUKD, and propose two models which use domain knowledge as textual features for text categorization. The first one is BOTW model which uses domain associated terms and conventional words as textual features. The other one is BOF model which uses domain features as textual features. But due to limitation of size of domain knowledge dictionary, we study and use a machine learning technique to solve the problem, and propose a BOL model which could be considered as the extended version of BOF model. In the comparison experiments, we consider naïve Bayes system based on BOW model as baseline system. Comparison experimental results of naïve Bayes systems based on those four models (BOW, BOTW, BOF and BOL) show that domain knowledge is very useful for improving text categorization. BOTW model performs better than BOW model, and BOL and BOF models perform better than BOW model in small number of features cases. Through learning new features using machine learning technique, BOL model performs better than BOF model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ittner, D.J., Lewis, D.D., Ahn, D.D.: Text categorization of low quality images. In: Symposium on Document Analysis and Information Retrieval, Las Vegas, Las Vegas (1995)
Lewis, D., Schapire, R., Callan, J., Papka, R.: Training Algorithms for Linear Text Classifiers. In: Proceedings of ACM SIGIR, pp. 298–306 (1996)
Joachims, T.: Text categorization with Support Vector Machines: Learning with many relevant features. In: Machine Learning: ECML 1998, Tenth European Conference on Machine Learning, pp. 137–142 (1998)
Lewis, D.: A Comparison of Two Learning Algorithms for Text Categorization. In: Symposium on Document Analysis and IR (1994)
Nigam, K., Lafferty, J., McCallum, A.: Using maximum entropy for text classification. In: IJCAI 1999 Workshop on Machine Learning for Information Filtering, pp. 61–67 (1999)
McCallum, Nigam, K.: A Comparison of Event Models for naïve Bayes Text Classification. In: AAAI 1998 Workshop on Learning for Text Categorization (1998)
Scott, Matwin, S.S.: Text classification using WordNet hypernyms. In: Proceedings of the COLING/ACL Workshop on Usage of WordNet in Natural Language Processing Systems, Montreal (1998)
Lee, S., Shishibori, M.: Passage Segmentation Based on Topic Matter. Computer Processing of Oriental Languages 15(3), 305–340 (2002)
Jingbo, Z., Tianshun, Y.: FIFA-based Text Classification. Journal of Chinese Information Processing 16(3) (2002) (in Chinese)
Wenliang, C., Jingbo, Z., Tianshun, Y.: Automatic Learning Field Words by Bootstrapping. In: Proceedings of the 7th national conference on computational linguistics, JSCL 2003 (2003) (in Chinese)
Yang, Y., Liu, X.: A re-examination of text categorization methods. In: Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval (1999)
Wenliang, C., Xingzhi, C., Huizhen, W., Jingbo, Z., Tianshun, Y.: Automatic Word Clustering for Text Categorization Using Global Information. In: AIRS 2004, Beijing (2004)
China Library Categorization Editorial Board. China Library Categorization, 4th ed., Beijing, Beijing Library Press (1999) (in Chinese)
Tianshun, Y., Jingbo, Z., li, Z., Ying, Y.: Natural Language Processing-research on making computers understand human languages, Tsinghua University Press (2002) (In Chinese)
Salton, G., McGill, M.J.: An introduction to modern information retrieval. McGraw-Hill, New York (1983)
Baker, L.D., MCallum, A.K.: Distributional clustering of words for text classification. In: Proc. 21st Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 96–103 (1998)
Pereira, F., Tishby, N., Lee, L.: Distributional clustering of English words. In: 30th Annual Meeting of the ACL, pp. 183–190 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, J., Chen, W. (2005). Improving Text Categorization Using Domain Knowledge. In: Montoyo, A., Muńoz, R., Métais, E. (eds) Natural Language Processing and Information Systems. NLDB 2005. Lecture Notes in Computer Science, vol 3513. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11428817_10
Download citation
DOI: https://doi.org/10.1007/11428817_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26031-8
Online ISBN: 978-3-540-32110-1
eBook Packages: Computer ScienceComputer Science (R0)