Abstract
We investigate two meta-model approaches for the task of automatic textual document categorization. The first approach is the linear combination approach. Based on the idea of distilling the characteristics of how we estimate the merits of each component algorithm, we propose three different strategies for the linear combination approach. The linear combination approach makes use of limited knowledge in the training document set. To address this limitation, we propose the second meta-model approach, called Meta-learning Using Document Feature characteristics (MUDOF), which employs a meta-learning phase using document feature characteristics. Document feature characteristics, derived from the training document set, capture some inherent properties of a particular category. Extensive experiments have been conducted on a real-world document collection and satisfactory performance is obtained.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
P.K. Chan and S.J. Stolfo. Comparative evaluation of voting and meta-learning on partitioned data. In Proceedings of the International Conference on Machine Learning (ICML’95), pages 90–98, 1995.
S. Dumais, J. Platt, D. Heckerman, and M. Sahami. Inductive learning algorithms and representations for text categorization. In Proceedings of the Seventh International Conference on Information and Knowledge Management, pages 148–155, 1998.
D.A. Hull, J.O. Pedersen, and H. Schutze. Method combination for document filtering. In Proceedings of the Nineteenth International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 279–287, 1996.
T. Joachims. Text categorization with support vector machines: Learning with many relevant features. In European Conference on Machine Learning (ECML’98), pages 137–142, 1998.
W. Lam and C.Y. Ho. Using a generalized instance set for automatic text categorization. In Proceedings of the Twenty-First International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 81–89, 1998.
W. Lam, K.F. Low, and C.Y. Ho. Using a Bayesian network induction approach for text categorization. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, (IJCAI), Nagoya, Japan, pages 745–750, 1997.
L.S. Larkey and W.B. Croft. Combining classifiers in text categorization. In Proceedings of the Nineteenth International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 289–297, 1996.
D.D. Lewis, R.E. Schapore, J.P. Call, and R. Papka. Training algorithms for linear text classifiers. In Proceedings of the Nineteenth International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 298–306, 1996.
V. Vapnic. The Nature of Statistical Learning Theory. Springer, New York, 1995.
Y. Yang. Expert network: Effective and efficient learning from human decisions in text categorization and retrieval. In Proceedings of the Seventeenth International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 13–22, 1994.
Y. Yang, T. Ault, and T. Pierce. Combining multiple learning strategies for effective cross validation. In Proceedings of the International Conference on Machine Learning (ICML 2000), pages 1167–1174, 2000.
Y. Yang and C.D. Chute. An example-based mapping method for text categorization and retrieval. ACM Transactions on Information Systems, 12(3):252–277, 1994.
Y. Yang and X. Liu. A re-examination of text categorization methods. In Proceedings of the Twenty-First International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 42–49, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lai⋆, KY., Lam, W. (2001). Meta-learning Models for Automatic Textual Document Categorization. In: Cheung, D., Williams, G.J., Li, Q. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2001. Lecture Notes in Computer Science(), vol 2035. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45357-1_11
Download citation
DOI: https://doi.org/10.1007/3-540-45357-1_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41910-5
Online ISBN: 978-3-540-45357-4
eBook Packages: Springer Book Archive