Abstract
Keywords provide rich semantic information for documents. It benefits many applications such as topic retrieval, document clustering, etc. However, there still exist a large amount documents without keywords. Manually assigning keywords to existing documents is very laborious. Therefore it is highly desirable to automate the process. Traditional methods are mainly based on a predefined controlled-vocabulary, which is limited by unknown words. This paper presents a new approach based on Bayesian decision theory. The approach casts keyword distillation to a problem of loss minimization. To determine which word can be assigned as keywords becomes a problem to estimate the loss. Feature selection is one of the most important issues in machine learning. Several plausible attributes are always be assigned as the learning features, but they are all based on the assumption of words’ independence. Machine learning based on them dose not produce satisfactory results. In this paper, taking the word’ context and linkages between words into account, we extend the work of feature selection. Experiments show that our approach significantly improves the quality of extracted keywords.
Supported by the National Natural Science Foundation of China under Grant No. 60443002
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dumais, S.T., Platt, J., Heckerman, D., Sahami, M.: Inductive learning algorithms and representations for text categorization. In: Proceedings of the 7th International Conference on Information and Knowledge Management (1998)
Turney, P.D.: Learning to extract keyphrases from text. Technical Report ERB-1057, National Research Council, Institute for Information Technology (1999)
Frank, E., Paynter, G.W., Witten, I.H.: Domain-Specific Keyphrase Extraction. In: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI 1999), Stockholm, Sweden, pp. 668–673. Morgan Kaufmann, San Francisco (1999)
Daille, B., Gaussier, E., Lang’e, J.-M.: Towards Automatic Extraction of Monolingual and Bilingual Terminology. In: Proceedings of COLING 1994, vol. 9, pp. 515–521 (1994)
Witten, I.H., Paynter, G.W., et al.: KEA: Practical Automatic Keyphrase Extraction. In: Proceedings Fourth ACM Conference on Digital Libraries, Berkeley, CA, pp. 254–255 (1999)
RodrĂguez, J.V.H., et al.: Improving term extraction by combining different techniques. Terminology 7, 1 (2001)
Quinlan, J.R.: C4.5: Programs for machine learning. Morgan Kaufmann, California (1993)
Berger, J.: Statistical decision theory and Bayesian analysis. Springer, Heidelberg (1985)
Jie, T.: Loss Minimization based Keyword Distillation. Technique Report (2003), ftp://keg.cs.tsinghua.edu.cn/publications
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tang, J., Li, JZ., Wang, KH., Cai, YR. (2004). Loss Minimization Based Keyword Distillation. In: Yu, J.X., Lin, X., Lu, H., Zhang, Y. (eds) Advanced Web Technologies and Applications. APWeb 2004. Lecture Notes in Computer Science, vol 3007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24655-8_62
Download citation
DOI: https://doi.org/10.1007/978-3-540-24655-8_62
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21371-0
Online ISBN: 978-3-540-24655-8
eBook Packages: Springer Book Archive