Abstract
MEDLINE is a widely used very large database of natural language medical data, mainly abstracts of research papers in medical domain. The documents in it are manually supplied with keywords from a controlled vocabulary, called MeSH terms. We show that (1) a vector space model-based retrieval system applied to the full text of the documents gives much better results than the Boolean model-based system supplied with MEDLINE, and (2) assigning greater weights to the MeSH terms than to the terms in the text of the documents provides even better results than the standard vector space model. The resulting system outperforms the retrieval system supplied with MEDLINE as much as 2.4 times.
Work supported by the ITRI of the Chung-Ang University.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dhillon, I.S., Modha, D.S.: Concept Decomposition for Large Sparse Text Data using Clustering. Technical Report RJ 10147(9502), IBM Almaden Research Center (1999)
Dhillon, I.S., Fan, J., Guan, Y.: Efficient Clustering of Very Large Document Collections. In: Data Mining for Scientific and Engineering Applications, Kluwer, Dordrecht (2001)
Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison-Wesley, Reading (1999)
Frakes, W.B., Baeza-Yates, R.: Information Retrieval: Data Structures and Algorithms. Prentince Hall, Englewood Cliffs (1992)
Gelbukh, A.: Lazy Query Enrichment: A Simple Method of Indexing Large Specialized Document Bases. In: Ibrahim, M., Küng, J., Revell, N. (eds.) DEXA 2000. LNCS, vol. 1873, pp. 526–535. Springer, Heidelberg (2000)
Gelbukh, A., Sidorov, G., Guzmán-Arenas, A.: A Method of Describing Document Contents through Topic Selection. In: Proc. SPIRE 1999, String Processing and Information Retrieval, pp. 73–80. IEEE Computer Society Press, Los Alamitos (1999)
Ide, E.: New experiments in relevance feedback. In: Salton, G. (ed.) The SMART Retrieval System, pp. 337–354. Prentice-Hall, Englewood Cliffs (1971)
Lowe, H.J., Barnett, O.: Understanding and using the medical subject headings (MeSH) vocabulary to perform literature searches. J. American Medical Association 273(184) (1995)
Montes-y-Gomez, M., López López, A., Gelbukh, A.: Document Title Patterns in Information Retrieval. In: MatouÅ¡ek, V., Mautner, P., OcelÃková, J., Sojka, P. (eds.) TSD 1999. LNCS (LNAI), vol. 1692, pp. 364–367. Springer, Heidelberg (1999)
Montes-y-Gomez, M., López López, A., Gelbukh, A.: Information Retrieval with Conceptual Graph Matching. In: Ibrahim, M., Küng, J., Revell, N. (eds.) DEXA 2000. LNCS, vol. 1873, pp. 312–321. Springer, Heidelberg (2000)
MEDLINE Fact Sheet, http://www.nlm.nih.gov/pubs/factsheets/medline.html
Porter, M.: An algorithm for suffix stripping. Program 14, 130–137 (1980)
Salton, G., McGill, M.J.: Introduction to Modern Retrieval. McGraw-Hill, New York (1983)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shin, K., Han, SY. (2004). Improving Information Retrieval in MEDLINE by Modulating MeSH Term Weights. In: Meziane, F., Métais, E. (eds) Natural Language Processing and Information Systems. NLDB 2004. Lecture Notes in Computer Science, vol 3136. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27779-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-27779-8_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22564-5
Online ISBN: 978-3-540-27779-8
eBook Packages: Springer Book Archive