Article

The role of knowledge in conceptual retrieval: a study in the domain of clinical medicine

Authors:

Dina Demner-FushmanAuthors Info & Claims

SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 99 - 106

https://doi.org/10.1145/1148170.1148191

Published: 06 August 2006 Publication History

Abstract

Despite its intuitive appeal, the hypothesis that retrieval at the level of "concepts" should outperform purely term-based approaches remains unverified empirically. In addition, the use of "knowledge" has not consistently resulted in performance gains. After identifying possible reasons for previous negative results, we present a novel framework for "conceptual retrieval" that articulates the types of knowledge that are important for information seeking. We instantiate this general framework in the domain of clinical medicine based on the principles of evidence-based medicine (EBM). Experiments show that an EBM-based scoring algorithm dramatically outperforms a state-of-the-art baseline that employs only term statistics. Ablation studies further yield a better understanding of the performance contributions of different components. Finally, we discuss how other domains can benefit from knowledge-based approaches.

References

[1]

G. Amati and C. van Rijsbergen. Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM TOIS, 20(4):357--389, 2002.

Digital Library

[2]

A. Aronson. Effective mapping of biomedical text to the UMLS Metathesaurus: The MetaMap program. In AMIA 2001.

[3]

N. Belkin. Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science, 5:133--143, 1980.

[4]

C. Buckley and D. Harman. Reliable information access final workshop report, 2004.

Digital Library

[5]

M. Chambliss and J. Conley. Answering clinical questions. The Journal of Family Practice, 43:140--144, 1996.

[6]

J. Chu-Carroll, J. Prager, C. Welty, K. Czuba, and D. Ferrucci. A multi-strategy and multi-source approach to question answering. In TREC 2002.

[7]

K. Cogdill and M. Moore. First-year medical students' information needs and resource selection: Responses to a clinical scenario. Bulletin of the Medical Library Association, 85(1):51--54, 1997.

[8]

D. Covell, G. Uman, and P. Manning. Information needs in office practice: Are they being met? Annals of Internal Medicine, 103(4):596--599, 1985.

[9]

H. Cui, R. Sun, K. Li, M.-Y. Kan, and T.-S. Chua. Question answering passage retrieval using dependency relations. In SIGIR 2005.

Digital Library

[10]

S. De Groote and J. Dorsch. Measuring use patterns of online journals and databases. Journal of the Medical Library Association, 91(2):231--241, 2003.

[11]

D. Demner-Fushman and J. Lin. Knowledge extraction for clinical question answering: Preliminary results. In Proc. of the AAAI 2005 Workshop on Question Answering in Restricted Domains.

[12]

D. Demner-Fushman and J. Lin. Answering clinical questions with knowledge-based and statistical techniques. Computational Linguistics, 2006, in press.

Digital Library

[13]

J. Ely, J. Osheroff, M. Ebell, G. Bergus, B. Levy, M. Chambliss, and E. Evans. Analysis of questions asked by family doctors regarding patient care. BMJ, 319:358--361, 1999.

[14]

J. Fagan. Experiments in Automatic Phrase Indexing for Document Retrieval: A Comparisons of Syntactic and Non-Syntactic Methods. Ph.D., Cornell, 1987.

[15]

L. Freund, E. Toms, and C. Clarke. Modeling task-genre relationships for IR in the Workplace. In SIGIR 2005.

Digital Library

[16]

J. Gao, J.-Y. Nie, G. Wu, and G. Cao. Dependence language model for information retrieval In SIGIR 2004.

Digital Library

[17]

P. Gorman, J. Ash, and L. Wykoff. Can primary care physicians' questions be answered using the medical journal literature? Bulletin of the Medical Library Association, 82(2):140--146, 1994.

[18]

W. Hersh, A. Cohen, J. Yang, R. Bhupatiraju, P. Roberts, and M. Hearst. TREC 2005 genomics track overview. In TREC 2005.

[19]

L. Hirschman and R. Gaizauskas. Natural language question answering: The view from here. Natural Language Engineering, 7(4):275--300, 2001.

Digital Library

[20]

P. Ingwersen. Cognitive information retrieval. ARIST, 34:3--52, 1999.

[21]

N. Kando and M.-K. Leong. Workshop on patent retrieval: SIGIR 2000 workshop report. SIGIR Forum, 34(1):28--30, 2000.

Digital Library

[22]

S.-B. Kim, H.-C. Seo, and H.-C. Rim. Information retrieval using word sense: Root sense tagging approach. In SIGIR 2004.

Digital Library

[23]

D. Lenat. CYC: A large-scale investment in knowledge infrastructure. CACM, 38(11):33--38, 1995.

Digital Library

[24]

D. Lindberg, B. Humphreys, and A. McCray. The Unified Medical Language System. Methods of Information in Medicine, 32(4):281--291, 1993.

[25]

D. Metzler and W. Croft. A Markov random field model for term dependencies. In SIGIR 2005.

Digital Library

[26]

D. Metzler and W. Croft. Combining the language model and inference network approaches to retrieval. Information Processing and Management, 40(5):735--750, 2004.

Digital Library

[27]

R. Mihalcea and D. Moldovan. Semantic indexing using WordNet senses. In Proc. of ACL 2000 Workshop on Recent Advances in NLP and IR.

Digital Library

[28]

D. Moldovan, M. Paşca, S. Harabagiu, and M. Surdeanu. Performance issues and error analysis in an open-domain question answering system. In ACL 2002.

Digital Library

[29]

S. Narayanan and S. Harabagiu. Question answering based on semantic structures. In COLING 2004.

Digital Library

[30]

J. Ponte and W. Croft. A language modeling approach to information retrieval. In SIGIR 1998.

Digital Library

[31]

W. Richardson, M. Wilson, J. Nishikawa, and R. Hayward. The well-built clinical question: A key to evidence-based decisions American College of Physicians Journal Club, 123(3):A12--A13, 1995.

[32]

T. Rindflesch and M. Fiszman. The interaction of domain knowledge and linguistic structure in natural language processing: Interpreting hypernymic propositions in biomedical text. Journal of Biomedical Informatics, 36(6):462--477, 2003.

Digital Library

[33]

S. Robertson, S. Walker, S. Jones, M. Hancock-Beaulieu, and M. Gatford. Okapi at TREC-3. In TREC-3, 1994.

[34]

D. Sackett, S. Straus, W. Richardson, W. Rosenberg, and R. Haynes. Evidence-Based Medicine: How to Practice and Teach EBM. Churchill Livingstone, second edition, 2000.

[35]

G. Salton. A vector space model for information retrieval. CACM, 18(11):613--620, 1975.

Digital Library

[36]

M. Sanderson. Word-sense disambiguation and information retrieval. In SIGIR 1994.

Digital Library

[37]

A. Smeaton, R. O'Donnell, and F. Kelledy. Indexing structures derived from syntax in TREC-3: System description. In TREC-3, 1994.

[38]

E. Voorhees. Query expansion using lexical-semantic relations. In SIGIR 1994.

Digital Library

[39]

E. Voorhees. Using WordNet to disambiguate word senses for text retrieval. In SIGIR 1993.

Digital Library

Cited By

Yang LLi XMa ZLi LXiong NMa J(2023)IRGA: An Intelligent Implicit Real-time Gait Authentication System in Heterogeneous Complex ScenariosACM Transactions on Internet Technology10.1145/359453823:2(1-29)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3594538
Muscariello LPapalini MRoques OSardara MTran Van A(2023)Securing Scalable Real-time Multiparty Communications with Hybrid Information-centric NetworkingACM Transactions on Internet Technology10.1145/359358523:2(1-20)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3593585
Wang HWang ZZhang LLuo XWang X(2023)A Highly Stable Fusion Positioning System of Smartphone under NLoS Acoustic Indoor EnvironmentACM Transactions on Internet Technology10.1145/358976523:2(1-19)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3589765
Show More Cited By

Index Terms

The role of knowledge in conceptual retrieval: a study in the domain of clinical medicine
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

An expansion and reranking approach for annotation-based image retrieval from Web
Highlights
► We introduce a new expansion and reranking method for annotation-based image retrieval from Web pages. ► Applying expansion methods solely to either to document or query does not help to increase retrieval performance. ►...
Abstract
In this paper, we introduce an expansion and reranking approach for annotation based image retrieval from Web pages. Our suggestion considers an image retrieval system using the surrounding texts nearby the image in a Web page as ...
Knowledge-intensive conceptual retrieval and passage extraction of biomedical literature
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval

This paper presents a study of incorporating domain-specific knowledge (i.e., information about concepts and relationships between concepts in a certain domain) in an information retrieval (IR) system to improve its effectiveness in retrieving ...
Structured retrieval for question answering
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval

Bag-of-words retrieval is popular among Question Answering (QA) system developers, but it does not support constraint checking and ranking on the linguistic and semantic information of interest to the QA system. We present anapproach to retrieval for QA,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

August 2006

768 pages

ISBN:1595933697

DOI:10.1145/1148170

General Chair:
Efthimis N. Efthimiadis
University of Washington
,
Program Chairs:
Susan Dumais
Microsoft Research, Redmond
,
David Hawking
CSIRO ICT Centre, Canberra, Australia
,
Kalervo Järvelin,
University of Tampere, Finland

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 August 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR06

Sponsor:

SIGIR06: The 29th Annual International SIGIR Conference

August 6 - 11, 2006

Washington, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
1,107
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yang LLi XMa ZLi LXiong NMa J(2023)IRGA: An Intelligent Implicit Real-time Gait Authentication System in Heterogeneous Complex ScenariosACM Transactions on Internet Technology10.1145/359453823:2(1-29)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3594538
Muscariello LPapalini MRoques OSardara MTran Van A(2023)Securing Scalable Real-time Multiparty Communications with Hybrid Information-centric NetworkingACM Transactions on Internet Technology10.1145/359358523:2(1-20)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3593585
Wang HWang ZZhang LLuo XWang X(2023)A Highly Stable Fusion Positioning System of Smartphone under NLoS Acoustic Indoor EnvironmentACM Transactions on Internet Technology10.1145/358976523:2(1-19)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3589765
Gangwar AKumar S(2023)Concept Drift in Software Defect Prediction: A Method for Detecting and Handling the DriftACM Transactions on Internet Technology10.1145/358934223:2(1-28)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3589342
Borges PTaconet CChabridon SConan DCavalcante EBatista T(2023)Taming Internet of Things Application Development with the IoTvar MiddlewareACM Transactions on Internet Technology10.1145/358601023:2(1-21)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3586010
Chen JJiang WWu JLi KLi K(2023)Dynamic Personalized POI Sequence Recommendation with Fine-Grained ContextsACM Transactions on Internet Technology10.1145/358368723:2(1-28)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3583687
Dong YRan QChao XLi CYu S(2023)Personalized Individual Semantics Learning to Support a Large-Scale Linguistic Consensus ProcessACM Transactions on Internet Technology10.1145/353343223:2(1-27)Online publication date: 19-May-2023
https://dl.acm.org/doi/10.1145/3533432
Sankhavara JDave RDave BMajumder P(2020)Query specific graph-based query reformulation using UMLS for clinical information accessJournal of Biomedical Informatics10.1016/j.jbi.2020.103493(103493)Online publication date: Jun-2020
https://doi.org/10.1016/j.jbi.2020.103493
Yuan XXiaoli LShilei LQinwen SKe L(2019)Extracting PICO Elements From RCT Abstracts Using 1-2gram Analysis And Multitask ClassificationProceedings of the 3rd International Conference on Medical and Health Informatics10.1145/3340037.3340043(194-199)Online publication date: 17-May-2019
https://dl.acm.org/doi/10.1145/3340037.3340043
Lee JBlake CMcInnes B(2019)Evaluating ontology coverage and internal structure to better align patients with clinical trialsProceedings of the Association for Information Science and Technology10.1002/pra2.1456:1(157-165)Online publication date: 18-Oct-2019
https://doi.org/10.1002/pra2.14
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten