skip to main content
10.1145/1148170.1148203acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
Article

Context-sensitive semantic smoothing for the language modeling approach to genomic IR

Published: 06 August 2006 Publication History

Abstract

Semantic smoothing, which incorporates synonym and sense information into the language models, is effective and potentially significant to improve retrieval performance. The implemented semantic smoothing models, such as the translation model which statistically maps document terms to query terms, and a number of works that have followed have shown good experimental results. However, these models are unable to incorporate contextual information. Thus, the resulting translation might be mixed and fairly general. To overcome this limitation, we propose a novel context-sensitive semantic smoothing method that decomposes a document or a query into a set of weighted context-sensitive topic signatures and then translate those topic signatures into query terms. In detail, we solve this problem through (1) choosing concept pairs as topic signatures and adopting an ontology-based approach to extract concept pairs; (2) estimating the translation model for each topic signature using the EM algorithm; and (3) expanding document and query models based on topic signature translations. The new smoothing method is evaluated on TREC 2004/05 Genomics Track collections and significant improvements are obtained. The MAP (mean average precision) achieves a 33.6% maximal gain over the simple language model, as well as a 7.8% gain over the language model with context-insensitive semantic smoothing.

References

[1]
Bai, J., Song, D., Bruza, P., Nie, J.Y., and Cao, G., "Query Expansion Using Term Relationships in Language Models for Information Retrieval", In Proceedings of the ACM 14th Conference on Information and Knowledge Management (CIKM), November 2005, Bremen, Germany.
[2]
Berger, A. and Lafferty J., "Information Retrieval as Statistical Translation", In Proceedings of the 22nd ACM SIGIR Conference on Research and Development in IR, 1999, pp.222--229.
[3]
Cao, G., Nie, J.Y., and Bai, J., "Integrating Word Relationships into Language Models", Proceedings of the 28th annual international ACM SIGIR conference on Research and Development in Information Retrieval, 2005, pp. 298--305
[4]
Dempster, A.P., Laird, N.M., and Rubin, D.B., "Maximum likelihood from incomplete data via the EM algorithm", Journal of the Royal Statistical Society, 1977, 39: 1--38.
[5]
Grefenstette, G., "Use of syntactic context to produce term association lists for information retrieval", Proceedings of the 15th annual international ACM SIGIR conference on Research and Development in Information Retrieval, 1992, pp. 89--97
[6]
Harabagiu, S. and Lacatusu, F., "Topic themes for multi-document summarization", 2005 ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05), 2005, pp. 42--48
[7]
Hersh, W. et al. "TREC 2004 Genomics Track Overview", the Thirteenth Text Retrieval Conference, 2004.
[8]
Hersh, W. et al. "TREC 2005 Genomics Track Overview", the Fourteenth Text Retrieval Conference, 2005.
[9]
Jin, R., Hauptmann, A., and Zhai, C., "Title Language Model for Information Retrieval", 2002 ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'02), 2002, pp. 42--48
[10]
Lafferty, J. and Zhai, C., "Document Language Models, Query Models, and Risk Minimization for Information Retrieval", In Proceedings of the 24th ACM SIGIR Conference on Research and Development in IR, 2001, pp.111--119.
[11]
Liu, X. and Croft, W.B., "Cluster-based retrieval using language models", In Proceedings of the 24th ACM SIGIR Conference on Research and Development in IR, 2001, pp.186--193.
[12]
Miller, D., Leek, T., and Schwartz M.R., "A Hidden Markov Model Information Retrieval System", In Proceedings of SIGIR-99, 22nd ACM International Conference on Research and Development in Information Retrieval, 1999, pp 214--221.
[13]
Mooney, R. J. and Bunescu, R. "Mining Knowledge from Text Using Information Extraction", SIGKDD Explorations (special issue on Text Mining and Natural Language Processing), 7, 1 (2005), pp. 3--10.
[14]
Ponte, J. and Croft, W.B., "A Language Modeling Approach to Information Retrieval", In Proceedings of the 21st ACM SIGIR Conference on Research and Development in IR, 1998, pp.275--281.
[15]
Song, D. and Bruza P.D., "Towards Context-sensitive Information Inference", Journal of the American Society for Information Science and Technology (JASIST), 2003, Vol. 54, 321--334.
[16]
Zhai, C. and Lafferty, J., "A Study of Smoothing Methods for Language Models Applied to Ad hoc Information Retrieval", In Proceedings of the 24th ACM SIGIR Conference on Research and Development in IR, 2001, pp.334--342.
[17]
Zhai, C. and Lafferty, J., "Model-based Feedback in the Language Modeling Approach to Information Retrieval", In Proceedings of the 10th International Conference on Information and Knowledge Management, 2001, pp.403--410.
[18]
Zhai, C. and Lafferty, J., "Two-Stage Language Models for Information Retrieval", 2002 ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'02), 2002.
[19]
Zhou, X., Hu, X., Lin, X., Han, H., and Zhang, X., "Relation-based Document Retrieval for Biomedical Literature Databases", The 11th International Conference on Database Systems for Advanced Applications (DASFAA 2006), 12-15 April, 2006, Singapore, pp. 689--701
[20]
Zhou, X., Zhang, X., and Hu, X., "Using Concept-based Indexing to Improve Language Modeling Approach to Genomic IR", The 28th European Conference on Information Retrieval (ECIR' 2006), 10 - 12 April, 2006, London, UK, pp. 444--455.

Cited By

View all

Index Terms

  1. Context-sensitive semantic smoothing for the language modeling approach to genomic IR

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
    August 2006
    768 pages
    ISBN:1595933697
    DOI:10.1145/1148170
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 August 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. concept pair
    2. genomic information retrieval
    3. information retrieval
    4. language models
    5. semantic smoothing
    6. topic signature

    Qualifiers

    • Article

    Conference

    SIGIR06
    Sponsor:
    SIGIR06: The 29th Annual International SIGIR Conference
    August 6 - 11, 2006
    Washington, Seattle, USA

    Acceptance Rates

    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2016)Enterprise information systems state of the artComputers in Industry10.1016/j.compind.2016.03.00179:C(3-13)Online publication date: 1-Jun-2016
    • (2014)Efficient Algorithms for Clustering Data and Text StreamsEncyclopedia of Information Science and Technology, Third Edition10.4018/978-1-4666-5888-2.ch170(1767-1776)Online publication date: 31-Jul-2014
    • (2013)Mining disease associated biomarker networks from PubMed2013 7th International Conference on Systems Biology (ISB)10.1109/ISB.2013.6623786(15-18)Online publication date: Aug-2013
    • (2012)Smoothing Text Representation Models Based on Rough SetQuantitative Semantics and Soft Computing Methods for the Web10.4018/978-1-60960-881-1.ch003(50-68)Online publication date: 2012
    • (2012)Towards a context sensitive approach to searching information based on domain specific knowledge sourcesJournal of Web Semantics10.1016/j.websem.2011.11.00912-13(41-52)Online publication date: Apr-2012
    • (2011)Particle swarm optimizer for variable weighting in clustering high-dimensional dataMachine Language10.1007/s10994-009-5154-282:1(43-70)Online publication date: 1-Jan-2011
    • (2010)Context-Based Semantic Approach to Ontology Creation of Maritime Information in ChineseProceedings of the 2010 IEEE International Conference on Granular Computing10.1109/GrC.2010.30(133-138)Online publication date: 14-Aug-2010
    • (2010)Conceptual language models for domain-specific retrievalInformation Processing and Management: an International Journal10.1016/j.ipm.2009.09.00546:4(448-469)Online publication date: 1-Jul-2010
    • (2010)Passage extraction and result combination for genomics information retrievalJournal of Intelligent Information Systems10.1007/s10844-009-0097-434:3(249-274)Online publication date: 1-Jun-2010
    • (2010)Fuzzy Methods on the Web: A Critical Discussion35 Years of Fuzzy Set Theory10.1007/978-3-642-16629-7_12(237-266)Online publication date: 2010
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media