skip to main content
10.1145/2633211.2634347acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
poster

A language modeling approach to entity recognition and disambiguation for search queries

Published: 11 July 2014 Publication History

Abstract

The Entity Recognition and Disambiguation (ERD) problem refers to the task of recognizing mentions of entities in a given query string, disambiguating them, and mapping them to entities in a given Knowledge Base(KB). If there are multiple ways to interpret the query, then an ERD system is supposed to group candidate entity annotations into consistent interpretations.
In this paper, we propose a four step solution to this problem. First, we generate candidate entity strings by segmenting queries in different ways. Second, we retrieve candidate entities by searching for these candidate entity stringsin Freebase. Third, we rank the candidate entities using language model based query likelihood scores. Finally, we group the entity annotations into interpretations. We also present both quantitative and qualitative evaluation of our methods based on 91 training, 500 validation and 1000 test queries. Our system achieved an F1 score of 0.42 on the set of validation queries, whereas the NULL baseline which returns no annotations for any query achieved an F1 score of 0.3. Similarly, on the test queries, our method achieved an F1 score of 0.36 and outperformed the NULL baseline which achieved an F1 score of 0.2.

References

[1]
DBPedia data dumps. 2013. http://wiki.dbpedia.org/Downloads39.
[2]
FreeBase data dumps. 2013. https://developers.google.com/freebase/data.
[3]
E. Agirre, O. L. de Lacalle, and A. Soroa. Random walks for knowledge-based word sense disambiguation. In Computational Linguistics, 2013.
[4]
D. Carmel, M.-W. Chang, E. Gabrilovich, B.-J. P. Hsu, and K. Wang. ERD 2014: Entity recognition and disambiguation challenge. SIGIR Forum, 2014 (forthcoming).
[5]
J. Guo, G. Xu, X. Cheng, and H. Li. Named entity recognition in query. In Proceedings of the 32Nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR, 2009.
[6]
X. Han, L. Sun, and J. Zhao. Collective entity linking in web text: a graph-based method. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, 2011.
[7]
J. Krishnamurthy and T. M. Mitchell. Which noun phrases denote which concepts? In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011.
[8]
S. Kulkarni, A. Singh, G. Ramakrishnan, and S. Chakrabarti. Collective annotation of wikipedia entities in web text. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, 2009.
[9]
T. Lin, O. Etzioni, et al. Entity linking at web scale. In Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction, 2012.
[10]
Y. Liu, P. Scheuermann, X. Li, and X. Zhu. Using wordnet to disambiguate word senses for text classification. In Computational Science ICCS. 2007.
[11]
C. D. Manning, P. Raghavan, and H. Schtze. Introduction to information retrieval. In Cambridge University Press, 2008.
[12]
D. Nadeau and S. Sekine. A survey of named entity recognition and classification. Lingvisticae Investigationes, 2007.
[13]
L. Ratinov and D. Roth. Design challenges and misconceptions in named entity recognition. In Proceedings of the Thirteenth Conference on Computational Natural Language Learning, 2009.
[14]
L. Ratinov, D. Roth, D. Downey, and M. Anderson. Local and global algorithms for disambiguation to wikipedia. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011.
[15]
S. Sekine and E. Ranchhod. Named entities: recognition, classification and use. John Benjamins Publishing, 2009.
[16]
C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Transactions on Information Systems (TOIS), 2004.

Cited By

View all
  • (2017)Entity recognition and disambiguation for natural-language spatial search queries2017 3th International Conference on Web Research (ICWR)10.1109/ICWR.2017.7959301(32-37)Online publication date: Apr-2017
  • (2015)On an Empirical Study of Smoothing Techniques for a Tiny Language ModelProceedings of the International Conference on Intelligent Information Processing, Security and Advanced Communication10.1145/2816839.2816878(1-5)Online publication date: 23-Nov-2015
  • (2015)Automatic Gloss Finding for a Knowledge Base using Ontological ConstraintsProceedings of the Eighth ACM International Conference on Web Search and Data Mining10.1145/2684822.2685288(369-378)Online publication date: 2-Feb-2015
  • Show More Cited By

Index Terms

  1. A language modeling approach to entity recognition and disambiguation for search queries

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ERD '14: Proceedings of the first international workshop on Entity recognition & disambiguation
    July 2014
    134 pages
    ISBN:9781450330237
    DOI:10.1145/2633211
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 July 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. entity linking
    2. language modeling

    Qualifiers

    • Poster

    Conference

    SIGIR '14
    Sponsor:

    Acceptance Rates

    ERD '14 Paper Acceptance Rate 18 of 28 submissions, 64%;
    Overall Acceptance Rate 18 of 28 submissions, 64%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2017)Entity recognition and disambiguation for natural-language spatial search queries2017 3th International Conference on Web Research (ICWR)10.1109/ICWR.2017.7959301(32-37)Online publication date: Apr-2017
    • (2015)On an Empirical Study of Smoothing Techniques for a Tiny Language ModelProceedings of the International Conference on Intelligent Information Processing, Security and Advanced Communication10.1145/2816839.2816878(1-5)Online publication date: 23-Nov-2015
    • (2015)Automatic Gloss Finding for a Knowledge Base using Ontological ConstraintsProceedings of the Eighth ACM International Conference on Web Search and Data Mining10.1145/2684822.2685288(369-378)Online publication date: 2-Feb-2015
    • (2014)ERD'14ACM SIGIR Forum10.1145/2701583.270159148:2(63-77)Online publication date: 23-Dec-2014

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media