skip to main content
10.1145/2063576.2063875acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
poster

Efficient phrase querying with flat position index

Published: 24 October 2011 Publication History

Abstract

A large proportion of search engine queries contain phrases,namely a sequence of adjacent words. In this paper, we propose to use flat position index (a.k.a schema-independent index) for phrase query evaluation. In the flat position index, the entire document collection is viewed as a huge sequence of tokens. Each token is represented by one flat position, which is a unique position offset from the beginning of the collection. Each indexed term is associated with a list of the flat positions about that term in the sequence. To recover DocID from flat positions efficiently, we propose a novel cache sensitive look-up table (CSLT), which is much faster than existing search algorithms. Experiments on TREC GOV2 data collection show that flat position index can reduce the index size and speed up phrase querying substantially, compared with traditional word-level index.

References

[1]
V. N. Anh and A. Moffat. Inverted index compression using word-aligned binary codes. Inf. Retr., 2005.
[2]
V. N. Anh and A. Moffat. Structured index organizations for high-throughput text querying. In SPIRE, 2006.
[3]
D. Bahle, H. E. Williams, and J. Zobel. Efficient phrase querying with an auxiliary index. In SIGIR, 2002.
[4]
S. Büttcher and C. L. A. Clarke. Index compression is good, especially for random access. In CIKM, pages 761--770, New York, NY, USA, 2007. ACM.
[5]
C. L. Clarke, G. V. Cormack, and F. J. Burkowski. An Algebra for Structured Text Search and A Framework for its Implementation. The Computer Journal, 1995.
[6]
J. Dean. Invited talk: Challenges in building large-scale information retrieval systems. In WSDM, 2009.
[7]
C. Silverstein, H. Marais, M. Henzinger, and M. Moricz. Analysis of a very large web search engine query log. SIGIR Forum, 1999.
[8]
T. Strohman and W. B. Croft. Efficient document retrieval in main memory. In SIGIR, 2007.
[9]
J. Teevan, D. Ramage, and M. R. Morris. #twittersearch: a comparison of microblog search and web search. In WSDM, 2011.
[10]
H. E. Williams, J. Zobel, and D. Bahle. Fast phrase querying with combined indexes. ACM Trans. Inf. Syst., 2004.

Cited By

View all
  • (2017)Topic Modeling for Unsupervised Concept Extraction and Document RankingIntelligent Systems Technologies and Applications10.1007/978-3-319-68385-0_11(123-135)Online publication date: 21-Oct-2017
  • (2015)On the Cost of Phrase-Based RankingProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/2766462.2767769(931-934)Online publication date: 9-Aug-2015
  • (2014)Phrase Queries with Inverted + Direct IndexesWeb Information Systems Engineering – WISE 201410.1007/978-3-319-11749-2_13(156-169)Online publication date: 2014
  • Show More Cited By

Index Terms

  1. Efficient phrase querying with flat position index

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '11: Proceedings of the 20th ACM international conference on Information and knowledge management
    October 2011
    2712 pages
    ISBN:9781450307178
    DOI:10.1145/2063576
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 October 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. flat position index
    2. phrase query
    3. query evaluation

    Qualifiers

    • Poster

    Conference

    CIKM '11
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2017)Topic Modeling for Unsupervised Concept Extraction and Document RankingIntelligent Systems Technologies and Applications10.1007/978-3-319-68385-0_11(123-135)Online publication date: 21-Oct-2017
    • (2015)On the Cost of Phrase-Based RankingProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/2766462.2767769(931-934)Online publication date: 9-Aug-2015
    • (2014)Phrase Queries with Inverted + Direct IndexesWeb Information Systems Engineering – WISE 201410.1007/978-3-319-11749-2_13(156-169)Online publication date: 2014
    • (2012)Reordering an index to speed query processing without loss of effectivenessProceedings of the Seventeenth Australasian Document Computing Symposium10.1145/2407085.2407088(17-24)Online publication date: 5-Dec-2012
    • (2012)To index or not to indexProceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval10.1145/2348283.2348320(255-264)Online publication date: 12-Aug-2012

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media