skip to main content
10.1145/2348283.2348458acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
poster

Clarity re-visited

Published: 12 August 2012 Publication History

Abstract

We present a novel interpretation of Clarity [5], a widely used query performance predictor. While Clarity is commonly described as a measure of the "distance" between the language model of the top-retrieved documents and that of the collection, we show that it actually quantifies an additional property of the result list, namely, its diversity. This analysis, along with empirical evaluation, helps to explain the low prediction quality of Clarity for large-scale Web collections.

References

[1]
N. Balasubramanian, G. Kumaran, and V. R. Carvalho. Predicting query performance on the web. In Proceedings of SIGIR, pages 785--786, 2010.
[2]
D. Carmel and E. Yom-Tov. Estimating the Query Difficulty for Information Retrieval. Synthesis lectures on information concepts, retrieval, and services. Morgan & Claypool, 2010.
[3]
C. L. A. Clarke, N. Craswell, and I. Soboroff. Overview of the TREC 2009 Web track. In Proceedings of TREC, 2009.
[4]
G. V. Cormack, M. D. Smucker, and C. L. A. Clarke. Efficient and effective spam filtering and re-ranking for large web datasets. CoRR, abs/1004.5168, 2010.
[5]
S. Cronen-Townsend, Y. Zhou, and W. B. Croft. Predicting query performance. In Proceedings of SIGIR, pages 299--306, 2002.
[6]
C. Hauff, V. Murdock, and R. Baeza-Yates. Improved query difficulty prediction for the web. In Proceedings of CIKM, pages 439--448, 2008.
[7]
B. He and I. Ounis. Inferring query performance using pre-retrieval predictors. In Proceedings of SPIRE, pages 43--54, 2004.

Cited By

View all
  • (2018)An Extended Query Performance Prediction Framework Utilizing Passage-Level InformationProceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3234944.3234946(35-42)Online publication date: 10-Sep-2018
  • (2015)Combining relevance language modeling and clarity measure for extractive speech summarizationIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2015.241482023:6(957-969)Online publication date: 1-Jun-2015
  • (2013)Using document-quality measures to predict web-search effectivenessProceedings of the 35th European conference on Advances in Information Retrieval10.1007/978-3-642-36973-5_12(134-145)Online publication date: 24-Mar-2013
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
August 2012
1236 pages
ISBN:9781450314725
DOI:10.1145/2348283

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. clarity
  2. query-performance prediction

Qualifiers

  • Poster

Conference

SIGIR '12
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)An Extended Query Performance Prediction Framework Utilizing Passage-Level InformationProceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3234944.3234946(35-42)Online publication date: 10-Sep-2018
  • (2015)Combining relevance language modeling and clarity measure for extractive speech summarizationIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2015.241482023:6(957-969)Online publication date: 1-Jun-2015
  • (2013)Using document-quality measures to predict web-search effectivenessProceedings of the 35th European conference on Advances in Information Retrieval10.1007/978-3-642-36973-5_12(134-145)Online publication date: 24-Mar-2013
  • (2012)Back to the rootsProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2396866(823-832)Online publication date: 29-Oct-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media