skip to main content
10.1145/2600428.2609540acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
poster

Predicting query performance in microblog retrieval

Published: 03 July 2014 Publication History

Abstract

Query Performance Prediction (QPP) is the estimation of the retrieval success for a query, without explicit knowledge about relevant documents. QPP is especially interesting in the context of Automatic Query Expansion (AQE) based on Pseudo Relevance Feedback (PRF). PRF-based AQE is known to produce unreliable results when the initial set of retrieved documents is poor. Theoretically, a good predictor would allow to selectively apply PRF-based AQE when performance of the initial result set is good enough, thus enhancing the overall robustness of the system. QPP would be of great benefit in the context of microblog retrieval, as AQE was the most widely deployed technique for enhancing retrieval performance at TREC. In this work we study the performance of the state of the art predictors under microblog retrieval conditions as well as introducing our own predictors. Our results show how our proposed predictors outperform the baselines significantly.

References

[1]
D. Carmel and E. Yom-Tov. Estimating the query difficulty for information retrieval. Synthesis Lectures on Information Concepts, Retrieval, and Services, 2(1):1--89, 2010.
[2]
C. Carpineto and G. Romano. A survey of automatic query expansion in information retrieval. ACM Computing Surveys (CSUR), 44(1):1, 2012.
[3]
S. Cronen-Townsend, Y. Zhou, and W. B. Croft. Predicting query performance. In Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 299--306. ACM, 2002.
[4]
D. F. Gurini and F. Gasparetti. Trec microblog 2012 track: Real-time algorithm for microblog ranking systems. 2012.
[5]
C. Hau. Predicting the effectiveness of queries and retrieval systems. University of Twente, 2010.
[6]
C. Hau, D. Hiemstra, and F. de Jong. A survey of pre-retrieval query performance predictors. In Proceedings of the 17th ACM conference on Information and knowledge management, pages 1419--1420. ACM, 2008.
[7]
B. He and I. Ounis. Inferring query performance using pre-retrieval predictors. In String Processing and Information Retrieval, pages 43--54. Springer, 2004.
[8]
J. He, M. Larson, and M. De Rijke. Using coherence-based measures to predict query difficulty. In Advances in Information Retrieval, pages 689--694. Springer, 2008.
[9]
J. Teevan, D. Ramage, and M. Morris. # twittersearch: a comparison of microblog search and web search. In Proceedings of the fourth ACM international conference on Web search and data mining, pages 35--44. ACM, 2011.
[10]
Y. Zhao, F. Scholer, and Y. Tsegay. Effective pre-retrieval query performance prediction using similarity and variability evidence. In Advances in Information Retrieval, pages 52--64. Springer, 2008.

Cited By

View all
  • (2022)Chatbot4QR: Interactive Query Refinement for Technical Question RetrievalIEEE Transactions on Software Engineering10.1109/TSE.2020.301600648:4(1185-1211)Online publication date: 1-Apr-2022
  • (2018)Silent Day Detection on Microblog DataNatural Language Processing and Information Systems10.1007/978-3-319-91947-8_46(443-455)Online publication date: 22-May-2018
  • (2016)Smart filters for social retrievalProceedings of the 3rd IKDD Conference on Data Science, 201610.1145/2888451.2888457(1-2)Online publication date: 13-Mar-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval
July 2014
1330 pages
ISBN:9781450322577
DOI:10.1145/2600428
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. ad-hoc retrieval
  2. query expansion
  3. query performance prediction

Qualifiers

  • Poster

Conference

SIGIR '14
Sponsor:

Acceptance Rates

SIGIR '14 Paper Acceptance Rate 82 of 387 submissions, 21%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)1
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Chatbot4QR: Interactive Query Refinement for Technical Question RetrievalIEEE Transactions on Software Engineering10.1109/TSE.2020.301600648:4(1185-1211)Online publication date: 1-Apr-2022
  • (2018)Silent Day Detection on Microblog DataNatural Language Processing and Information Systems10.1007/978-3-319-91947-8_46(443-455)Online publication date: 22-May-2018
  • (2016)Smart filters for social retrievalProceedings of the 3rd IKDD Conference on Data Science, 201610.1145/2888451.2888457(1-2)Online publication date: 13-Mar-2016
  • (2016)Predicting the effectiveness of pattern-based entity extractor inferenceApplied Soft Computing10.1016/j.asoc.2016.05.02346:C(398-406)Online publication date: 1-Sep-2016
  • (2016)Improving Tweet Timeline Generation by Predicting Optimal Retrieval DepthInformation Retrieval Technology10.1007/978-3-319-28940-3_11(135-146)Online publication date: 22-Jan-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media