skip to main content
10.1145/3121050.3121097acmconferencesArticle/Chapter ViewAbstractPublication PagesictirConference Proceedingsconference-collections
short-paper

An Initial Investigation of Query Expansion Bias

Published: 01 October 2017 Publication History

Abstract

In this work, the relationship between performance and retrievability bias is explored when various query expansion methods are employed to aide retrieval. Several parameters are altered, independently, to identify those that have an impact on bias. Parameters altered include; Rocchio's beta, length normalisation parameters, the number of terms added and the number of documents those terms are extracted from. A strong correlation between performance and retrievability bias is identified, suggesting that query expansion increases performance by making the system more biased.

References

[1]
L. Azzopardi and R. Bache. On the relationship between effectiveness and accessibility. In Proc. of the 33rd ACM SIGIR, pages 889--890, 2010.
[2]
L. Azzopardi and V. Vinay. Retrievability: An evaluation measure for higher order information access tasks. In Proc. of the 17th ACM CIKM, pages 561--570, 2008.
[3]
S. Bashir and A. Rauber. Analyzing document retrievability in patent retrieval settings. In Database and Expert Systems Applications, pages 753--760. 2009.
[4]
S. Bashir and A. Rauber. Improving retrievability of patents with cluster-based pseudo-relevance feedback documents selection. In Proc. of the 18th ACM CIKM, pages 1863--1866, 2009.
[5]
S. Bashir and A. Rauber. Improving retrievability of patents in prior-art search. In Proc. of the 32nd ECIR, pages 457--470, 2010.
[6]
J. Gastwirth. The estimation of the lorenz curve and gini index. The Review of Economics and Statistics, 54:306--316, 1972.
[7]
J. Pickens, M. Cooper, and G. Golovchinsky. Reverted indexing for feedback and expansion. In Proc. of the 19th ACM CIKM, pages 1049--1058, 2010.
[8]
J. J. Rocchio. Relevance feedback in information retrieval. 1971.
[9]
C. Wilkie and L. Azzopardi. Relating retrievability, performance and length. In Proc. of the 36th ACM SIGIR conference, pages 937--940, 2013.
[10]
C. Wilkie and L. Azzopardi. Best and fairest: An empirical analysis of retrieval system bias. Advances in Information Retrieval, pages 13--25, 2014.
[11]
C. Wilkie and L. Azzopardi. A retrievability analysis: Exploring the relationship between retrieval bias and retrieval performance. In Proc. of the 23rd ACM CIKM, pages 81--90, 2014.

Cited By

View all
  • (2019)The impact of fielding on retrieval performance and biasProceedings of the Association for Information Science and Technology10.1002/pra2.2018.1450550106155:1(564-572)Online publication date: 1-Feb-2019

Index Terms

  1. An Initial Investigation of Query Expansion Bias

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICTIR '17: Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval
    October 2017
    348 pages
    ISBN:9781450344906
    DOI:10.1145/3121050
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 October 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. bias
    2. effectiveness
    3. query expansion
    4. retrievability

    Qualifiers

    • Short-paper

    Funding Sources

    Conference

    ICTIR '17
    Sponsor:

    Acceptance Rates

    ICTIR '17 Paper Acceptance Rate 27 of 54 submissions, 50%;
    Overall Acceptance Rate 235 of 527 submissions, 45%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)The impact of fielding on retrieval performance and biasProceedings of the Association for Information Science and Technology10.1002/pra2.2018.1450550106155:1(564-572)Online publication date: 1-Feb-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media