skip to main content
10.1145/3477495.3532687acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
tutorial

What the Actual...Examining User Behaviour in Information Retrieval

Published: 07 July 2022 Publication History

Abstract

Conducting studies involving actual users is a recurring challenge in information retrieval. In this tutorial we will address the main strategic and tactical choices for engaging with, designing and executing user studies, considering both evaluation and formative investigation. The tension between reproducibility and ensuring natural user behaviour will be a recurring focus, seeking to help individual researchers make an intentional and well-argued choice for their research. The presenters have over fifty years of combined experience working in interactive information retrieval, and information interaction in general.

References

[1]
Azzopardi, L., Kelly, D., and Brennan, K., 2013. How Query Cost Affects Search Behavior. In Proceedings of the ACM SIGIR conference on Research and Development in Information Retrieval (Dublin, Ireland, 2013), ACM, 23--32. DOI= http://dx.doi.org/10.1145/2484028.2484049
[2]
Hearst, M.A. and Pedersen, J.O., 1996. Reexamining the Cluster Hypothesis: Scatter/Gather on Retrieval Results. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (Zurich, Switzerland, 1996), ACM, 76--84. DOI= http://dx.doi.org/10.1145/243199.243216
[3]
Kelly, D. and Belkin, N.J., 2004. Display time as implicit feedback: understanding task effects. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (Sheffield, United Kingdom, 2004), ACM, 377--384. DOI= http://dx.doi.org/10.1145/1008992.1009057
[4]
Nordlie, R., 1999. "User Revealment"-a Comparison of Initial Queries and Ensuing Question Development in Online Searching and in Human Reference Interactions. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (Berkeley, California, USA, 1999), ACM, 11--18. DOI= http://dx.doi.org/10.1145/312624.312618
[5]
Sanderson, M., Paramita, M.L., Clough, P., and Kanoulas, E., 2010. Do User Preferences and Evaluation Measures Line Up? In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (Geneva, Switzerland, 2010), ACM, 555--562. DOI= http://dx.doi.org/10.1145/1835449.1835542

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2022
3569 pages
ISBN:9781450387323
DOI:10.1145/3477495
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. information retrieval
  2. interactive information retrieval
  3. user studies

Qualifiers

  • Tutorial

Funding Sources

Conference

SIGIR '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 150
    Total Downloads
  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)3
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media