Leif Azzopardi
ABSTRACT
Searching is inherently an interactive process usually requiring a number of queries to be submitted and a number of documents to be assessed in order to find the desired amount of relevant information. While numerous models of search have been proposed, they have been largely conceptual in nature providing a descriptive account of the search process. For example, Bates' Berry Picking metaphor aptly describes how information seekers forage for relevant information [4]. However it lacks any predictive or explanatory power. In this talk, I will outline how microeconomic theory can be applied to interactive information retrieval, where the search process can be viewed as a combination of inputs (i.e. queries and assessments) which are used to "produce" output (i.e. relevance). Under this view, it is possible to build models that not only describe the relationship between interaction, cost and gain, but also explain and predict behaviour. During the talk, I will run through a number of examples of how economics can explain different behaviours. For example, why PhD students should search more than their supervisors (using an economic model developed by Cooper [6]), why queries are short [1], why Boolean searchers need to explore more results, and why it is okay to look at the first few results when searching the web [2]. I shall then describe how the cost of different interactions affect search behaviour [3], before extending the current theory to include other variables (such as the time spent on the search result page, the interaction with snippets, etc) to create more sophisticated and realistic models. Essentially, I will argue that by using such models we can:
1. theorise and predict how users will behave when interacting with systems,
2. ascertain how the costs of different interaction will influence search behaviour,
3. understand why particular interaction styles, strategies, techniques are or are not adopted by users, and,
4. determine what interactions and functionalities are worthwhile based on their expected gain and associated costs.
- L. Azzopardi. Query side evaluation: an empirical analysis of effectiveness and effort. In Proc. of the 32nd ACM SIGIR conference on Research and development in information retrieval, pages 556--563, 2009. Google Scholar
Digital Library
- L. Azzopardi. The economics in interactive information retrieval. In Proc. of the 34th ACM SIGIR conference on research and development in information retrieval, pages 15--24, 2011. Google ScholarDigital Library
- L. Azzopardi, D. Kelly, and K. Brennan. How query cost affects search behavior. In Proc. of the 36th ACM SIGIR conference on Research and development in information retrieval, pages 23--32, 2013. Google ScholarDigital Library
- M. J. Bates. The design of browsing and berrypicking techniques for the online search interface. Online Information Review, 13(5): 407--424, 1989.Google ScholarCross Ref
- N. J. Belkin. Some(what) grand challenges for interactive information retrieval. ACM SIGIR Forum, 42: 47--54, 2008. Google ScholarDigital Library
- M. D. Cooper. A cost model for evaluating information retrieval systems. Journal of the American Society for Information Science, 23(5): 306--312, 1972.Google ScholarCross Ref
- K. Järvelin. IR research: systems, interaction, evaluation and theories. ACM SIGIR Forum, 45(2): 17--31, 2012. Google ScholarDigital Library
Index Terms
- Economic models of search
Recommendations
Building Cost-Benefit Models of Information Interactions
CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and RetrievalModeling how people interact with search interfaces has been of particular interest and importance to the field of Interactive Information Retrieval. Recently, there has been a move to developing formal models of the interaction between the user and the ...
Modelling interaction with economic models of search
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrievalUnderstanding how people interact when searching is central to the study of Interactive Information Retrieval (IIR). Most of the prior work has either been conceptual, observational or empirical. While this has led to numerous insights and findings ...
An Analysis of the Cost and Benefit of Search Interactions
ICTIR '16: Proceedings of the 2016 ACM International Conference on the Theory of Information RetrievalInteractive Information Retrieval (IR) systems often provide various features and functions, such as query suggestions and relevance feedback, that a user may or may not decide to use. The decision to take such an option has associated costs and may ...
Comments