skip to main content
10.1145/2854946.2854983acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Developing a Measure of Search Expertise

Published: 13 March 2016 Publication History

Abstract

While search expertise has long been considered an important variable in the study of online information search, the creation of a robust measure to characterize it has eluded researchers. Instead, those wishing to measure search expertise often include a single item that asks people to indicate how often they search or for how long they have been searching. In this paper, we report initial results of a four-phase study aimed at developing a measure of search expertise. Interviews and focus groups were conducted with nine professional searchers and an inventory of items related to online search expertise was created. While participants identified a number of usual items for determining search expertise, such as prior search experience, domain knowledge and resource knowledge, they also identified a large number of items related to personality characteristics such as persistence, flexibility, curiosity, adaptability and humility. These results suggest that measuring personality characteristics in addition to experience and knowledge might help determine who will be a more successful searcher. In today's search environments, where many people describe themselves as experts, representing these types of characteristics in a measure of search expertise might allow researchers and practitioners to observe more variation in populations of interest, design more effective instruction and make better predictions about search outcomes.

References

[1]
Aula, A. & Nordhausen, K. (2006). Modeling successful performance in Web searching. JASIST, 57, 1678--1693.
[2]
Bellardo, T. (1985). An investigation of online searcher traits and their relationship to search outcome. JASIS, 36, 241--250.
[3]
Borgman, C.L. (1989). All users of information systems are not created equal: An exploration into individual differences. IP&M, 25(3), 237--252.
[4]
Chen, C. (2000). Individual differences in a spatial-semantic virtual environment. JASIS, 51(6), 529--542.
[5]
Chi, M. (2006). Two approaches to the study of experts' characteristics. In K.A. Ericsson, N. Charness, P.J. Feltovich, & R.R. Hoffman (Eds.), The Cambridge handbook of Expertise and Expert Performance (pp. 21--30). Cambridge, UK: Cambridge Univ. Press.
[6]
Ericcson, K., Krampe, R., & Tesche-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363--406.
[7]
Ericsson, K. & Charness, N. (1994). Expert performance: its structure and acquisition. Amer. Psych., 49(8), 725--747.
[8]
Glaser, R. (1987). Thoughts on expertise. In C. Schooler & W. Schaie (Eds.) Cognitive functioning and social structure over the life course. Norwood, NJ: Ablex.
[9]
Hölscher, C. & Strube, G. (2000). Web search behaviour of Internet experts and newbies. Proc. of WWW Conference.
[10]
Hsieh-Yee, I. (2001). Research on Web search behavior. Library and Information Science Research, 23, 167--185.
[11]
Markey, K. (2007). Twenty-five years of end-user searching, Part 1: Research findings. JASIST, 58(8), 1071--108
[12]
Smith, C. (2014). Domain-independent search expertise: A description of procedural knowledge gained during guided instruction. JASIST, 66(7), 1388--1405.
[13]
Sternberg, R. J. (2006). Cognitive psychology (4th ed.). Belmont, CA: Thomson Wadsworth.

Cited By

View all
  • (2022)A Privacy-Aware Browser Extension to Track User Search Behavior for Programming Course SupplementMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-030-94822-1_51(783-796)Online publication date: 8-Feb-2022
  • (2021)Children’s query formulation and search result explorationInternational Journal on Digital Libraries10.1007/s00799-021-00316-922:4(385-410)Online publication date: 30-Nov-2021
  • (2017)Exploring Context in Information Behavior: Seeker, Situation, Surroundings, and Shared IdentitiesSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00807ED1V01Y201710ICR0619:7(i-163)Online publication date: 8-Dec-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval
March 2016
400 pages
ISBN:9781450337519
DOI:10.1145/2854946
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. information search
  2. measurement
  3. search expertise

Qualifiers

  • Short-paper

Conference

CHIIR '16
Sponsor:
CHIIR '16: Conference on Human Information Interaction and Retrieval
March 13 - 17, 2016
North Carolina, Carrboro, USA

Acceptance Rates

CHIIR '16 Paper Acceptance Rate 23 of 58 submissions, 40%;
Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A Privacy-Aware Browser Extension to Track User Search Behavior for Programming Course SupplementMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-030-94822-1_51(783-796)Online publication date: 8-Feb-2022
  • (2021)Children’s query formulation and search result explorationInternational Journal on Digital Libraries10.1007/s00799-021-00316-922:4(385-410)Online publication date: 30-Nov-2021
  • (2017)Exploring Context in Information Behavior: Seeker, Situation, Surroundings, and Shared IdentitiesSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00807ED1V01Y201710ICR0619:7(i-163)Online publication date: 8-Dec-2017
  • (2017)Asking "Good" QuestionsProceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval10.1145/3020165.3020167(27-36)Online publication date: 7-Mar-2017

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media