Scott Bateman
Jaime Teevan
Ryen W. White
ABSTRACT
Most searchers do not know how to use Web search engines as effectively as possible. This is due, in part, to search engines not providing feedback about how search behavior can be improved. Because feedback is an essential part of learning, we created the Search Dashboard, which provides an interface for reflection on personal search behavior. The Dashboard aggregates and presents an individual's search history and provides comparisons with that of archetypal expert profiles. Via a five-week study of 90 Search Dash-board users, we find that users are able to change aspects of their behavior to be more in line with that of the presented expert searchers. We also find that reflection can be beneficial, even without comparison, by changing participants' views about their own search skills, what is possible with search, and what aspects of their behavior may influence search success. Our findings demonstrate a new way for search engines to help users modify their search behavior for positive outcomes.
Supplemental Material
- Aula, A., Khan, R.M. & Guan, Z. How does search behavior change as search becomes more difficult? Proc. CHI, 2010, 35--44. Google Scholar
Digital Library
- Aula, A. & Nordhausen, K. Modeling successful performance in web searching. JASIST 57, 12 (2006), 1678--1693. Google ScholarDigital Library
- Aula, A., Jhaveri, N. & Kaki, M. Information search and re-access strategies of experienced Web users. Proc. WWW, 583--592. Google ScholarDigital Library
- Bandura, A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ, US: Prentice-Hall, 1986.Google Scholar
- Bennett, P., Svore, K. & Dumais, S. Classificationenhanced ranking. Proc. WWW, 2010, 111--120. Google ScholarDigital Library
- Brand-Gruwel, S., Wopereis, I. & Vermetten, Y. Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior, 21, (2005), 487--508. Google ScholarDigital Library
- Boud, D., Keogh, R. & Walker, D. Reflection: Turning Experience into Learning. Routledge, 1985.Google Scholar
- Collins, A., Brown, J.S. & Newman, S.E. Cognitive apprenticeship: Teaching the craft of reading, writing and mathematics. Knowing, Learning and Instruction 8, 1 (1989), 453--494.Google Scholar
- Consolvo, S., McDonald, D. & Landay, J. Theory-driven design strategies for technologies that support behavior change in everyday life. Proc. CHI, 2009, 405--414. Google ScholarDigital Library
- Dou, Z., Song, R. & Wen, J. A large-scale evaluation and analysis of personalized search strategies. Proc. WWW, 2007, 581--590. Google ScholarDigital Library
- Evans, B. M. & Chi, E.H. An elaborated model of social search. IP&M, 46, 6 (2010), 656--678. Google ScholarDigital Library
- Fogg, B.J. Motivating, influencing, and persuading users. In The human-computer interaction handbook, Julie A. Jacko and Andrew Sears (Eds.). L., (2002), 358--370. Google ScholarDigital Library
- Froehlich, J., Findlater, L. & Landay, J. The design of eco-feedback technology. Proc. CHI, 2010, 1999--2008. Google ScholarDigital Library
- Hölscher, C. & Strube, G. Web search behavior of Internet experts and newbies. Computer Networks 33, (2000), 337--346. Google ScholarDigital Library
- Khan, K. & Locatis, C. Searching through the cyberspace: the effects of link display and link density on information retrieval from hypertext on the World Wide Web. JASIST, 49, 2 (1998), 176--182. Google ScholarDigital Library
- Kodagoda, N. & Wong, B.L.W. Effects of low and high literacy on user performance in information search and retrieval. Proc. BCS-HCI, 2008, 173--181. Google ScholarDigital Library
- Lazonder, A.W., Biemans, H.J.A. & Worpeis, I.G.J.H. Differences between novice and experienced users in searching information on the World Wide Web. JASIST 51, 6 (2000), 576--581. Google ScholarDigital Library
- Li, I., Forlizzi, J. & Dey, A. Know thyself: monitoring and reflecting on facets of one's life. Proc. CHI EA, 2010, 4489--4492. Google ScholarDigital Library
- Moraveji, N., Morris, M.R., Morris, D., Czerwinski, M. & Riche, N. ClassSearch: Facilitating the development of web search skills through social learning. Proc. CHI, 2011, 1797--1806. Google ScholarDigital Library
- Moraveji, N., Russell, D., Bien, J. & Mease, D. Measuring improvement in user search performance resulting from optimal search tips. Proc. SIGIR, 2011, 355--363. Google ScholarDigital Library
- Morris, D., Morris, M.R. & Venolia, G. SearchBar: a search-centric web history for task resumption and information re-finding. Proc. CHI, 2008, 1207--1216. Google ScholarDigital Library
- Nielsen, J. Incompetent research skills curb users' problem solving. Alertbox. April 11, 2011. (available at: http://www.useit.com/alertbox/search-skills.html)Google Scholar
- Saito, H. & Miwa, K. A cognitive study of information seeking processes in the WWW: Effects of searcher's knowledge and experience. Proc. WISE, 2001, 321--333. Google ScholarDigital Library
- Sparck-Jones, K. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28, 1 (1972), 11--21.Google ScholarCross Ref
- Thaler, R.H. & Sunstein, C.R. Nudge: improving decisions about health, wealth, and happiness. Yale, 2008.Google Scholar
- Van Kleek, M., Moore, B., Xu, C., & Karger, D.R. Eyebrowse: Real-time web activity sharing and visualization. Proc. CHI EA, 2010, 3643--3648. Google ScholarDigital Library
- White, R.W. and Morris, D. Investigating the querying and browsing behavior of advanced search engine users. Proc. SIGIR, 2007, 255--262. Google ScholarDigital Library
- White, R.W., Bilenko, M., and Cucerzan, S. Studying the use of popular destinations to enhance web search Interaction. Proc. of SIGIR, 2007, 159--166. Google ScholarDigital Library
- White, R.W., Dumais, S., and Teevan, J. Characterizing the influence of domain expertise on web search behavior. Proc. WSDM, 2009, 132--141. Google ScholarDigital Library
Index Terms
- The search dashboard: how reflection and comparison impact search behavior
Recommendations
Characterizing the influence of domain expertise on web search behavior
WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data MiningDomain experts search differently than people with little or no domain knowledge. Previous research suggests that domain experts employ different search strategies and are more successful in finding what they are looking for than non-experts. In this ...
How do users handle inconsistent information?: the effect of search expertise
SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied ComputingWhile search engines sometimes return different documents containing contradictory answers, little is known about how users handle inconsistent information. This paper investigates the effect of search expertise (defined as specialized knowledge on the ...
Developing a Measure of Search Expertise
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and RetrievalWhile search expertise has long been considered an important variable in the study of online information search, the creation of a robust measure to characterize it has eluded researchers. Instead, those wishing to measure search expertise often include ...
Comments