Abstract
This paper proposes a system that highlights weasel sentences while browsing webpages. The term weasel sentence is defined in the context of this paper as a quotation with an unknown or unidentifiable source. Following this definition, the system automatically detects weasel sentences in browsed webpages. Then, we investigate how highlighting weasel sentences affects the search behaviors and decision making of the users searching for information on the web. An online user study yielded the following results: (1) Highlighting the weasel sentences encouraged participants to invest more time in web browsing and to view a larger number of webpages. (2) The effect of (1) was more significant when participants were familiar with the search topics. (3) Web browsing elicited less change in the confidence of the search answers when participants were familiar with the given topics. The findings provide insights into how users can avoid gathering misleading on the web.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Berkeley Library’s Evaluating resources: http://guides.lib.berkeley.edu/evaluating-resources.
- 2.
Unsupported attributions: https://en.wikipedia.org/wiki/Wikipedia:Manual_of_Style/Words_to_watch.
- 3.
The number is at the time of April 19th, 2018.
- 4.
MeCab: [http://taku910.github.io/mecab/].
- 5.
Weasel expression on Wikipedia (Japanese version): https://bit.ly/33lJ1hC.
- 6.
CrowdWorks: https://crowdworks.jp/.
- 7.
- 8.
For Bayesian GLMMs, we used the R package brms [3].
References
American Library Association, Association for College and Research Libraries: Information Literacy Competency Standards for Higher Education. Technical report (2000)
Bateman, S., Teevan, J., White, R.W.: The search dashboard: how reflection and comparison impact search behavior. In: Proceedings of CHI (2012)
Bürkner, P.C.: brms: an R package for Bayesian multilevel models using Stan. J. Stat. Softw. 80(1), 1–8 (2017)
Dong, X.L., et al.: Knowledge-based trust: estimating the trustworthiness of Web sources. In: Proceedings of the VLDB Endowment, vol. 8, no. 9, pp. 938–949 (2015)
Ennals, R., Trushkowsky, B., Agosta, J.M.: Highlighting disputed claims on the Web. In: Proceedings of WWW (2010)
Fogg, B.J., Tseng, H.: The elements of computer credibility. In: Proceedings of CHI (1999)
Hasan Dalip, D., André Gonçalves, M., Cristo, M., Calado, P.: Automatic quality assessment of content created collaboratively by Web communities: a case study of wikipedia. In: Proceedings of JCDL (2009)
Hofmann, K., Mitra, B., Radlinski, F., Shokouhi, M.: An eye-tracking study of user interactions with query auto completion. In: Proceedings of CIKM (2014)
Ieong, S., Mishra, N., Sadikov, E., Zhang, L.: Domain bias in Web search. In: Proceedings of WSDM (2012)
Kahneman, D.: Thinking, Fast and Slow. Macmillan, London (2011)
Kay, M., Nelson, G.L., Hekler, E.B.: Researcher-centered design of statistics: why Bayesian statistics better fit the culture and incentives of HCI. In: Proceedings of CHI (2016
Kruschke, J.: Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan. Academic Press, Cambridge (2014)
Lee, J., Walker, E., Burleson, W., Kay, M., Buman, M., Hekler, E.B.: Self-experimentation for behavior change: design and formative evaluation of two approaches. In: Proceedings of CHI (2017)
Leong, C.W., Cucerzan, S.: Supporting factual statements with evidence from the Web. In: Proceedings of CIKM (2012)
Liao, Q.V., Fu, W.T.: Expert voices in echo chambers: effects of source expertise indicators on exposure to diverse opinions. In: Proceedings of CHI (2014
Liu, C., White, R.W., Dumais, S.: Understanding web browsing behaviors through Weibull analysis of dwell time. In: Proceedings of SIGIR (2010)
Metzger, M.J.: Making sense of credibility on the Web: models for evaluating online information and recommendations for future research. J. Am. Soc. Inf. Sci. Technol. 58(13), 2078–2091 (2007)
Nakamura, S., et al.: Trustworthiness analysis of Web search results. In: Proceedings of ECDL (2007)
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., Granka, L.: In Google we trust: users’ decisions on rank, position, and relevance. J. Comput. Mediated Commun. 12(3), 801–823 (2007)
Schwarz, J., Morris, M.: Augmenting Web pages and search results to support credibility assessment. In: Proceedings of CHI (2011)
Wang, W.Y.: Liar, liar pants on fire: a new benchmark dataset for fake news detection. In: Proceedings of ACL (2017)
White, R.: Beliefs and biases in web search. In: Proceedings of SIGIR (2013)
Yamamoto, T., Yamamoto, Y., Fujita, S.: Exploring people’s attitudes and behaviors toward careful information seeking in Web search. In: Proceedings of CIKM (2018)
Yamamoto, Y., Yamamoto, T.: Query priming for promoting critical thinking in Web search. In: Proceedings of CHIIR (2018)
Yamamoto, Y., Yamamoto, T., Ohshima, H., Kawakami, H.: Web access literacy scale to evaluate how critically users can browse and search for Web information. In: Proceedings of WebSci (2018)
Acknowledgments
This work was supported in part by Grants-in-Aid for Scientific Research (18H03243, 18H03244, 18H03494, 18KT0097, 18K18161, 16H02906) from MEXT of Japan.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Saito, F., Shoji, Y., Yamamoto, Y. (2019). Highlighting Weasel Sentences for Promoting Critical Information Seeking on the Web. In: Cheng, R., Mamoulis, N., Sun, Y., Huang, X. (eds) Web Information Systems Engineering – WISE 2019. WISE 2020. Lecture Notes in Computer Science(), vol 11881. Springer, Cham. https://doi.org/10.1007/978-3-030-34223-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-34223-4_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34222-7
Online ISBN: 978-3-030-34223-4
eBook Packages: Computer ScienceComputer Science (R0)