Abstract
Search engine click-through data is a valuable source of implicit user feedback for relevance. However, not all user clicks are good indication of relevance. The clicks from search experts, who are more successful searching a query, tend to be more reliable in indicating document relevance than those of the non-experts. Therefore, knowing the expertise of search users is helpful to better understand their clicks. In this paper, we propose two probabilistic modelings of user expertise in the environment of web search. Inspired by the idea of evaluation metrics in classification, search users are treated as classifiers and result documents are viewed as the data samples to classify in our models. A click implies that the document is classified as relevant by the user. Therefore, the expertise of a user can be measured by how well he/she classifies the documents. We carry out experiments on a real-world click-through data of a Chinese search engine. The results show that modeling user expertise helps the click models with relevance inference, which also implies that our models are effective in identifying the user expertise.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Agichtein, E., Brill, E., Dumais, S.: Improving web search ranking by incorporating user behavior information. In: Proceedings of SIGIR 2006, pp. 19–26 (2006)
Chapelle, O., Zhang, Y.: A dynamic bayesian network click model for web search ranking. In: Proceedings of WWW 2009, pp. 1–10 (2009)
Chen, W., Wang, D., Zhang, Y., Chen, Z., Singla, A., Yang, Q.: A noise-aware click model for web search. In: Proceedings of WSDM 2012, pp. 313–322 (2012)
Craswell, N., Zoeter, O., Taylor, M., Ramsey, B.: An experimental comparison of click position-bias models. In: Proceedings of WSDM 2008 (2008)
Dupret, G., Piwowarski, B.: A user browsing model to predict search engine click data from past observations. In: Proceedings of SIGIR 2008 (2008)
Guo, F., Liu, C., Kannan, A., Minka, T., Taylor, M., Wang, Y., Faloutsos, C.: Click chain model in web search. In: Proceedings of WWW 2009, pp. 11–20 (2009)
Guo, F., Liu, C., Wang, Y.: Efficient multiple-click models in web search. In: Proceedings of WSDM 2009, pp. 124–131 (2009)
Joachims, T., Granka, L., Pan, B., Hembrooke, H., Gay, G.: Accurately interpreting clickthrough data as implicit feedback. In: Proceedings of SIGIR 2005 (2005)
Kendall, M.G.: A new measure of rank correlation. Biometrika 30(1/2), 81–93 (1938)
Shen, S., Hu, B., Chen, W., Yang, Q.: Personalized click model through collaborative filtering. In: Proceedings of WSDM 2012 (2012)
Wang, H., Zhai, C., Dong, A., Chang, Y.: Content-aware click modeling. In: Proceedings of the 22nd international conference on World Wide Web, WWW 2013, Republic and Canton of Geneva, Switzerland, pp. 1365–1376. International World Wide Web Conferences Steering Committee (2013)
White, R., Morris, D.: Investigating the querying and browsing behavior of advanced search engine users. In: Proceedings of SIGIR 2007, pp. 255–262 (2007)
White, R.W., Drucker, S.M.: Investigating behavioral variability in web search. In: Proceedings of WWW 2007, pp. 21–30 (2007)
White, R.W., Dumais, S.T., Teevan, J.: Characterizing the influence of domain expertise on web search behavior. In: Proceedings of WSDM 2009, pp. 132–141 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xing, Q., Liu, Y., Zhang, M., Ma, S., Zhang, K. (2013). Characterizing Expertise of Search Engine Users. In: Banchs, R.E., Silvestri, F., Liu, TY., Zhang, M., Gao, S., Lang, J. (eds) Information Retrieval Technology. AIRS 2013. Lecture Notes in Computer Science, vol 8281. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45068-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-45068-6_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45067-9
Online ISBN: 978-3-642-45068-6
eBook Packages: Computer ScienceComputer Science (R0)