skip to main content
10.1145/3209978.3210060acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Constructing Click Models for Mobile Search

Published: 27 June 2018 Publication History

Abstract

Users' click-through behavior is considered as a valuable yet noisy source of implicit relevance feedback for web search engines. A series of click models have therefore been proposed to extract accurate and unbiased relevance feedback from click logs. Previous works have shown that users' search behaviors in mobile and desktop scenarios are rather different in many aspects, therefore, the click models that were designed for desktop search may not be as effective in mobile context. To address this problem, we propose a novel Mobile Click Model (MCM) that models how users examine and click search results on mobile SERPs. Specifically, we incorporate two biases that are prevalent in mobile search into existing click models: 1) the click necessity bias that some results can bring utility and usefulness to users without being clicked; 2) the examination satisfaction bias that a user may feel satisfied and stop searching after examining a result with low click necessity. Extensive experiments on large-scale real mobile search logs show that: 1) MCM outperforms existing models in predicting users' click behavior in mobile search; 2) MCM can extract richer information, such as the click necessity of search results and the probability of user satisfaction, from mobile click logs. With this information, we can estimate the quality of different vertical results and improve the ranking of heterogeneous results in mobile search.

References

[1]
Olivier Chapelle and Ya Zhang . 2009. A dynamic bayesian network click model for web search ranking WWW '09. ACM, 1--10.
[2]
Danqi Chen, Weizhu Chen, Haixun Wang, Zheng Chen, and Qiang Yang . 2012. Beyond ten blue links: enabling user click modeling in federated web search WSDM '12. ACM, 463--472.
[3]
Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke . 2015. Click models for web search. Synthesis Lectures on Information Concepts, Retrieval, and Services, Vol. 7, 3 (2015), 1--115.
[4]
Aleksandr Chuklin, Pavel Serdyukov, and Maarten De Rijke . 2013. Using Intent Information to Model User Behavior in Diversified Search. ECIR. Springer, 1--13.
[5]
Jacob Cohen . 1968. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological bulletin Vol. 70, 4 (1968), 213.
[6]
Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey . 2008. An experimental comparison of click position-bias models WSDM'08. ACM, 87--94.
[7]
Georges E Dupret and Benjamin Piwowarski . 2008. A user browsing model to predict search engine click data from past observations. SIGIR'08. ACM, 331--338.
[8]
Laura A Granka, Thorsten Joachims, and Geri Gay . 2004. Eye-tracking analysis of user behavior in WWW search SIGIR'04. ACM, 478--479.
[9]
Fan Guo, Chao Liu, and Yi Min Wang . 2009. Efficient multiple-click models in web search. In WSDM'09. ACM, 124--131.
[10]
Qi Guo, Haojian Jin, Dmitry Lagun, Shuai Yuan, and Eugene Agichtein . 2013. Mining touch interaction data on mobile devices to predict web search result relevance SIGIR'13. ACM, 153--162.
[11]
Morgan Harvey and Matthew Pointon . 2017. Searching on the Go: The Effects of Fragmented Attention on Mobile Web Search Tasks SIGIR'17. ACM, 155--164.
[12]
Kalervo J"arvelin and Jaana Kek"al"ainen . 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS), Vol. 20, 4 (2002), 422--446.
[13]
Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay . 2005. Accurately interpreting clickthrough data as implicit feedback SIGIR'05. Acm, 154--161.
[14]
Maryam Kamvar and Shumeet Baluja . 2006. A large scale study of wireless search behavior: Google mobile search SIGCHI'06. ACM, 701--709.
[15]
Maryam Kamvar, Melanie Kellar, Rajan Patel, and Ya Xu . 2009. Computers and iphones and mobile phones, oh my!: a logs-based comparison of search users on different devices. In WWW'09. ACM, 801--810.
[16]
Jaewon Kim, Paul Thomas, Ramesh Sankaranarayana, Tom Gedeon, and Hwan-Jin Yoon . 2015. Eye-tracking analysis of user behavior and performance in web search on large and small screens. Journal of the Association for Information Science and Technology, Vol. 66, 3 (2015), 526--544.
[17]
Dmitry Lagun, Chih-Hung Hsieh, Dale Webster, and Vidhya Navalpakkam . 2014. Towards better measurement of attention and satisfaction in mobile search SIGIR'14. ACM, 113--122.
[18]
Zeyang Liu, Yiqun Liu, Ke Zhou, Min Zhang, and Shaoping Ma . 2015. Influence of vertical result in web search examination SIGIR'15. ACM, 193--202.
[19]
Cheng Luo, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, and Shaoping Ma . 2017. Evaluating mobile search with height-biased gain. SIGIR'17. ACM, 435--444.
[20]
Kevin Ong, Kalervo J"arvelin, Mark Sanderson, and Falk Scholer . 2017. Using Information Scent to Understand Mobile and Desktop Web Search Behavior SIGIR'17. ACM, 295--304.
[21]
Matthew Richardson, Ewa Dominowska, and Robert Ragno . 2007. Predicting clicks: estimating the click-through rate for new ads WWW'07. ACM, 521--530.
[22]
Yang Song, Hao Ma, Hongning Wang, and Kuansan Wang . 2013. Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance. In WWW'13. ACM, 1201--1212.
[23]
Manisha Verma and Emine Yilmaz . 2016. Characterizing Relevance on Mobile and Desktop. In ECIR'16. Springer, 212--223.
[24]
Chao Wang, Yiqun Liu, Min Zhang, Shaoping Ma, Meihong Zheng, Jing Qian, and Kuo Zhang . 2013. Incorporating vertical results into search click models SIGIR'13. ACM, 503--512.
[25]
Kyle Williams, Julia Kiseleva, Aidan C Crook, Imed Zitouni, Ahmed Hassan Awadallah, and Madian Khabsa . 2016. Detecting good abandonment in mobile search. In WWW'16. 495--505.
[26]
Wan-Ching Wu, Diane Kelly, and Avneesh Sud . 2014. Using information scent and need for cognition to understand online search behavior SIGIR'14. ACM, 557--566.
[27]
Jeonghee Yi, Farzin Maghoul, and Jan Pedersen . 2008. Deciphering mobile search patterns: a study of yahoo! mobile search queries WWW'18. ACM, 257--266.

Cited By

View all
  • (2024)Entity Footprinting: Modeling Contextual User States via Digital Activity MonitoringACM Transactions on Interactive Intelligent Systems10.1145/364389314:2(1-27)Online publication date: 5-Feb-2024
  • (2024)Counteracting Duration Bias in Video Recommendation via Counterfactual Watch TimeProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671817(4455-4466)Online publication date: 25-Aug-2024
  • (2024)Mobile search made easier: An ability-based mobile search prototype for people with dyslexiaProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638292(45-55)Online publication date: 10-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
June 2018
1509 pages
ISBN:9781450356572
DOI:10.1145/3209978
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. click model
  2. mobile search
  3. web search

Qualifiers

  • Research-article

Conference

SIGIR '18
Sponsor:

Acceptance Rates

SIGIR '18 Paper Acceptance Rate 86 of 409 submissions, 21%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)1
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Entity Footprinting: Modeling Contextual User States via Digital Activity MonitoringACM Transactions on Interactive Intelligent Systems10.1145/364389314:2(1-27)Online publication date: 5-Feb-2024
  • (2024)Counteracting Duration Bias in Video Recommendation via Counterfactual Watch TimeProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671817(4455-4466)Online publication date: 25-Aug-2024
  • (2024)Mobile search made easier: An ability-based mobile search prototype for people with dyslexiaProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638292(45-55)Online publication date: 10-Mar-2024
  • (2024) LT 2 R: Learning to Online Learning to Rank for Web Search 2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00360(4733-4746)Online publication date: 13-May-2024
  • (2024)Probabilistic graph model and neural network perspective of click models for web searchKnowledge and Information Systems10.1007/s10115-024-02145-z66:10(5829-5873)Online publication date: 6-Jun-2024
  • (2023)Searching Online for Art and Culture: User Behavior AnalysisFuture Internet10.3390/fi1506021115:6(211)Online publication date: 11-Jun-2023
  • (2023)A Passage-Level Reading Behavior Model for Mobile SearchProceedings of the ACM Web Conference 202310.1145/3543507.3583343(3236-3246)Online publication date: 30-Apr-2023
  • (2023)An F-shape Click Model for Information Retrieval on Multi-block Mobile PagesProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570365(1057-1065)Online publication date: 27-Feb-2023
  • (2023)Implications and New Directions for IR Research and PracticesA Behavioral Economics Approach to Interactive Information Retrieval10.1007/978-3-031-23229-9_7(181-201)Online publication date: 18-Feb-2023
  • (2023)IntroductionA Behavioral Economics Approach to Interactive Information Retrieval10.1007/978-3-031-23229-9_1(3-22)Online publication date: 18-Feb-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media