skip to main content
10.1145/3295750.3298920acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

A Rank-biased Neural Network Model for Click Modeling

Published: 08 March 2019 Publication History

Abstract

Query logs contain rich feedback information from a large number of users interacting with search engines. Various click models have been developed to decode users' search behavior and to extract useful knowledge from query logs. Although the state-of-the-art neural click models have been shown to be very effective in click modeling, the input representations of queries and documents rely on either manually crafted features or on automatic methods suffering from the high-dimensionality issue. Moreover, these neural click models are still rather restrictive when coping with commonly biased user clicks. In this paper, we investigate how to effectively deploy a neural network model for decoding users' click behavior. First, we present two novel rank-biased neural network models ($RBNN$ and $RBNN^* $) for click modeling. The key idea is to deploy different weight matrices across different rank positions. Second, we introduce a new method ($QD\mymathhyphen DCCA$) for automatically learning the vector representations for both queries and documents within the same low-dimensional space, which provides high-quality inputs for $RBNN$ and $RBNN^* $. Finally, a series of experiments are conducted on two different real query logs to validate the effectiveness and efficiency of the proposed neural click models. The experiments demonstrate that: (1) The proposed models can achieve substantially improved performance over the state-of-the-art baseline on two datasets across multiple metrics. By incorporating rank-specific weight matrices, $RBNN$ and $RBNN^* $ are more capable of dealing with the position-bias problem. (2) The input representations of queries, documents and context information significantly affect the performance of neural click models. Thanks to the application of $QD\mymathhyphen DCCA$, not only $RBNN$ and $RBNN^* $ but also the baseline method exhibit enhanced performance. Furthermore, the training cost under the proposed models is greatly reduced.

References

[1]
Jae-wook Ahn, Peter Brusilovsky, and Shuguang Han. 2015. Personalized Search: Reconsidering the Value of Open User Models. In Proceedings of the 20th International Conference on Intelligent User Interfaces . 202--212.
[2]
Galen Andrew, Raman Arora, Jeff Bilmes, and Karen Livescu. 2013. Deep Canonical Correlation Analysis. In Proceedings of the 30th ICML. 1247--1255.
[3]
Ricardo Baeza-Yates and Alessandro Tiberi. 2007. Extracting semantic relations from query logs. In Proceedings of the 13th KDD . 76--85.
[4]
Afroze Ibrahim Baqapuri and Ilya Trofimov. 2014. Using Neural Networks for Click Prediction of Sponsored Search. CoRR, Vol. abs/1412.6601 (2014).
[5]
Alexey Borisov, Ilya Markov, Maarten de Rijke, and Pavel Serdyukov. 2016. A Neural Click Model for Web Search. In Proceedings of the 25th WWW . 531--541.
[6]
Chris Burges, Tal Shaked, Erin Renshaw, Ari Lazier, Matt Deeds, Nicole Hamilton, and Greg Hullender. 2005. Learning to rank using gradient descent. In Proceedings of the 22nd ICML . 89--96.
[7]
Olivier Chapelle, Donald Metlzer, Ya Zhang, and Pierre Grinspan. 2009. Expected reciprocal rank for graded relevance. In Proceedings of the 18th CIKM . 621--630.
[8]
Olivier Chapelle and Ya Zhang. 2009. A Dynamic Bayesian Network Click Model for Web Search Ranking. In Proceedings of the 18th WWW . 1--10.
[9]
Weizhu Chen, Dong Wang, Yuchen Zhang, Zheng Chen, Adish Singla, and Qiang Yang. 2012. A Noise-aware Click Model for Web Search. In Proceedings of the 5th WSDM . 313--322.
[10]
Ye Chen and Tak W. Yan. 2012. Position-normalized Click Prediction in Search Advertising. In Proceedings of the 18th KDD . 795--803.
[11]
Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke. 2015. Click Models for Web Search . Vol. 7:3. Synthesis Lectures on Information Concepts, Retrieval, and Services.
[12]
Aleksandr Chuklin, Pavel Serdyukov, and Maarten de Rijke. 2013. Using Intent Information to Model User Behavior in Diversified Search. In Proceedings of the 35th ECIR. 1--13.
[13]
Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey. 2008. An Experimental Comparison of Click Position-bias Models. In Proceedings of the 1st WSDM . 87--94.
[14]
Fernando Diaz, Qi Guo, and Ryen W. White. 2016. Search Result Prefetching Using Cursor Movement. Proceedings of the 39th SIGIR . 609--618.
[15]
Georges E. Dupret and Benjamin Piwowarski. 2008. A User Browsing Model to Predict Search Engine Click Data from Past Observations. In Proceedings of the 31st SIGIR. 331--338.
[16]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS, Vol. 9. 249--256.
[17]
Christoph Goller and Andreas Küchler. 1996. Learning task-dependent distributed representations by backpropagation through structure. In Proceedings of ICNN-96 . 347--352.
[18]
Laura A. Granka, Thorsten Joachims, and Geri Gay. 2004. Eye-tracking Analysis of User Behavior in WWW Search. In Proceedings of the 27th SIGIR . 478--479.
[19]
Aditya Grover and Jure Leskovec. 2016. Node2Vec: Scalable Feature Learning for Networks. In Proceedings of the 22nd KDD . 855--864.
[20]
Fan Guo, Chao Liu, Anitha Kannan, Tom Minka, Michael Taylor, Yi-Min Wang, and Christos Faloutsos. 2009. Click Chain Model in Web Search. In Proceedings of the 18th WWW . 11--20.
[21]
Jacek Gwizdka and Yinglong Zhang. 2015. Differences in Eye-Tracking Measures Between Visits and Revisits to Relevant and Irrelevant Web Pages. In Proceedings of the 38th SIGIR . 811--814.
[22]
G. E. Hinton, J. L. McClelland, and D. E. Rumelhart. 1986. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1 . Chapter Distributed representations, 77--109.
[23]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation, Vol. 9, 8 (1997), 1735--1780.
[24]
Botao Hu, Yuchen Zhang, Weizhu Chen, Gang Wang, and Qiang Yang. 2011. Characterizing Search Intent Diversity into Click Models. In Proceedings of the 20th WWW . 17--26.
[25]
Jeff Huang, Ryen W. White, Georg Buscher, and Kuansan Wang. 2012. Improving Searcher Models Using Mouse Cursor Activity. In Proceedings of the 35th SIGIR . 195--204.
[26]
Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately Interpreting Clickthrough Data As Implicit Feedback. In Proceedings of the 28th SIGIR. 154--161.
[27]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR .
[28]
Daphne Koller and Nir Friedman. 2009. Probabilistic Graphical Models: Principles and Techniques .The MIT Press.
[29]
Dmitry Lagun, Mikhail Ageev, Qi Guo, and Eugene Agichtein. 2014. Discovering Common Motifs in Cursor Movement Data for Improving Web Search. In Proceedings of the 7th WSDM. 183--192.
[30]
Quoc Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In Proceedings of the 31st ICML . 1188--1196.
[31]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature, Vol. 521 (2015), 436--444.
[32]
Chao Liu, Fan Guo, and Christos Faloutsos. 2010. Bayesian Browsing Model: Exact Inference of Document Relevance from Petabyte-Scale Data. ACM Transactions on Knowledge Discovery from Data, Vol. 4, 4 (2010), 19:1--19:26.
[33]
Qiang Liu, Feng Yu, Shu Wu, and Liang Wang. 2015. A Convolutional Click Prediction Model. In Proceedings of the 24th CIKM . 1743--1746.
[34]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: Online Learning of Social Representations. In Proceedings of the 20th KDD . 701--710.
[35]
Filip Radlinski, Madhu Kurup, and Thorsten Joachims. 2008. How Does Clickthrough Data Reflect Retrieval Quality?. In Proceedings of the 17th CIKM . 43--52.
[36]
Matthew Richardson, Ewa Dominowska, and Robert Ragno. 2007. Predicting Clicks: Estimating the Click-through Rate for New Ads. In Proceedings of the 16th WWW . 521--530.
[37]
Fabrizio Silvestri. 2010. Mining Query Logs: Turning Search Usage Data into Knowledge. Foundations and Trends in Information Retrieval, Vol. 4, 1--2 (2010), 1--174.
[38]
Richard Socher, Cliff Chiung-Yu Lin, Andrew Ng, and Christopher D Manning. 2011. Parsing Natural Scenes and Natural Language with Recursive Neural Networks. In Proceedings of the 28th ICML. 129--136.
[39]
Dong Wang, Weizhu Chen, Gang Wang, Yuchen Zhang, and Botao Hu. 2010. Explore Click Models for Search Ranking. In Proceedings of the 19th CIKM . 1417--1420.
[40]
Hongning Wang, ChengXiang Zhai, Anlei Dong, and Yi Chang. 2013. Content-aware Click Modeling. In Proceedings of the 22nd WWW . 1365--1376.
[41]
Hongning Wang, ChengXiang Zhai, Feng Liang, Anlei Dong, and Yi Chang. 2014. User Modeling in Search Logs via a Nonparametric Bayesian Approach. In Proceedings of the 7th WSDM. 203--212.
[42]
Weiran Wang, Raman Arora, Karen Livescu, and Jeff Bilmes. 2015. On Deep Multi-View Representation Learning. In Proceedings of the 32nd ICML . 1083--1092.
[43]
Yisong Yue, Rajan Patel, and Hein Roehrig. 2010. Beyond Position Bias: Examining Result Attractiveness As a Source of Presentation Bias in Clickthrough Data. In Proceedings of the 19th WWW . 1011--1018.
[44]
Yuchen Zhang, Weizhu Chen, Dong Wang, and Qiang Yang. 2011. User-click Modeling for Understanding and Predicting Search-behavior. In Proceedings of the 17th KDD. 1388--1396.
[45]
Yuyu Zhang, Hanjun Dai, Chang Xu, Jun Feng, Taifeng Wang, Jiang Bian, Bin Wang, and Tie-Yan Liu. 2014. Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks. In Proceedings of the 28th AAAI. 1369--1375.
[46]
Yuchen Zhang, Dong Wang, Gang Wang, Weizhu Chen, Zhihua Zhang, Botao Hu, and Li Zhang. 2010. Learning Click Models via Probit Bayesian Inference. In Proceedings of the 19th CIKM . 439--448.
[47]
Zeyuan Allen Zhu, Weizhu Chen, Tom Minka, Chenguang Zhu, and Zheng Chen. 2010. A Novel Click Model and Its Applications to Online Advertising. In Proceedings of the 3rd WSDM . 321--330.

Cited By

View all
  • (2024)Probabilistic graph model and neural network perspective of click models for web searchKnowledge and Information Systems10.1007/s10115-024-02145-z66:10(5829-5873)Online publication date: 6-Jun-2024
  • (2024)MassiveClicks: A Massively-Parallel Framework for Efficient Click Models TrainingEuro-Par 2023: Parallel Processing Workshops10.1007/978-3-031-50684-0_18(232-245)Online publication date: 16-Apr-2024
  • (2022)ParClick: A Scalable Algorithm for EM-based Click ModelsProceedings of the ACM Web Conference 202210.1145/3485447.3511967(392-400)Online publication date: 25-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval
March 2019
463 pages
ISBN:9781450360258
DOI:10.1145/3295750
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. click modeling
  2. deep learning
  3. recurrent neural networks

Qualifiers

  • Research-article

Funding Sources

Conference

CHIIR '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)2
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Probabilistic graph model and neural network perspective of click models for web searchKnowledge and Information Systems10.1007/s10115-024-02145-z66:10(5829-5873)Online publication date: 6-Jun-2024
  • (2024)MassiveClicks: A Massively-Parallel Framework for Efficient Click Models TrainingEuro-Par 2023: Parallel Processing Workshops10.1007/978-3-031-50684-0_18(232-245)Online publication date: 16-Apr-2024
  • (2022)ParClick: A Scalable Algorithm for EM-based Click ModelsProceedings of the ACM Web Conference 202210.1145/3485447.3511967(392-400)Online publication date: 25-Apr-2022
  • (2020)A Context-Aware Click Model for Web SearchProceedings of the 13th International Conference on Web Search and Data Mining10.1145/3336191.3371819(88-96)Online publication date: 20-Jan-2020
  • (2019)Deep Learning of Human Information Foraging Behavior with a Search EngineProceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3341981.3344231(185-192)Online publication date: 26-Sep-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media