research-article

One Query, Many Clicks: Analysis of Queries with Multiple Clicks by the Same User

Authors:

Gilad TsurAuthors Info & Claims

CIKM '16: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management

Pages 1423 - 1432

https://doi.org/10.1145/2983323.2983856

Published: 24 October 2016 Publication History

Abstract

In this paper, we study multi-click queries - queries for which more than one click is performed by the same user within the same query session. Such queries may reflect a more complex information need, which leads the user to examine a variety of results. We present a comprehensive analysis that reveals unique characteristics of multi-click queries, in terms of their syntax, lexical domains, contextual properties, and returned search results page. We also show that a basic classifier for predicting multi-click queries can reach an accuracy of 75% over a balanced dataset. We discuss the implications of our findings for the design of Web search tools.

References

[1]

E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of SIGIR, pages 19--26. ACM, 2006.

Digital Library

[2]

A. Berger and J. Lafferty. Information retrieval as statistical translation. In Proceedings of SIGIR, pages 222--229, 1999.

Digital Library

[3]

M. S. Bernstein, J. Teevan, S. Dumais, D. Liebling, and E. Horvitz. Direct answers for search queries in the long tail. In Proceedings of CHI, pages 237--246. ACM, 2012.

Digital Library

[4]

D. J. Brenes, D. Gayo-Avello, and K. Pérez-González. Survey and evaluation of query intent detection methods. In Proceedings of WSCD, pages 1--7. ACM, 2009.

Digital Library

[5]

D. Carmel and E. Yom-Tov. Estimating the query difficulty for information retrieval. Synthesis Lectures on Information Concepts, Retrieval, and Services, 2(1):1--89, 2010.

Digital Library

[6]

D. Chakrabarti, R. Kumar, and K. Punera. Quicklink selection for navigational query results. In Proceedings of WWW, pages 391--400. WWW, 2009.

Digital Library

[7]

S. F. Chen and J. Goodman. An empirical study of smoothing techniques for language modeling. Computer Speech & Language, 13(4):359--393, 1999.

Digital Library

[8]

A. Chuklin, I. Markov, and M. d. Rijke. Click models for web search. Synthesis Lectures on Information Concepts, Retrieval, and Services, 7(3):1--115, 2015.

[9]

K. Crammer, A. Kulesza, and M. Dredze. Adaptive regularization of weight vectors. MLJ, 91(2):155--187, 2013.

Digital Library

[10]

N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In Proceedings of WSDM, pages 87--94. ACM, 2008.

Digital Library

[11]

D. Donato, F. Bonchi, T. Chi, and Y. Maarek. Do you want to take notes?: Identifying research missions in Yahoo! search pad. In Proceedings of WWW, pages 321--330. WWW, 2010.

Digital Library

[12]

H. Duan, E. Kiciman, and C. Zhai. Click patterns: An empirical representation of complex query intents. In Proceedings of CIKM, pages 1035--1044. ACM, 2012.

Digital Library

[13]

K. Ganchev, K. Hall, R. McDonald, and S. Petrov. Using search-logs to improve query tagging. In Proceedings of ACL, pages 238--242. ACL, 2012.

Digital Library

[14]

S. Goel, A. Broder, E. Gabrilovich, and B. Pang. Anatomy of the long tail: Ordinary people with extraordinary tastes. In Proceeding of WSDM, pages 201--210. ACM, 2010.

Digital Library

[15]

F. Guo, C. Liu, A. Kannan, T. Minka, M. Taylor, Y.-M. Wang, and C. Faloutsos. Click chain model in web search. In Proceedings of WWW, pages 11--20. ACM, 2009.

Digital Library

[16]

F. Guo, C. Liu, and Y. M. Wang. Efficient multiple-click models in web search. In Proceedings of WSDM, pages 124--131. ACM, 2009.

Digital Library

[17]

M. Gupta and M. Bendersky. Information retrieval with verbose queries. Foundations and Trends in Information Retrieval, 9(3--4):209--354, 2015.

[18]

I. Guy. Searching by talking: Analysis of voice queries on mobile web search. In Proceedings of SIGIR, pages 35--44. ACM, 2016.

Digital Library

[19]

M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: an update. ACM SIGKDD explorations newsletter, 11(1):10--18, 2009.

Digital Library

[20]

A. Hassan and R. W. White. Task tours: Helping users tackle complex search tasks. In Proceedings of CIKM, pages 1885--1889. ACM, 2012.

Digital Library

[21]

A. Hassan Awadallah, R. W. White, P. Pantel, S. T. Dumais, and Y.-M. Wang. Supporting complex search tasks. In Proceedings of CIKM, pages 829--838. ACM, 2014.

Digital Library

[22]

V. Hatzivassiloglou and J. M. Wiebe. Effects of adjective orientation and gradability on sentence subjectivity. In Proceedings of COLING, pages 299--305. ACL, 2000.

Digital Library

[23]

H. He and E. A. Garcia. Learning from imbalanced data. IEEE Trans. on Knowl. and Data Eng., 21(9):1263--1284, Sept. 2009.

Digital Library

[24]

J. Huang, T. Lin, and R. W. White. No search result left behind: Branching behavior with browser tabs. In Proceedings of WSDM, pages 203--212. ACM, 2012.

Digital Library

[25]

T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of KDD, pages 133--142. ACM, 2002.

Digital Library

[26]

T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of SIGIR, pages 154--161. ACM, 2005.

Digital Library

[27]

R. Jones and K. L. Klinkner. Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. In Proceedings of CIKM, pages 699--708. ACM, 2008.

Digital Library

[28]

J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In Proceedings of SIGIR, pages 43--50. ACM, 2009.

Digital Library

[29]

F. Radlinski and T. Joachims. Query chains: Learning to rank from implicit feedback. In Proceedings of KDD, pages 239--248. ACM, 2005.

Digital Library

[30]

K. Raman, P. N. Bennett, and K. Collins-Thompson. Toward whole-session relevance: Exploring intrinsic diversity in web search. In Proceedings of SIGIR, pages 463--472. ACM, 2013.

Digital Library

[31]

A. Shtok, O. Kurland, D. Carmel, F. Raiber, and G. Markovits. Predicting query performance by query-drift estimation. ACM Trans. Inf. Syst., 30(2):11:1--11:35, May 2012.

Digital Library

[32]

G. Singer, U. Norbisrath, and D. Lewandowski. Ordinary search engine users carrying out complex search tasks. Journal of Information Science, 2012.

Digital Library

[33]

G. Tsur, Y. Pinter, I. Szpektor, and D. Carmel. Identifying web queries with question intent. In Proceedings of WWW, pages 783--793. WWW, 2016.

Digital Library

[34]

D. Tunkelang. Faceted search. Synthesis lectures on information concepts, retrieval, and services, 1(1):1--80, 2009.

Digital Library

[35]

C. Wang, Y. Liu, M. Wang, K. Zhou, J.-y. Nie, and S. Ma. Incorporating non-sequential behavior into click models. In Proceedings of SIGIR, pages 283--292. ACM, 2015.

Digital Library

[36]

Y. Wang and E. Agichtein. Query ambiguity revisited: Clickthrough measures for distinguishing informational and ambiguous queries. In HLT, pages 361--364. Association for Computational Linguistics, 2010.

Digital Library

[37]

R. W. White, S. M. Drucker, G. Marchionini, M. Hearst, and m. c. schraefel. Exploratory search and hci: Designing and evaluating interfaces to support exploratory search interaction. In Proceedings of CHI EA '07, pages 2877--2880. ACM, 2007.

Digital Library

[38]

R. W. White, M. Richardson, and W.-t. Yih. Questions vs. queries in informational search tasks. In Proceedings of WWW Companion, pages 135--136. WWW, 2015.

Digital Library

Cited By

Chen JMao JLiu YZhang FZhang MMa S(2021)Towards a Better Understanding of Query Reformulation Behavior in Web SearchProceedings of the Web Conference 202110.1145/3442381.3450127(743-755)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442381.3450127
Hirsch SGuy INus ADagan AKurland OHuang JChang YCheng XKamps JMurdock VWen JLiu Y(2020)Query Reformulation in E-Commerce SearchProceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3397271.3401065(1319-1328)Online publication date: 25-Jul-2020
https://dl.acm.org/doi/10.1145/3397271.3401065
Mansouri BSadegh Zahedi MCampos RFarhoodi M(2019)Exploring Video Game Searches on the WebCompanion Proceedings of The 2019 World Wide Web Conference10.1145/3308560.3314999(1161-1170)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3308560.3314999
Show More Cited By

Index Terms

One Query, Many Clicks: Analysis of Queries with Multiple Clicks by the Same User
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing
      1. Query log analysis
    2. Users and interactive retrieval
      1. Search interfaces
  2. World Wide Web
    1. Web mining
      1. Web log analysis
    2. Web searching and information discovery
      1. Web search engines

Recommendations

Evaluation of phrasal query suggestions
CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

This paper evaluates the uptake and efficacy of a unified approach to phrasal query suggestions in the context of a high-precision search engine. The search engine performs ranked extended-Boolean searches with the proximity operator <scp>NEAR</scp> ...
A Social-Knowledge-Directed Query Suggestion Approach for Exploratory Search
CYBERC '11: Proceedings of the 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery

Existing query suggestion techniques mainly revolve around mining existing queries that are most similar to a given query. If the query fails to precisely capture a user's real intent, for example, in most exploratory search tasks, suggested queries are ...
When do people use query suggestion? A query suggestion log analysis
Abstract
Query suggestion, which enables the user to revise a query with a single click, has become one of the most fundamental features of Web search engines. However, it has not been clear what circumstances cause the user to turn to query suggestion. In ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '16: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management

October 2016

2566 pages

ISBN:9781450340731

DOI:10.1145/2983323

General Chairs:
Snehasis Mukhopadhyay
Indiana University Purdue University Indianapolis, USA
,
ChengXiang Zhai
University of Illinois at Urbana-Champaign, USA
,
Program Chairs:
Elisa Bertino
Purdue University
,
Fabio Crestani
University of Lugano
,
Javed Mostafa
University of North Carolina
,
Jie Tang
Tsinghua University
,
Luo Si
Alibaba Group Inc & Purdue University
,
Xiaofang Zhou
University of Queensland
,
Yi Chang
Yahoo Research
,
Yunyao Li
IBM Research - Almaden
,
Parikshit Sondhi
WalmartLabs

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM'16

Sponsor:

CIKM'16: ACM Conference on Information and Knowledge Management

October 24 - 28, 2016

Indiana, Indianapolis, USA

Acceptance Rates

CIKM '16 Paper Acceptance Rate 160 of 701 submissions, 23%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
269
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chen JMao JLiu YZhang FZhang MMa S(2021)Towards a Better Understanding of Query Reformulation Behavior in Web SearchProceedings of the Web Conference 202110.1145/3442381.3450127(743-755)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442381.3450127
Hirsch SGuy INus ADagan AKurland OHuang JChang YCheng XKamps JMurdock VWen JLiu Y(2020)Query Reformulation in E-Commerce SearchProceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3397271.3401065(1319-1328)Online publication date: 25-Jul-2020
https://dl.acm.org/doi/10.1145/3397271.3401065
Mansouri BSadegh Zahedi MCampos RFarhoodi M(2019)Exploring Video Game Searches on the WebCompanion Proceedings of The 2019 World Wide Web Conference10.1145/3308560.3314999(1161-1170)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3308560.3314999
Borisov AWardenaar MMarkov Ide Rijke MCollins-Thompson KMei QDavison BLiu YYilmaz E(2018)A Click Sequence Model for Web SearchThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210004(45-54)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210004
Guy I(2018)The Characteristics of Voice SearchACM Transactions on Information Systems10.1145/318216336:3(1-28)Online publication date: 13-Mar-2018
https://dl.acm.org/doi/10.1145/3182163
Levi OGuy IRaiber FKurland O(2018)Selective Cluster Presentation on the Search Results PageACM Transactions on Information Systems10.1145/315867236:3(1-42)Online publication date: 28-Feb-2018
https://dl.acm.org/doi/10.1145/3158672
Sekharan C(2017)A probabilistic graphical model for learning as search2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC)10.1109/CCWC.2017.7868379(1-4)Online publication date: Jan-2017
https://doi.org/10.1109/CCWC.2017.7868379

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten