Cited By
View all- Schultheiß SLewandowski Dvon Mach SYagci N(2023)Query sampler: generating query sets for analyzing search engines using keyword research toolsPeerJ Computer Science10.7717/peerj-cs.14219(e1421)Online publication date: 7-Jun-2023
SOGOU-2012-CRAWL: A Crawl of Search Results in the Sogou 2012 Chinese Query Log
Pages 709 - 712
Abstract
In 2012, Sogou, a major Chinese web search engine released a large-scale query log containing 43.5M user interactions, including submitted queries and clicked web page search results. This query log offers a deep sample of queries over a two day period from 30th December 2011 to 1st January 2012. In August 2013, we identified 1.4M predominantly Chinese language unique search result URLs that were clicked at least three times in this query log. We crawled the HTML content of these URLs to construct the supplementary SOGOU-2012-CRAWL dataset, which we release in this work. A real large-scale query log with accompanying crawl such as this offers several opportunities for reproducible information retrieval (IR) research, including query classification, intent modelling and indexing strategy. In this paper we first detail the query log and crawl dataset construction and characteristics. Following this, to demonstrate potential applications we use the crawl to indicatively analyse various time-based patterns in web content and search behaviour. In particular, we study the distribution of language-independent date expressions in the crawled web content. Based on this, we propose a simple approach for modelling the past/present/future temporal intent of queries based on the date the query was submitted by the user, and the dates appearing in the clicked search results. We observe several prominent temporal patterns which may lead to novel time-aware IR approaches.
References
[1]
S. M. Beitzel, E. C. Jensen, A. Chowdhury, O. Frieder, and D. Grossman. Temporal analysis of a very large topically categorized web query log. J. Am. Soc. Inf. Sci. Technol., 58(2):166--178, January 2007.
[2]
K. Berberich, S. Bedathur, O. Alonso, and G. Weikum. A language modeling approach for temporal information needs. ECIR'2010, pages 13--25, Berlin, Heidelberg, 2010. Springer-Verlag.
[3]
N. Craswell, R. Jones, G. Dupret, and E. Viegas. Wscd '09: Proceedings of the 2009 workshop on web search click data. New York, NY, USA, 2009. ACM.
[4]
J. L. Elsas and S. T. Dumais. Leveraging temporal dynamics of document content in relevance ranking. WSDM '10, pages 1--10, New York, NY, USA, 2010. ACM.
[5]
D. Fetterly, M. Manasse, M. Najork, and J. Wiener. A large-scale study of the evolution of web pages. WWW '03, pages 669--678, New York, NY, USA, 2003. ACM.
[6]
R. Jones and F. Diaz. Temporal profiles of queries. ACM Trans. Inf. Syst., 25(3):14--es, 2007.
[7]
N. Kanhabua and K. Nørvåg. Determining time of queries for re-ranking search results. ECDL'10, pages 261--272, Berlin, Heidelberg, 2010. Springer-Verlag.
[8]
S. Nunes, C. Ribeiro, and G. David. Use of temporal expressions in web search. ECIR'08, pages 580--584, Berlin, Heidelberg, 2008. Springer-Verlag.
[9]
G. Pass, A. Chowdhury, and C. Torgeson. A picture of search. InfoScale '06, New York, NY, USA, 2006. ACM.
[10]
J. Strötgen, O. Alonso, and M. Gertz. Identification of top relevant temporal expressions in documents. TempWeb '12, pages 33--40, New York, NY, USA, 2012. ACM.
[11]
J. Strötgen and M. Gertz. Heideltime: High quality rule-based extraction and normalization of temporal expressions. SemEval '10, pages 321--324, Stroudsburg, PA, USA, 2010. ACL.
Index Terms
- SOGOU-2012-CRAWL: A Crawl of Search Results in the Sogou 2012 Chinese Query Log
Recommendations
Temporal variance of intents in multi-faceted event-driven information needs
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrievalTime is often important for understanding user intent during search activity, especially for information needs related to event-driven topics. Diversity for multi-faceted information needs ensures that ranked documents optimally cover multiple facets ...
The essence of time: considering temporal relevance as an intent-aware ranking problem
SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrievalReal-time news and social media quickly reflect large-scale phenomena and events. As users become exposed to this information, time plays a central role in prompting both information authorship and seeking activities.
The objective of this research is ...
Recent and robust query auto-completion
WWW '14: Proceedings of the 23rd international conference on World wide webQuery auto-completion (QAC) is a common interactive feature that assists users in formulating queries by providing completion suggestions as they type. In order for QAC to minimise the user's cognitive and physical effort, it must: (i) suggest the user'...
Comments
Information & Contributors
Information
Published In
July 2016
1296 pages
ISBN:9781450340694
DOI:10.1145/2911451
- General Chairs:
- Raffaele Perego,
- Fabrizio Sebastiani,
- Program Chairs:
- Javed Aslam,
- Ian Ruthven,
- Justin Zobel
Copyright © 2016 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 July 2016
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
SIGIR '16
Sponsor:
SIGIR '16: The 39th International ACM SIGIR conference on research and development in Information Retrieval
July 17 - 21, 2016
Pisa, Italy
Acceptance Rates
SIGIR '16 Paper Acceptance Rate 62 of 341 submissions, 18%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 194Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)1
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
Cited By
View all- Schultheiß SLewandowski Dvon Mach SYagci N(2023)Query sampler: generating query sets for analyzing search engines using keyword research toolsPeerJ Computer Science10.7717/peerj-cs.14219(e1421)Online publication date: 7-Jun-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in