skip to main content
10.1145/1963192.1963223acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
poster

Automatically generating labels based on unified click model

Published: 28 March 2011 Publication History

Abstract

Ground truth labels are one of the most important parts in many test collections for information retrieval. Each label, depicting the relevance between a query-document pair, is usually judged by a human, and this process is time-consuming and labor-intensive. Automatically Generating labels from click-through data has attracted increasing attention. In this paper, we propose a Unified Click Model to predict the multi-level labels, which aims at comprehensively considering the advantages of the Position Models and Cascade Models. Experiments show that the proposed click model outperforms the existing click models in predicting the multi-level labels, and could replace the labels judged by humans for test collections.

References

[1]
A. Broder. A taxonomy of web search. In SIGIR Forum, 2002.
[2]
O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In WWW, pages 1--10, 2009.
[3]
N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In WSDM, pages 87--94, 2008.
[4]
R. Herbrich and et.al. Large margin rank boundaries for ordinal regression. In Advances in Large Margin Classifiers, pages 115--132, 2000.
[5]
T. Joachims. Optimizing search engines using clickthrough data. In KDD 2002, pages 133--142.
[6]
T. Qin and et.al. Letor: A benchmark collection for research on learning to rank for information retrieval. In Information Retrieval Journal, 2010.
[7]
D. E. Rose and D. Levinson. Understanding user goals in web search. In WWW, 2004.
[8]
L. R. Yiqun Liu, Min Zhang and S. Ma. Automatic query type identification based on click through information. In AIRS, 2006.
[9]
V. Zhang and R. Jones. Comparing click logs and editorial labels for training query rewriting. In WWW 2007 Workshop: Query Log Analysis: Social And Technological Challenges.

Cited By

View all
  • (2014)Query recommendation in the information domain of childrenJournal of the Association for Information Science and Technology10.1002/asi.2305565:7(1368-1384)Online publication date: 1-Jul-2014

Index Terms

  1. Automatically generating labels based on unified click model

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    WWW '11: Proceedings of the 20th international conference companion on World wide web
    March 2011
    552 pages
    ISBN:9781450306379
    DOI:10.1145/1963192

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 March 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. click model
    2. learning to rank
    3. ranking SVM

    Qualifiers

    • Poster

    Conference

    WWW '11
    WWW '11: 20th International World Wide Web Conference
    March 28 - April 1, 2011
    Hyderabad, India

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2014)Query recommendation in the information domain of childrenJournal of the Association for Information Science and Technology10.1002/asi.2305565:7(1368-1384)Online publication date: 1-Jul-2014

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media