research-article

Page Hunt: using human computation games to improve web search

Authors:

Hao Ma,

Raman Chandrasekar,

Chris Quirk,

Abhishek GuptaAuthors Info & Claims

HCOMP '09: Proceedings of the ACM SIGKDD Workshop on Human Computation

Pages 27 - 28

https://doi.org/10.1145/1600150.1600158

Published: 28 June 2009 Publication History

Get Access

Abstract

There has been a lot of work on evaluating and improving the relevance of web search engines, primarily using human relevance judgments or using clickthrough data. Both of these approaches look at the problem of learning the mapping from queries to web pages. In contrast, Page Hunt is a single-player human computation game which seeks to learn a mapping from web pages to queries. In particular, Page Hunt is used to elicit data from players about web pages that can be used to improve search. The data that we elicit from players has several applications including providing metadata for pages, providing query alterations for use in query refinement, and identifying ranking issues. The demo has features which make the game fun, while eliciting useful data.

References

[1]

C. Quirk, C. Brockett, and W. B. Dolan. Monolingual Machine Translation for Paraphrase Generation. In Proc. Of EMNLP, Barcelona, Spain, 2004.

Google Scholar

[2]

L. von Ahn. Games with a purpose. IEEE Computer, 39(6):92--94, 2006.

Digital Library

Google Scholar

[3]

L. von Ahn and L. Dabbish. Designing games with a purpose. Communications of the ACM, 51(8):58--67, 2008.

Digital Library

Google Scholar

[4]

H. Ma, R. Chandrasekar, C. Quirk, and A. Gupta. Page Hunt: Improving Search Engines Using Human Computation Games. In Proc. of SIGIR, Boston, USA, 2009.

Digital Library

Google Scholar

Cited By

View all

Chung CMatsuoka AYang YRubin JChechik M(2016)Serious games for NP-hard problemsProceedings of the 5th International Workshop on Games and Software Engineering10.1145/2896958.2896963(29-32)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2896958.2896963
Cambria EHussain ACambria EHussain A(2015)ConclusionSentic Computing10.1007/978-3-319-23654-4_5(155-160)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_5
Cambria EHussain ACambria EHussain A(2015)Sentic ApplicationsSentic Computing10.1007/978-3-319-23654-4_4(107-153)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_4
Show More Cited By

Index Terms

Page Hunt: using human computation games to improve web search
1. Human-centered computing
  1. Collaborative and social computing
2. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

Improving search engines using human computation games
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

Work on evaluating and improving the relevance of web search engines typically use human relevance judgments or clickthrough data. Both these methods look at the problem of learning the mapping from queries to web pages. In this paper, we identify some ...
Page hunt: improving search engines using human computation games
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval

There has been a lot of work on evaluating and improving the relevance of web search engines. In this paper, we suggest using human computation games to elicit data from players that can be used to improve search. We describe Page Hunt, a single-player ...
Intent-based diversification of web search results: metrics and algorithms

We study the problem of web search result diversification in the case where intent based relevance scores are available. A diversified search result will hopefully satisfy the information need of user-L.s who may have different intents. In this context, ...

Comments

Information & Contributors

Information

Published In

HCOMP '09: Proceedings of the ACM SIGKDD Workshop on Human Computation

June 2009

87 pages

ISBN:9781605586724

DOI:10.1145/1600150

Editors:
Paul Bennett
Microsoft Research
,
Raman Chandrasekar
Microsoft Research
,
Max Chickering
Microsoft Corporation
,
Panos Ipeirotis
New York University
,
Edith Law
Carnegie Mellon University
,
Anton Mityagin
Microsoft Corporation
,
Foster Provost
New York University
,
Luis von Ahn
Carnegie Mellon University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

KDD09

Sponsor:

SIGMOD
SIGKDD
Microsoft Research

KDD09: The 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

June 28, 2009

Paris, France

Upcoming Conference

KDD '25

Sponsor:
sigkdd
sigkdd

The 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining

August 3 - 7, 2025

Toronto , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
176
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chung CMatsuoka AYang YRubin JChechik M(2016)Serious games for NP-hard problemsProceedings of the 5th International Workshop on Games and Software Engineering10.1145/2896958.2896963(29-32)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2896958.2896963
Cambria EHussain ACambria EHussain A(2015)ConclusionSentic Computing10.1007/978-3-319-23654-4_5(155-160)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_5
Cambria EHussain ACambria EHussain A(2015)Sentic ApplicationsSentic Computing10.1007/978-3-319-23654-4_4(107-153)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_4
Cambria EHussain ACambria EHussain A(2015)Sentic PatternsSentic Computing10.1007/978-3-319-23654-4_3(73-106)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_3
Cambria EHussain ACambria EHussain A(2015)SenticNetSentic Computing10.1007/978-3-319-23654-4_2(23-71)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_2
Cambria EHussain ACambria EHussain A(2015)IntroductionSentic Computing10.1007/978-3-319-23654-4_1(1-21)Online publication date: 2015
https://doi.org/10.1007/978-3-319-23654-4_1
Krause MSmeddinck J(2012)Human ComputationHandbook of Research on Serious Games as Educational, Business and Research Tools10.4018/978-1-4666-0149-9.ch053(1027-1047)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-0149-9.ch053
Crouser RChang R(2012)An Affordance-Based Framework for Human Computation and Human-Computer CollaborationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.19518:12(2859-2868)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.195
Cambria EHussain ACambria EHussain A(2012)ToolsSentic Computing10.1007/978-94-007-5070-8_4(69-101)Online publication date: 29-Jul-2012
https://doi.org/10.1007/978-94-007-5070-8_4
Levene M(2010)BibliographyAn Introduction to Search Engines and Web Navigation10.1002/9780470874233.biblio(424-461)Online publication date: 4-Aug-2010
https://doi.org/10.1002/9780470874233.biblio

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Improving search engines using human computation games

Page hunt: improving search engines using human computation games

Intent-based diversification of web search results: metrics and algorithms

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations