Ali Dasdan
Chris Drome
ABSTRACT
Human computation is an effective way to channel human effort spent playing games to solving computational problems that are easy for humans but difficult for computers to automate. We propose Thumbs-Up, a new game for human computation with the purpose of playing to rank search result. Our experience from users shows that Thumbs-Up is not only fun to play, but produces more relevant rankings than both a major search engine and optimal rank aggregation using the Kemeny rule.
- B. Carterette, P. Bennett, D. M. Chichering, and S. Dumais. Here or there: Preference judgments for relevance. In Proc. Int. Euro. Conf. on IR (ECIR), pp. 16--27. ACM, 2008. Google Scholar
Digital Library
- C. Dwork, R. Kumar, M. Naor, and D. Sivakumar. Rank aggregation methods for the web. In Proc. Int. Conf. on WWW (WWW), pp. 613--622. ACM, 2001. Google ScholarDigital Library
- The Entertainment Software Association: Industry facts. http://www.theesa.com/facts/, Dec 2008.Google Scholar
- K. Jarvelin and J. Kekalainen. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst., 20(4):422--446, 2002. Google ScholarDigital Library
- L. von Ahn and L. Dabbish. Designing games with a purpose. Commun. ACM, 51(8):58--67, 2008. Google ScholarDigital Library
Index Terms
- Thumbs-up: a game for playing to rank search results
Recommendations
Thumbs-Up: a game for playing to rank search results
HCOMP '09: Proceedings of the ACM SIGKDD Workshop on Human ComputationHuman computation is an effective way to channel human effort spent playing games to solving computational problems that are easy for humans but difficult for computers to automate. We propose Thumbs-Up, a new game for human computation with the purpose ...
Improving web search relevance and freshness with content previews
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge managementTraditional web search engines find it challenging to achieve good search quality for recency-sensitive queries, as they are prone to delays in discovering, indexing and ranking new web pages. In this paper we introduce PreGen, an adaptive preview ...
Search Computing: Managing Complex Search Queries
Search computing focuses on building answers to complex search queries (for example, "Where can I attend an interesting conference in my field near a sunny beach?") by interacting with a constellation of cooperating search services, and using result ...
Comments