Michael S. Bernstein
Jaime Teevan
Susan Dumais
Daniel Liebling
Eric Horvitz
ABSTRACT
Web search engines now offer more than ranked results. Queries on topics like weather, definitions, and movies may return inline results called answers that can resolve a searcher's information need without any additional interaction. Despite the usefulness of answers, they are limited to popular needs because each answer type is manually authored. To extend the reach of answers to thousands of new information needs, we introduce Tail Answers: a large collection of direct answers that are unpopular individually, but together address a large proportion of search traffic. These answers cover long-tail needs such as the average body temperature for a dog, substitutes for molasses, and the keyboard shortcut for a right-click. We introduce a combination of search log mining and paid crowdsourcing techniques to create Tail Answers. A user study with 361 participants suggests that Tail Answers significantly improved users' subjective ratings of search quality and their ability to solve needs without clicking through to a result. Our findings suggest that search engines can be extended to directly respond to a large new class of queries.
- Adar, E., Teevan, J., Dumais, S.T., and Elsas, J.L. The web changes everything. Proc. WSDM '09, (2009).Google Scholar
Digital Library
- Agichtein, E., Lawrence, S., and Gravano, L. Learning to find answers to questions on the Web. ACM TOIS 4, 2 (2004), 129--162. Google ScholarDigital Library
- Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., and Etzioni, O. Open information extraction for the web. IJCAI '072, University of Washington (2007). Google ScholarDigital Library
- Bernstein, M.S., Little, G., Miller, R.C., et al. Soylent: A Word Processor with a Crowd Inside. Proc. UIST '10, (2010). Google ScholarDigital Library
- Brill, E., Dumais, S., and Banko, M. An analysis of the AskMSR question-answering system. Proc. EMNLP '02, (2002). Google ScholarDigital Library
- Broder, A. A taxonomy of web search. ACM SIGIR Forum 36, 2 (2002), 3. Google ScholarDigital Library
- Chilton, L.B. and Teevan, J. Addressing people's information needs directly in a web search result page. Proc. WWW '11, (2011). Google ScholarDigital Library
- Cutrell, E. and Guan, Z. What are you looking for?: an eye-tracking study of information usage in web search. Proc. CHI '07, (2007). Google ScholarDigital Library
- Horowitz, D. and Kamvar, S.D. The anatomy of a largescale social search engine. Proc. WWW '10, (2010). Google ScholarDigital Library
- Kellar, M., Watters, C., and Shepherd, M. A field study characterizing Web-based information-seeking tasks. JASIST 58, 7 (2007), 999--1018. Google ScholarDigital Library
- Law, E. and Zhang, H. Towards Large-Scale Collaborative Planning: Answering High-Level Search Queries Using Human Computation. Proc. AAAI '11, (2011).Google Scholar
- Le, J., Edmonds, A., Hester, V., and Biewald, L. Ensuring quality in crowdsourced search relevance evaluation. Proc. SIGIR '10 Workshop on Crowdsourcing for Search Evaluation, (2010).Google Scholar
- Li, J., Huffman, S., and Tokuda, A. Good abandonment in mobile and PC internet search. Proc. SIGIR '09, (2009). Google ScholarDigital Library
- Lin, J. An exploration of the principles underlying redundancy-based factoid question answering. ACM TOIS 25, 2 (2007). Google ScholarDigital Library
- Little, G., Chilton, L., Goldman, M., and Miller, R.C. Exploring iterative and parallel human computation processes. Proc. HCOMP '10, (2010). Google ScholarDigital Library
- Pirolli, P. Information foraging theory: adaptive interaction with information. Oxford Press, 2007. Google ScholarDigital Library
- Stamou, S. and Efthimiadis, E.N. Queries without clicks: Successful or failed searches. Proc. SIGIR '09 Wkshp on the Future of IR Evaluation, (2009).Google Scholar
- Suchanek, F.M., Kasneci, G., and Weikum, G. YAGO : A Core of Semantic Knowledge Unifying Wikipedia and WordNet. WWW '07, (2007). Google ScholarDigital Library
- Teevan, J., Liebling, D.J., and Ravichandran Geetha, G. Understanding and predicting personal navigation. Proc. WSDM '11, (2011). Google ScholarDigital Library
- White, R.W., Bilenko, M., and Cucerzan, S. Studying the use of popular destinations to enhance web search interaction. Proc. SIGIR '07, (2007). Google ScholarDigital Library
Index Terms
- Direct answers for search queries in the long tail
Recommendations
Recommending high-utility search engine queries via a query-recommending model
Query recommendation technology is of great importance for search engines, because it can assist users to find the information they require. Many query recommendation algorithms have been proposed, but they all aim to recommend similar queries and ...
What Users Ask a Search Engine: Analyzing One Billion Russian Question Queries
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementWe analyze the question queries submitted to a large commercial web search engine to get insights about what people ask, and to better tailor the search results to the users' needs. Based on a dataset of about one billion question queries submitted ...
Query Reformulation Patterns of Mixed Language Queries in Different Search Intents
CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and RetrievalWith the increasing number of multilingual resources on the Internet, cross-language information retrieval has become an important research topic. In cultures where people speak both Chinese and English, using mixed language in oral speaking and web ...
Comments