Bahar Salehi
Damiano Spina
Alistair Moffat
Falk Scholer
Mark Sanderson
ABSTRACT
Errors in formulation of queries made by users can lead to poor search results pages. We performed a living lab study using online A/B testing to measure the degree of improvement achieved with a query amendment technique when applied to a commercial job search engine. Of particular interest in this case study is a clear 'success' signal, namely, the number of job applications lodged by a user as a result of querying the service. A set of 276 queries was identified for amendment in four different categories through the use of word embeddings, with large gains in conversion rates being attained in all four of those categories. Our analysis of query reformulations also provides a better understanding of user satisfaction in the case of problematic queries (ones with fewer results than fill a single page) by observing that users tend to reformulate rewritten queries less.
- A. H. Awadallah, X. Shi, N. Craswell, and B. Ramsey. 2013. Beyond clicks: Query reformulation as a predictor of search satisfaction Proc. CIKM. 2019--2028. Google Scholar
Digital Library
- P. D. Bruza and S. Dennis. 1997. Query reformulation on the internet: Empirical data and the hyperindex search engine Proc. RIAO. 488--499. Google ScholarDigital Library
- F. Cai and M. de Rijke. 2016. Selectively personalizing query auto-completion. In Proc. SIGIR. 993--996. Google ScholarDigital Library
- C. Carpineto and G. Romano. 2012. A survey of automatic query expansion in information retrieval. ACM Comp. Surv. Vol. 44, 1 (2012), 1. Google ScholarDigital Library
- J. Gao, X. Li, D. Micol, C. Quirk, and X. Sun. 2010. A large scale ranker-based system for search query spelling correction Proc. COLING. 358--366. Google ScholarDigital Library
- K. Hofmann, L. Li, and F. Radlinski. 2016. Online evaluation for information retrieval. Found. & Trends in IR Vol. 10, 1 (2016), 1--117. Google ScholarDigital Library
- J. Huang and E. N. Efthimiadis. 2009. Analyzing and evaluating query reformulation strategies in web search logs Proc. CIKM. 77--86. Google ScholarDigital Library
- M. Kusner, Y. Sun, N. Kolkin, and K. Weinberger. 2015. From word embeddings to document distances. In Proc. ICML. 957--966. Google ScholarDigital Library
- T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space Proc. ICLR Wrkshp.Google Scholar
- A. Saha and D. Arya. 2017. Generalized mixed effect models for personalizing job search Proc. SIGIR. 1129--1132. Google ScholarDigital Library
- M. Shokouhi, R. Jones, U. Ozertem, K. Raghunathan, and F. Diaz. 2014. Mobile query reformulations. In Proc. SIGIR. 1011--1014. Google ScholarDigital Library
- D. Spina, M. Maistro, Y. Ren, S. Sadeghi, W. Wong, T. Baldwin, L. Cavedon, A. Moffat, M. Sanderson, F. Scholer, and J. Zobel. 2017. Understanding user behavior in job and talent search: An Initial Investigation Proc. SIGIR Wrkshp. eCommerce.Google Scholar
- J. Wang, W. Zhang, and S. Yuan. 2017. Display advertising with real-time bidding (RTB) and behavioural targeting. Found. & Trends in IR Vol. 11, 4--5 (2017), 297--435. Google ScholarDigital Library
Index Terms
- A Living Lab Study of Query Amendment in Job Search
Recommendations
Online Job Search: Study of Users' Search Behavior using Search Engine Query Logs
SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information RetrievalOver the last few years, an increasing number of user's and enterprises on the internet has generated a global marketplace for both employers and job seekers. Despite the fact that online job search is now more preferable than traditional methods - ...
Mapping Natural Language Questions to SPARQL Queries for Job Search
ICSC '13: Proceedings of the 2013 IEEE Seventh International Conference on Semantic ComputingA technique for enabling end users to explore semantically annotated data in job search domain, Sem-QAS is presented. It translates a natural language text query into SPARQL by semantically identifying distinct atomic filtering constraints and their ...
Combining query translation with query answering for efficient keyword search
ESWC'10: Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part IIKeyword search has been regarded as an intuitive paradigm for searching not only documents but also data, especially when the users are not familiar with the data and the query language. Two types of approaches can be distinguished. Answers to keywords ...
Comments