Abstract
To fulfill some sophisticated information needs in Web search, users may submit multiple queries in a search session. Session search aims to provide an optimized document rank by utilizing query log as well as user interaction behaviors within a search session. Although a number of solutions were proposed to solve the session search problem, most of these efforts simply assume that users’ search intents stay unchanged during the search process. However, most complicated search tasks involve exploratory processes where users’ intents evolve while interacting with search results. The evolving process leaves the static search intent assumption unreasonable and hurts the performance of document rank. To shed light on this research question, we propose a system with multiple agents which adjusts its framework by a self-adaption mechanism. In the framework, each agent models the document ranking as a Markov Decision Process (MDP) and updates its parameters by Reinforcement Learning algorithms. Experimental results on TREC Session Track datasets (2013 & 2014) show the effectiveness of the proposed framework.
J. Chen—This work is supported by Natural Science Foundation of China (Grant No. 61622208, 61732008, 61532011) and National Key Basic Research Program (2015CB358700).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Carterette, B., Kanoulas, E., Hall, M., Bah, A., Clough, P.: Overview of the TREC 2013 session track. Technical report, Delaware University Newark Department of Computer and Information Sciences (2013)
Carterette, B., Kanoulas, E., Hall, M., Clough, P.: Overview of the TREC 2014 session track. Technical report, Delaware University Newark Department of Computer and Information Sciences (2014)
Carterette, B., Kanoulas, E., Yilmaz, E.: Simulating simple user behavior for system effectiveness evaluation. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 611–620. ACM (2011)
Feild, H., Allan, J.: Task-aware query recommendation. In: Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 83–92. ACM (2013)
Guan, D., Yang, H., Goharian, N.: Effective structured query formulation for session search. Technical report, Georgetown Univ Washington DC Dept Of Computer Science (2012)
Guan, D., Zhang, S., Yang, H.: Utilizing query change for session search. In: Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 453–462. ACM (2013)
Gwizdka, J., Hansen, P., Hauff, C., He, J., Kando, N.: Search as learning (SAL) workshop 2016. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1249–1250. ACM (2016)
Jiang, J., Han, S., Wu, J., He, D.: Pitt at TREC 2011 session track. In: TREC (2011)
Joachims, T.: A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. Technical report, Carnegie-Mellon University Pittsburgh PA Department of Computer Science (1996)
Kotov, A., Bennett, P.N., White, R.W., Dumais, S.T., Teevan, J.: Modeling and analysis of cross-session search tasks. In: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, pp. 5–14. ACM (2011)
Littman, M.L., Kaelbling, L.P., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 99–134 (1995)
Liu, J., Belkin, N.J.: Personalizing information retrieval for multi-session tasks: the roles of task stage and task type. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 26–33. ACM (2010)
Luo, J., Zhang, S., Yang, H.: Win-win search: dual-agent stochastic game in session search. In: Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 587–596. ACM (2014)
Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Pitman, J., et al.: Combinatorial stochastic processes. Technical report, Technical Report 621, Department of Statistics, UC Berkeley, 2002. Lecture notes for St. Flour course (2002)
Radlinski, F., Joachims, T.: Query chains: learning to rank from implicit feedback, pp. 239–248 (2006)
Raman, K., Bennett, P.N., Collins-Thompson, K.: Toward whole-session relevance: exploring intrinsic diversity in web search. In: Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 463–472. ACM (2013)
Song, Y., He, L.W.: Optimal rare query suggestion with implicit user feedback. In: International Conference on World Wide Web, WWW 2010, Raleigh, North Carolina, USA, pp. 901–910, April 2010
Teevan, J., Dumais, S.T., Liebling, D.J.: To personalize or not to personalize: modeling queries with variation in user intent. In: International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 163–170 (2008)
Wang, H., Song, Y., Chang, M.W., He, X., White, R.W., Chu, W.: Learning to extract cross-session search tasks. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 1353–1364. ACM (2013)
Wei, Z., Xu, J., Lan, Y., Guo, J., Cheng, X.: Reinforcement learning to rank with markov decision process (2017)
Zhang, S., Luo, J., Yang, H.: A POMDP model for content-free document re-ranking, pp. 1139–1142 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, J., Liu, Y., Luo, C., Mao, J., Zhang, M., Ma, S. (2018). Improving Session Search Performance with a Multi-MDP Model. In: Tseng, YH., et al. Information Retrieval Technology. AIRS 2018. Lecture Notes in Computer Science(), vol 11292. Springer, Cham. https://doi.org/10.1007/978-3-030-03520-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-03520-4_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03519-8
Online ISBN: 978-3-030-03520-4
eBook Packages: Computer ScienceComputer Science (R0)