Skip to main content

History-Aware Expansion and Fuzzy for Query Reformulation

  • Conference paper
  • First Online:
Artificial Intelligence (CICAI 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13070))

Included in the following conference series:

  • 1271 Accesses

Abstract

Query reformulation is the task of rewriting users’ query to predict their information need. A user often struggles to modify a query by adding or removing terms when interacting with search engines. To address this issue, we propose a history-aware expansion and fuzzy model for query reformulation that improves follow-up queries based on successful history click-through logs. A probabilistic model is thus presented to calculate term weight in history and expand meaningful terms or fuzz trivial terms to follow-up query. Experimental results show that reformulated query can improve search engine results on low-frequency and long-tailed queries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, H., Jun, X.: Semantic matching in search. In: Foundations and Trends in Information Retrieval 7, pp. 343–469 (2014)

    Google Scholar 

  2. Manning, C.D., Raghavan, P., SchAijtze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)

    Google Scholar 

  3. Carpineto, C., Romano, G.: A Survey of Automatic Query Expansion in Information Retrieval. ACM Computing Surveys, volume 44 of CSUR, pp. 1–50, January 2012

    Google Scholar 

  4. Liu, Q., Huang, H., Lu, J., Gao, Y., Zhang, G.: Enhanced word embedding similarity measures using fuzzy rules for query expansion. In: Fuzzy Systems, pp. 571–578 (2017)

    Google Scholar 

  5. Meili, L., Sun, X., Wang, S., Lo, D., Duan, Y.: Query expansion via wordnet for effective code search. In: Software Analysis. Evolution and Reengineering, SANER, pp. 545–549, Montreal, QC, Canada (2015)

    Google Scholar 

  6. Ooi, J., Ma, X., Qin, H., Liew, S.C.: A survey of query expansion, query suggestion and query refinement techniques. In: 4th International Conference on Software Engineering and Computer Systems. ICSECS, pp. 545–549, Kuantan, Pahang, Malaysia (2015)

    Google Scholar 

  7. Xiong, C., Callan, J.: Query expansion with freebase. In: 2015 International Conference on The Theory of Information Retrieval. ICTIR, pp. 111–120. Northampton, Massachusetts, USA (2015)

    Google Scholar 

  8. Singh, J., Sharan, A.: A new fuzzy logic-based query expansion model for efficient information retrieval using relevance feedback approach. In: Neural Computing and Applications, vol. 28, pp. 2557–2580 (2017)

    Google Scholar 

  9. Almasri, M., Berrut, C., Chevallet, J.-P.: A comparison of deep learning based query expansion with pseudo-relevance feedback and mutual information. In: European Conference on Information Retrieval, pp. 709–715, March 2016

    Google Scholar 

  10. Kuzi, S., Shtok, A., Kurland, O.: Query expansion using word embeddings. In: CIKM, pp. 1929–1932, Indianapolis, IN, USA (2016)

    Google Scholar 

  11. Diaz, F., Mitra, B., Craswell, N.: Query expansion with locally trained word embeddings. In: ACL, vol. 1, pp. 367–377 (2016)

    Google Scholar 

  12. Roy, D., Paul, D., Mitra, M., Garain, U.: Using word embeddings for automatic query expansion. In: SIGIR, vol. 1, July 2016

    Google Scholar 

  13. Liu, Y., Miao, J., Zhang, M., Ma, S., Ru, L.: How do users describe their information need: query recommendation based on snippet click model. In: Expert Systems with Applications, vol. 38, pp. 13847–13856 (2011)

    Google Scholar 

  14. Balasubramanian, N., Kumaran, G., Carvalho, V.R.: Exploring reductions for long web queries. In: SIGIR, pp. 571–578, Geneva, Switzerland, July 2010

    Google Scholar 

  15. Pramanik, R., Pal, S., Chakraborty, M.: What the user does not want ?: Query reformulation through term inclusion-exclusion. In: ACM Conference on Data Sciences, pp. 116–117, Bangalore, India (2015)

    Google Scholar 

  16. Sloan, M., Yang, H., Wang, J.: A term-based methodology for query reformulation understanding. Inf. Retrieval J. 18(2), 145–165 (2015). https://doi.org/10.1007/s10791-015-9251-5

    Article  Google Scholar 

  17. Mottin, M., Bonchi, F., Gullo, F.: Graph query reformulation with diversity. In: SIGKDD, Sydney, NSW, Australia (2015)

    Google Scholar 

  18. Wang, Y., Huang, H., Feng, C.: Query expansion based on a feedback concept model for microblog retrieval. In: WWW, pp. 559–568, Perth, Australia (2017)

    Google Scholar 

  19. Nogueira, R., Cho, K.: Task-oriented query reformulation with reinforcement learning. In: EMNLP, pp. 585–594, Copenhagen, Denmark, September 2017

    Google Scholar 

  20. Buck, C., et al.: Ask the right questions: active question reformulation with reinforcement learning. In: ICLR, Vancouver, Canada (2018)

    Google Scholar 

  21. Odijk, D., White, R.W., Awadallah, A.H., Dumais, S.T.: Struggling and success in web search. In: CIKM, Melbourne, Australia (2015)

    Google Scholar 

  22. Wang, X., Zhai, C.: Mining term association patterns from search logs for effective query reformulation. In: CIKM, pp. 479–488, Napa Valley, California, USA, October 2008

    Google Scholar 

  23. Thulin, M.: The cost of using exact confidence intervals for a binomial proportion. Electron. J. Stat. 8, 817–840 (2014)

    Google Scholar 

  24. Wallis, S.: A binomial confidence intervals and contingency tests: mathematical fundamentals and the evaluation of alternative methods. J. Quant. Linguist. 20, 178–208 (2013)

    Google Scholar 

  25. Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: EMNLP, pp. 1532–1543 (2014)

    Google Scholar 

  26. Liu, Y., Miao, J., Zhang, M., Ma, S., Liyun, R.: How do users describe their information need: query recommendation based on snippet click model. Expert Syst. Appl. 38(11), 13847–13856 (2011)

    Google Scholar 

  27. Zhou, X.W.D., Zhao, W.: Query expansion with enriched user profiles for personalized search utilizing folksonomy data. In: EMNLP, vol. 29, pp. 1536–1548, July 2017

    Google Scholar 

  28. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NeurIPS (2013)

    Google Scholar 

  29. Mikolov, T., tau Yih, W., Zweig, G.: Linguistic regularities in continuous space word representations. In: NAACL (2013)

    Google Scholar 

Download references

Acknowledgements

We thank the reviewers for their comments and suggestions. This paper is supported by NSFC (No. 61906018), Huawei Noah’s Ark Lab, MoE-CMCC “Artificial Intelligence” Project (No. MCM20190701), Beijing Natural Science Foundation (Grant No. 4204100), and BUPT Excellent Ph.D. Students Foundation (No. CX2020309).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Pang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pang, W., Duan, R. (2021). History-Aware Expansion and Fuzzy for Query Reformulation. In: Fang, L., Chen, Y., Zhai, G., Wang, J., Wang, R., Dong, W. (eds) Artificial Intelligence. CICAI 2021. Lecture Notes in Computer Science(), vol 13070. Springer, Cham. https://doi.org/10.1007/978-3-030-93049-3_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-93049-3_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-93048-6

  • Online ISBN: 978-3-030-93049-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics