Skip to main content
SpringerLink
Log in

An evolutionary game theory based approach for query expansion

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In Information Retrieval (IR) Systems, an essential technique employed to improve accuracy and efficiency is Query Expansion (QE). QE is the technique that reformulates the original query by adding the relevant terms that aid the retrieval process in generating more relevant outcomes. Numerous methods have been proposed in the literature that generates desirable results, however they do not provide evenly favourable results for all types of queries. One of the primary reasons for this is their inability to capture holistic relationships among the query terms. To tackle this issue, we have proposed a novel technique for QE that leverages a game-theoretic framework to recommend contextually relevant expansion terms for each query. In our approach, the query terms are interpreted as players that play a game with the other terms in the query in order to maximize their payoffs; the payoffs are determined using similarity measures between two query terms in the game. Our framework also works best for disambiguating polysemous query terms. The experimental section presents an analysis of the combination of various similarity and association measures employed in the proposed framework and a comparative analysis against state-of-art approaches. In addition to this, we present our analysis over three datasets, namely AP89, INEX and CLUEWEB in combination with WordNet and BabelNet as knowledge bases. The results show that the proposed work outperforms state-of-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.natcorp.ox.ac.uk/corpus

  2. https://www.lemurproject.org/clueweb09.php/

  3. http://inex.mmci.uni-saarland.de/data/documentcollection.html

  4. https://wordnet.princeton.edu/

References

  1. Amati G, Van Rijsbergen CJ (2002) Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM Trans Inf Syst (TOIS) 20(4):357–389

    Article  Google Scholar 

  2. Araujo L (2008) "How evolutionary algorithms are applied to statistical natural language processing." Springer

  3. Arora P, Foster J, Jones GJF (2017) Query expansion for sentence retrieval using pseudo relevance feedback and word embedding. International Conference of the Cross-Language Evaluation Forum for European Languages. Springer, Cham

  4. Azad HK, Deepak A (2019) A new approach for query expansion using Wikipedia and WordNet. Inf Sci 492:147–163

    Article  Google Scholar 

  5. Bhogal J, MacFarlane A, Smith P (2007) A review of ontology based query expansion. Inf Process Manag 43(4):866–886

    Article  Google Scholar 

  6. Bodner RC, Song F (1996) Knowledge-based approaches to query expansion in information retrieval. In Conference of the Canadian Society for Computational Studies of Intelligence (pp. 146–158). Springer, Berlin, Heidelberg

  7. Buckley C et al (1995) Automatic query expansion using SMART: TREC 3. NIST special publication sp 69–69

  8. Buyse K, Saver E, Laffut A, Vekemans H (2011) "UrgentiAS, a Lexical Database for Medical Students in Clinical Placements: Architecture, Use and Evaluation." Res Specialized Lang 47:191–21

  9. Carpineto C, Romano G (2012) A survey of automatic query expansion in information retrieval. Acm Comput Surv (CSUR) 44(1):1–50

    Article  Google Scholar 

  10. Colace F, Santo MD, Greco D, Napoletano P (2015) "Weighted Word Pairs for query expansion." Inf Process Manag 51(1):179–193. Available https://doi.org/10.1016/j.ipm.2014.07.004

  11. Collins-Thompson K, Callan J (2005) "Query expansion using random walk models." Proceedings of the 14th ACM international conference on Information and knowledge management

  12. Dhungana UR, Subarna S, Baral K, Sharma B (2015) "Word Sense Disambiguation using WSD specific WordNet of polysemy words." In Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015) (pp. 148–152). IEEE

  13. Durao F, Bayyapu K, Xu G (2014) Expanding user’s query with tag-neighbors for effective medical information retrieval. Multimed Tools Appl 71:905–929. https://doi.org/10.1007/s11042-012-1316-5

    Article  Google Scholar 

  14. Erdem A, Pelillo M (2012) Graph Transduction as a Noncooperative Game. Neural Comput 24(3):700–723. Available https://doi.org/10.1162/neco_a_00233

  15. Gale WA, Church KW, Yarowsky D (1992) One sense per discourse. In Proceedings of the workshop on Speech and Natural Language . Assoc Comput Linguist 233–237

  16. Grootjen FA, Van Der Weide TP (2006) Conceptual query expansion. Data Knowl Eng 56(2):174–193

    Article  Google Scholar 

  17. Jiang JJ, Conrath D (1997) Semantic similarity based on corpus statistics and lexical taxonomy. arXiv preprint cmp-lg/9709008

  18. Kang JW, Kang HK, Ko MC, Jeon HS, Nam J (2010) A term cluster query expansion model based on classification information in natural language information retrieval. In 2010 International Conference on Artificial Intelligence and Computational Intelligence 2:172–176. IEEE

  19. Laorden C (2013) "Negobot: A conversational agent based on game theory for the detection of paedophile behaviour." International Joint Conference CISIS’12-ICEUTE´ 12-SOCO´ 12 Special Sessions. Springer, Berlin, Heidelberg

  20. Liu H, Singh P (2004) ConceptNet—a practical commonsense reasoning tool-kit. BT Technol J 22(4):211–226

    Article  Google Scholar 

  21. Lu M, Sun X, Wang S, Lo D, Duan Y (2015) "Query expansion via wordnet for effective code search." In 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER), pp. 545–549. IEEE

  22. Manning CD, Raghavan P, Schütze H (2009) Introduction to information retrieval. Cambridge University Press

    MATH  Google Scholar 

  23. Manning C, Raghavan P, Schütze H (2009) "Chapter 8: Evaluation in information retrieval". Part of Introduction to Information Retrieval

  24. Maron ME, Kuhns JL (1960) On relevance, probabilistic indexing and information retrieval. J ACM (JACM) 7(3):216–244

    Article  Google Scholar 

  25. Miller GA (1995) WordNet: A Lexical Database for English. Commun ACM 38(11):39–41

    Article  Google Scholar 

  26. Nash J (1951) "Non-Cooperative Games." Ann Math 54(2):286. Available https://doi.org/10.2307/1969529

  27. Nasir JA, Varlamis I, Ishfaq S (2019) “A knowledge-based semantic framework for query expansion.” Inf Process Manag 56(5)

  28. Neumann J, Morgenstern O (1966) Theory of games and economic behavior. Princeton University Press, Princeton

    MATH  Google Scholar 

  29. Ounis I, Amati G, Plachouras V, He B, Macdonald C, Johnson D (2005) "Terrier Information Retrieval Platform." In Losada D.E., Fernández-Luna J.M. (eds) Advances in Information Retrieval. ECIR 2005. Lecture Notes in Computer Science, Springer

  30. Pedersen T, Patwardhan S, Michelizzi J (2004) WordNet:: Similarity-Measuring the Relatedness of Concepts. In AAAI 4:25–29

  31. Raifer N, Raiber F, Tennenholtz M, Kurland O (2017) "Information retrieval meets game theory: The ranking competition between documents’ authors." In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval 465–-474

  32. Robertson SE, Walker S, Beaulieu M, Gatford M, Payne A (1996) "Okapi at trec-4." Nist Special Publication Sp 73–96

  33. Roberto N, Ponzetto SP (2010) "BabelNet: Building a very large multilingual semantic network." Proceedings of the 48th annual meeting of the association for computational linguistics. Assoc Comput Linguist

  34. Rocchio J (1971) Relevance feedback in information retrieval. The Smart retrieval system-experiments in automatic document processing 313–323

  35. Roy D, Paul D, Mitra M, Garain U (2016) "Using word embeddings for automatic query expansion." arXiv preprint arXiv:1606.07608

  36. Sanderson M (2008) Ambiguous queries: test collections need more sense. Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

  37. Saxena A, Mangal M, Jain G (2020) KeyGames: A Game Theoretic Approach to Automatic Keyphrase Extraction. In Proceedings of the 28th International Conference on Computational Linguistics (pp. 2037–2048)

  38. Singh J, Sharan A (2017) A new fuzzy logic-based query expansion model for efficient information retrieval using relevance feedback approach. Neural Comput Appl 28(9):2557–2580

    Article  Google Scholar 

  39. Singh J, Sharan A (2018) "Rank fusion and semantic genetic notion based automatic query expansion model." Swarm Evol Comput 38:295–308. Available https://doi.org/10.1016/j.swevo.2017.09.007

  40. Sharma DK, Pamula R, Chauhan DS (2020) A contemporary combined approach for query expansion. Multimed Tools Appl

  41. Smith JM, Price GR (1973) The logic of animal conflict. Nature 15:246

    MATH  Google Scholar 

  42. Soldaini L, Yates A, Yom-Tov E, Frieder O, Goharian N (2015) "Enhancing web search in the medical domain via query clarification." Inf Retr J 19(1–2):149–173. Available https://doi.org/10.1007/s10791-015-9258-y

  43. Song R, Luo Z, Nie JY, Yu Y, Hon HW (2009) Identification of ambiguous queries in web search. Inf Process Manag 45(2):216–229

    Article  Google Scholar 

  44. Szabó G, Fáth G (2007) "Evolutionary games on graphs." Phys Rep 446(4–6):97–216. Available https://doi.org/10.1016/j.physrep.2007.04.004

  45. Taylor P, Jonker LB (1978) Evolutionary stable strategies and game dynamics. Math Biosci 40(1):145–156

    Article  MathSciNet  Google Scholar 

  46. Tripodi R, Pelillo M (2017) "A Game-Theoretic Approach to Word Sense Disambiguation." Comput Linguist 43(1):31–70. Available https://doi.org/10.1162/coli_a_00274

  47. Vechtomova O (2009) Query Expansion for Information Retrieval. In: LIU L., ÖZSU M.T. (eds) Encyclopedia of Database Systems. Springer, Boston, MA

  48. Voorhees EM (1994) Query expansion using lexical-semantic relations. In SIGIR’94 (pp. 61–69). Springer, London

  49. Wasim M, Asim MN, Ghani MU et al (2019) Lexical paraphrasing and pseudo relevance feedback for biomedical document retrieval. Multimed Tools Appl 78:29681–29712

    Article  Google Scholar 

  50. Wu Z, Palmer M (1994) Verbs semantics and lexical selection. In the 32nd annual meeting on Association for Computational Linguistics (ACL ’94). Assoc Comput Linguist 133–138

  51. Yuanhua L, Zhai C (2010) Positional relevance model for pseudo-relevance feedback. Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

  52. Zhai CX (2015) "Towards a game-theoretic framework for information retrieval." Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval

  53. Zhao X, Ding G (2017) Query expansion for object retrieval with active learning using BoW and CNN feature. Multimed Tools Appl 76:12133–12147. https://doi.org/10.1007/s11042-016-4142-3

  54. Zhong Z, Ng HT (2012) Word sense disambiguation improves information retrieval. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1 (pp. 273–282)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, NCT of Delhi, Delhi Technological University, New Delhi, India

    Minni Jain & Ashima Suvarna

  2. Department of Computer Science and Engineering, Netaji Subhas University of Technology, East Campus, New Delhi, India

    Amita Jain

Authors
  1. Minni Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashima Suvarna
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amita Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amita Jain.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jain, M., Suvarna, A. & Jain, A. An evolutionary game theory based approach for query expansion. Multimed Tools Appl 81, 1971–1995 (2022). https://doi.org/10.1007/s11042-021-11297-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11297-x

Keywords

Search

Navigation