Abstract
Query Expansion could bring very significant improvement of baseline results of Information Retrieval process. This has been known for many years, but very detailed results on annotated sets provide richer insight on the preferred added word space. In this work we introduce novel expanded term adequacy measures related to term frequency and inverse document frequency in relevant and non-relevant groups of documents. Term evaluation scores are derived using two term characteristics: inverse term representativeness and term usability. We generate the Optimal Queries based on the documents contents and the Qrels files of data used in the Text Retrieval Conference 2016 – Clinical Decision Support track (TREC-CDS 2016). The improvement can be up to a factor of 2 depending on the evaluation measure. Potentially, the method can be improved by increasing the learning set and applied to retrieval of documents in biomedical contests.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Roberts, K., Gururaj, A.E., Chen, X., Pournejati, S., Hersh, W.R., Demner-Fushman, D., Ohno-Machado, L., Cohen, T., Xu, H.: Information retrieval for biomedical datasets the 2016 bioCADDIE dataset retrieval challenge. Database 2017, bax068 (2017)
Wei, W., Ji, Z., He, Y., Zhang, K., Ha, Y., Li, Q., Ohno-Machado, L.: Finding relevant biomedical datasets: the UC San Diego solution for the bioCADDIE retrieval challenge. Database 2018, bay017 (2018)
Bouadjenek, M.R., Verspoor, K.: Multi-field query expansion is effective for biomedical dataset retrieval. Database 2017, bax062 (2017)
Roberts, K., Demner-Fushman, D., Voorhees, E.M., Hersh, W.R.: Overview of the TREC clinical decision support track. In: TREC 2016 (2016). https://trec.nist.gov/pubs/trec25/papers/Overview-CL.pdf. Accessed 2 May 2018
Croft, W.B., Metzler, D., Strohman, T.: Search Engines - Information Retrieval in Practice. Pearson Education, pp. I–XXV, 1–524 (2009). ISBN 978-0-13-136489-9
Petersen, C., Simonsen, J.G., Järvelin, K., Lioma, C.: Adaptive distributional extensions to DFR ranking. In: CIKM 2016, pp. 2005–2008 (2016)
Amati, G., van Rijsbergen, C.J.: Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM Trans. Inf. Syst. 20(4), 357–389 (2002)
Claveau, V.: Indiscriminateness in representation spaces of terms and documents. In: ECIR 2018, pp. 251–262 (2018)
Cho, J., Lee, K., Shin, E., Choy, G., Do, S.: How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? arXiv:1511.06348.pdf (2016)
Figueroa, R.L., Zeng-Treitler, Q., Kandula, S., Ngo, L.H.: Predicting sample size required for classification performance. BMC Med. Inf. Decis. Mak. 12, 8 (2012)
Acknowledgments
We acknowledge the Poznan University of Technology grant (04/45/DSPB/0185).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Dutkiewicz, J., Jędrzejek, C. (2019). Calculating Optimal Queries from the Query Relevance File. In: Choroś, K., Kopel, M., Kukla, E., Siemiński, A. (eds) Multimedia and Network Information Systems. MISSI 2018. Advances in Intelligent Systems and Computing, vol 833. Springer, Cham. https://doi.org/10.1007/978-3-319-98678-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-98678-4_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-98677-7
Online ISBN: 978-3-319-98678-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)