Abstract
Query term expansion is an important technique for achieving higher retrieval performance. However, since many factors affects the quality of this technique, it is difficult to evaluate this technique in isolation. Feature quantities that characterize the quality of the initial query are defined in this study for evaluating topic difficulties from the viewpoint of query term expansion. I also briefly review the result of the NTCIR-5 query term expansion subtask that uses these quantities for evaluating the effectiveness of the query term expansion techniques. I also describe detailed analysis results on the effect of query term expansion based on topic-by-topic analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baeza-Yates, R., Ribeiro-Neto, B.: 5 Query Operations. In: Modern Information Retrieval, pp. 19–71. Addison-Wesley, Reading (1999)
Cronen-Townsend, S., Zhou, Y., Croft, W.B.: Predicting query performance. In: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 299–306 (2002)
Harman, D., Buckley, C.: SIGIR 2004 workshop: RIA and where can IR go from here? SIGIR Forum 38, 45–49 (2004)
Buckley, C.: Why current IR engines fail. In: SIGIR 2004: Proceedings of the 27th annual international conference on Research and development in information retrieval, pp. 584–585. ACM Press, New York (2004)
Warren, R.H., Liu, T.: A review of relevance feedback experiments at the 2003 Reliable Information Access (RIA) workshop. In: SIGIR 2004: Proceedings of the 27th annual international conference on Research and development in information retrieval, pp. 570–571. ACM Press, New York (2004)
Yoshioka, M.: Overview of the NTCIR-5 web query term expansion subtask. In: Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 443–454 (2005), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/data/WEB/NTCIR5-OV-WEB-YoshiokaM.pdf
Buckley, C., Harman, D.: Reliable information access final workshop report. Technical report, Northeast Regional Research Center, MITRE Data/RIA 2003/ria final.pdf (2004), http://nrrc.mitre.org/NRRC/Docs
Voorhees, E.: Query expansion using lexical-semantic relations. In: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 61–69 (1994)
Yoshioka, M., Haraguchi, M.: On a combination of probabilistic and Boolean IR models for WWW document retrieval. ACM Transactions on Asian Language Information Processing (TALIP) 4, 340–356 (2005)
Yoshioka, M., Haraguchi, M.: An appropriate Boolean query reformulation interface for information retrieval based on adaptive generalization. In: International Workshop on Challenges in Web Information Retrieval and Integration, pp. 145–150 (2005)
Eguchi, K., Oyama, K., Aizawa, A., Ishikawa, H.: Overview of the informational retrieval task at NTCIR-4 web. In: Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies Information Retrieval, Question Answering and Summarization (2004), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings4/WEB/NTCIR4-OV-WEB-A-EguchiK.pdf
Tanioka, H., Yamamoto, K., Nakagawa, T.: A distributed retrieval system for NTCIR-5 web task. In: Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 472–480 (2005), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/data/WEB/NTCIR5-WEB-TaniokaH.pdf
Toda, H., Kataoka, R.: Search result clustering method at NTCIR-5 web query expansion subtask. In: Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 481–485 (2005), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/data/WEB/NTCIR5-WEB-TodaH.pdf
Masada, T., Kanazawa, T., Takasu, A., Adachi, J.: Improving web search by query expansion with a small number of terms. In: Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 486–493 (2005), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/data/WEB/NTCIR5-WEB-MasadaT.pdf
Eguchi, K.: NTCIR-5 query expansion experiments using term dependence models. In: Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 494–501 (2005), http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/data/WEB/NTCIR5-WEB-EguchiK.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yoshioka, M. (2006). Evaluating Topic Difficulties from the Viewpoint of Query Term Expansion. In: Ng, H.T., Leong, MK., Kan, MY., Ji, D. (eds) Information Retrieval Technology. AIRS 2006. Lecture Notes in Computer Science, vol 4182. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11880592_30
Download citation
DOI: https://doi.org/10.1007/11880592_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45780-0
Online ISBN: 978-3-540-46237-8
eBook Packages: Computer ScienceComputer Science (R0)