Abstract
This paper reports the final results of our experiments involving the 2009 INEX Ad-Hoc Track and describes the methodology upon which our current, 2010 experiments are built. In 2009, our INEX investigations centered on indentifying a methodology for producing what we have referred to as improved focused elements—i.e., elements which when evaluated are competitive with others in the upper ranges of the official rankings. Our 2009 INEX paper [5] describes our approach to producing such elements, which is based on the combination of traditional document retrieval (to identify the document set of interest to the query) with our method of dynamic element retrieval (to generate and retrieve the elements of the document(s) so identified) and the subsequent application of a specific focusing technique for the Focused and Relevant-in-Context tasks (to select the focused elements). The system is based on the Vector Space Model [10]; basic functions are performed using the Smart experimental retrieval system [9]. In this paper, we report the final results of these experiments, applied to the INEX 2009 Thorough, Focused and Relevant-in-Context tasks. Results show that this approach produces highly ranked results for all three of these Ad Hoc tasks. Significance tests, applied to these results as compared to the top-ranked runs, show in which cases statistically significant results are obtained. Our 2010 work is ongoing at present.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bapat, S.: Improving the results for focused and relevant-in-context tasks. M.S. Thesis, Department of Computer Science, University of Minnesota Duluth (2008), http://www.d.umn.edu/cs/thesis/bapat.pdf
Cherukuri, R.: Significance testing for the INEX 2008-2009 Ad Hoc Tracks. M.S. Thesis, Department of Computer Science, University of Minnesota Duluth (2010), http://www.d.umn.edu/cs/thesis/cherukuri.pdf
Crouch, C.: Dynamic element retrieval in a structured environment. ACM TOIS 24(4), 437–454 (2006)
Crouch, C.J., Crouch, D.B., Bapat, S., Mehta, S., Paranjape, D.: Finding Good Elements for Focused Retrieval. In: Geva, S., Kamps, J., Trotman, A. (eds.) INEX 2008. LNCS, vol. 5631, pp. 33–38. Springer, Heidelberg (2009)
Crouch, C.J., Crouch, D.B., Bhirud, D., Poluri, P., Polumetla, C., Sudhakar, V.: A Methodology for Producing Improved Focused Elements. In: Geva, S., Kamps, J., Trotman, A. (eds.) INEX 2009. LNCS, vol. 6203, pp. 70–80. Springer, Heidelberg (2010)
Kamps, J., Geva, S., Trotman, A.: Analysis of the INEX 2009 Ad Hoc Track Results. In: Geva, S., Kamps, J., Trotman, A. (eds.) INEX 2009. LNCS, vol. 6203, pp. 26–48. Springer, Heidelberg (2010)
Khanna, S.: Design and implementation of a flexible retrieval system. M.S. The-sis, Department of Computer Science, University of Minnesota Duluth (2005), http://www.d.umn.edu/cs/thesis/khanna.pdf
Mahule, A.: Improving results of the INEX Thorough Task. M.S. Thesis, Department of Computer Science, University of Minnesota Duluth (2010), http://www.d.umn.edu/cs/thesis/mahule.pdf
Salton, G. (ed.): The Smart Retrieval System—Experiments in Automatic Document Processing. Prentice-Hall, Englewood Cliffs (1971)
Salton, G., Wong, A., Yang, C.: A vector space model for automatic indexing. Comm. ACM 18(11), 613–620 (1975)
Singhal, A., Buckley, C., Mitra, M.: Pivoted document length normalization. In: Proc. Of the 19th Annual International ACM SIGIR Conference, pp. 21–29 (1996)
Vadlamudi, S.: Producing improved results for the INEX Focused and Relevant-in-Context Tasks. M.S. Thesis, Department of Computer Science, University of Minnesota Duluth (2009), http://www.d.umn.edu/cs/thesis/vadlamudi.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Crouch, C.J., Crouch, D.B., Vadlamudi, S., Cherukuri, R., Mahule, A. (2011). A Useful Method for Producing Competitive Ad Hoc Task Results. In: Geva, S., Kamps, J., Schenkel, R., Trotman, A. (eds) Comparative Evaluation of Focused Retrieval. INEX 2010. Lecture Notes in Computer Science, vol 6932. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23577-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-23577-1_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23576-4
Online ISBN: 978-3-642-23577-1
eBook Packages: Computer ScienceComputer Science (R0)