Abstract
It has been postulated that a method of selecting terms in either routing or filtering using relevance feedback would be to evaluate every possible combination of terms in a training set and determine which combination yields the best retrieval results. Whilst this is not a realistic proposition because of the enormous size of the search space, some heuristics have been developed on the Okapi system to tackle the problem which are computationally intensive. This paper describes parallel computing techniques that have been applied to these heuristics to reduce the time it takes to select to select terms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
S.E. Robertson, S. Walker, S. Jones, M.M. Hancock-Beaulieu and M. Gatford, Okapi at TREC-3. In: D.K. Harman, (ed.): Proceedings of the Third Text Retrieval Conference, NIST Gaithersburg (1995) 109–126
S.E. Robertson, S. Walker, S. Jones, M.M. Beaulieu M. Gatford and A. Payne, Okapi at TREC-4. In: D.K. Harman, (ed.): Proceedings of the Fourth Text Retrieval Conference, NIST Gaithersburg (1996) 73–96
M.M. Beaulieu, M. Gatford, X. Huang, S.E. Robertson, S. Walker and P. Williams, Okapi at TREC-5. In: Voorhees E.M and D.K. Harman, (eds.): Proceedings of the Fifth Text Retrieval Conference, NIST Gaithersburg (1997) 143–166.
S. Walker, S.E. Robertson and M Boughanem, OKAPI at TREC-6. In: Voorhees E.M and D.K. Harman, (eds.): Proceedings of the Sixth Text Retrieval Conference, NIST Gaithersburg (1998) 125–136
Tuson, Optimisation with Hillclimbing on Steriods: An Overview of Neightbourhood Search Techniques. Proceedings of the 10th Young Operational research Conference, Operational Research Society (1998) 141–156
F. Glover and M. Laguna, Tabu Search, Kluwer Academic Publishers, 1997
D. Harman, Overview of the Fourth Text REtrieval Conference (TREC-4). In: D.K. Harman, (ed.): Proceedings of the Fourth Text Retrieval Conference, NIST Gaithersburg (1996) 1–24
D. Hawking, “The Design and Implementation of a Parallel Document Retrieval Engine”, Technical Report TR-CS-95-08, Department of Computer Science, Australian National University (1995)
Hutchinson, Algorithm Learning, Clarendon Press (1994)
J. Kittler, Feature selection and extraction. In: T.Y. Young and K. Fu, (ed.): Handbook of Pattern Recognition and Image Processing, Academic Press (1986) 59–83
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
MacFarlane, A., Robertson, S.E., McCann, J.A. (2003). Parallel Computing for Term Selection in Routing/Filtering. In: Sebastiani, F. (eds) Advances in Information Retrieval. ECIR 2003. Lecture Notes in Computer Science, vol 2633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36618-0_40
Download citation
DOI: https://doi.org/10.1007/3-540-36618-0_40
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-01274-0
Online ISBN: 978-3-540-36618-8
eBook Packages: Springer Book Archive