Abstract
Users judge relevance in various dimensions, but systems traditionally only support matching of queries to documents or document representations on an algorithmic or topical level. We argue that systems should support users in order for them to make relevance judgements on the level of cognitive relevance, situational relevance, and socio-cognitive relevance as well. Current studies in the field of Information Retrieval and Seeking are discussed from a relevance point of view, in order to show how systems might be adapted to assist users in making multi-dimensional relevance judgements.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cosijn, E.: Relevance Judgements in Information Retrieval. Unpublished DPhil Thesis. University of Pretoria, South Africa (2003)
Cosijn, E., Ingwersen, P.: Dimensions of Relevance. Information Processing and Management 6(4), 533–550 (2000)
Ingwersen, P.: Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory. Journal of Documentation 52(1), 3–50 (1996)
Cosijn, E.: A methodology for testing dimensions of relevance. In: Bothma, T., Kaniki, A. (eds.) Progress in Library and Information Science in Southern Africa. Proceedings of the third biennial DISSAnet Conference (ProLISSA3), Pretoria, Infuse, pp. 279–299 (2004), Available http://www.dissanet.com
Tomaiuolo, N.G., Packer, J.: Keyword and natural language searching, 57-60. Online, November/December (1998)
Sanderson, M.: Retrieving with good sense. Information Retrieval 2, 47–67 (2000)
Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness. In: Croft, B.C., et al. (eds.) Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 315–323. ACM Press, New York (1998)
Lee, J.H.: Combining the evidence of different relevance feedback methods for information retrieval. Information Processing and Management 34(6), 681–691 (1998)
Lam-Adesina, A.M., Jones, G.J.F.: Applying summarization techniques for term selection in relevance feedback. In: Croft, W.B., et al. (eds.) Proceedings of the 24th Annual International ACM SIGIR conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA, pp. 1–9. ACM Press, New York (2001)
Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness. Information Processing and Management 36, 697–716 (2000)
Voorhees, E.M.: Evaluation by highly relevant documents. In: Croft, W.B., et al. (eds.) Proceedings of the 24th Annual International ACM SIGIR conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA, pp. 74–82. ACM Press, New York (2001)
Järvelin, K., Kekäläinen, J.: IR evaluation methods for retrieving highly relevant documents. In: Belkin, N.J., et al. (eds.) Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 41–48. ACM Press, New York (2000)
Kekäläinen, J., Järvelin, K.: Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology 53(13), 1120–1129 (2002)
Ford, N.: Information retrieval and creativity: towards support for the original thinker. Journal of Documentation 55(5), 528–542 (1999)
Welty, C., Guarino, N.: Supporting ontological analysis of taxonomic relationships. Institute for systems science and biomedical engineering of the Italian Research Council (CNR), March 13 (2003) (online), Available http://www.labseb.pd.cnr.it/infor/ontology/papers/DKE-2001.pdf
Pepper, S.: The TAO of topic maps: finding the way in the age of infoglut, March 13 (2003) (online), Available http://www.gca.org/papers/xmleurope2000/papers/s11-01.html
Park, H.: Inferential representations of science documents. Information Processing and Management 32(4), 419–429 (1996)
Choi, Y., Rasmussen, E.: User’s relevance criteria in image retrieval in American history. Information Processing and Management 38, 695–726 (2001)
Toms, E.: Information exploration of the third kind: the concept of chance encounters. In: A position paper for the CHI 1998 Workshop on Information exploration, November 21 (2002) (online), Available http://www.fxpal.com/ConferencesWorkshops/CHI98IE/submissions/long/toms/Default.htm
Toms, E.: Serendipitous information retrieval, November 21 (2002) (online), Available http://www.ercim.org/publication/ws-proceedings/DelNoe01/3-Toms.pdf
Figueiredo, A.D.: The serendipity equations. In: Webber, R., Gresse, C. (eds.) Proceedings of the Workshop Program at the 4th International Conference on Case-based Reasoning, ICCBR 2001, Navy Centre for Applied Research in Artificial Intelligence. Naval Research Laboratory, Washington, November 21 (2002) Technical Note AIC-01-003 (online), Available http://www.aic.nrl.navy.mil/papers/2001/AIC-01-003/ws4/ws4toc2.pdf
Fine, G., Deegan, J.: Three principles of serendip: insight, chance and discovery in qualitative research, November 21 (2002) (online), Available http://www.ul.ie/~philos/vol2/Deegan.html
Spink, A., Greisdorf, H.: User’s partial relevance judgements during online searching. Online and CDROM Review 21(5), 271–280 (1997)
Bowman, C.M., Danzig, P.B., Manber, U., Schwartz, F.: Scalable internet resources discovery: research problems and approaches. Communications of the ACM 37(8), 98–107 (1994)
Quiroga, L.M., Mostafa, J.: An experiment in building profiles in information filtering: the role of context of user relevance feedback. Information Processing and Management 38(5), 671–694 (2001)
Borlund, P.: Evaluation of interactive information retrieval systems. Doctoral dissertation. Ã…bo Akademi University Press, Ã…bo (2000)
Savage-Knepshield, P.A., Belkin, N.: Information retrieval interaction: trends over time. ournal of the American Society for Information Science 50(12), 1067–1082 (1999)
Hakala, J.: Internet metadata and library cataloguing, November 21 (2004) (online), Available http://www.lnb.lt/events/ifla/hakala.html
Cosijn, E., Pirkola, A., Bothma, T., Järvelin, K.: Information access in indigenous languages. In: Bruce, H., et al. (eds.) Emerging frameworks and methods. Proceedings of the Fourth International Conference on Conceptions of Library and Information Science, pp. 221–238. Libraries Unlimited, Colorado (2002)
Yuang, W., Meadow, C.T.: A study of the use of variables in information retrieval user studies. Journal of the American Society for Information Science 50(2), 140–150 (1999)
Ingwersen, P.: Cognitive information retrieval. In: Williams, M.E. (ed.) Annual Review of Information Science and Technology (ARIST), vol. 34, pp. 3–52. Learned Information, Inc., Medford (1999)
Hjørland, B.: Brief communication: Towards a theory of aboutness, topicality, theme, domain, field, content and relevance. Journal of the American Society for Information Science 52(9), 774–778 (2001)
Froelich, T.J.: Relevance reconsidered – towards an agenda for the 21st century: Introduction to special topic issue on relevance research. Journal of the American Society for Information Science 45, 124–133 (1994)
Saracevic, T.: Relevance reconsidered 1996. In: Ingwersen, P., Pors, N.O. (eds.) Information Science: Integration in Perspective, pp. 201–218. Royal School of Library and Information Science, Copenhagen (1996)
Saracevic, T.: Information science. Journal of the American Society for Information Science 50(12), 1051–1063 (1999)
Schamber, L., Eisenberg, M.B., Nilan, M.S.: A re-examination of relevance: Toward a dynamic, situational definition. Information Processing and Management 26(6), 755–776 (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cosijn, E., Bothma, T. (2005). Contexts of Relevance for Information Retrieval System Design. In: Crestani, F., Ruthven, I. (eds) Context: Nature, Impact, and Role. CoLIS 2005. Lecture Notes in Computer Science, vol 3507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11495222_6
Download citation
DOI: https://doi.org/10.1007/11495222_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26178-0
Online ISBN: 978-3-540-32101-9
eBook Packages: Computer ScienceComputer Science (R0)