Skip to main content

Contexts of Relevance for Information Retrieval System Design

  • Conference paper
Context: Nature, Impact, and Role (CoLIS 2005)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3507))

Abstract

Users judge relevance in various dimensions, but systems traditionally only support matching of queries to documents or document representations on an algorithmic or topical level. We argue that systems should support users in order for them to make relevance judgements on the level of cognitive relevance, situational relevance, and socio-cognitive relevance as well. Current studies in the field of Information Retrieval and Seeking are discussed from a relevance point of view, in order to show how systems might be adapted to assist users in making multi-dimensional relevance judgements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cosijn, E.: Relevance Judgements in Information Retrieval. Unpublished DPhil Thesis. University of Pretoria, South Africa (2003)

    Google Scholar 

  2. Cosijn, E., Ingwersen, P.: Dimensions of Relevance. Information Processing and Management 6(4), 533–550 (2000)

    Article  Google Scholar 

  3. Ingwersen, P.: Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory. Journal of Documentation 52(1), 3–50 (1996)

    Article  Google Scholar 

  4. Cosijn, E.: A methodology for testing dimensions of relevance. In: Bothma, T., Kaniki, A. (eds.) Progress in Library and Information Science in Southern Africa. Proceedings of the third biennial DISSAnet Conference (ProLISSA3), Pretoria, Infuse, pp. 279–299 (2004), Available http://www.dissanet.com

  5. Tomaiuolo, N.G., Packer, J.: Keyword and natural language searching, 57-60. Online, November/December (1998)

    Google Scholar 

  6. Sanderson, M.: Retrieving with good sense. Information Retrieval 2, 47–67 (2000)

    Article  Google Scholar 

  7. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness. In: Croft, B.C., et al. (eds.) Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 315–323. ACM Press, New York (1998)

    Chapter  Google Scholar 

  8. Lee, J.H.: Combining the evidence of different relevance feedback methods for information retrieval. Information Processing and Management 34(6), 681–691 (1998)

    Article  Google Scholar 

  9. Lam-Adesina, A.M., Jones, G.J.F.: Applying summarization techniques for term selection in relevance feedback. In: Croft, W.B., et al. (eds.) Proceedings of the 24th Annual International ACM SIGIR conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA, pp. 1–9. ACM Press, New York (2001)

    Chapter  Google Scholar 

  10. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness. Information Processing and Management 36, 697–716 (2000)

    Article  Google Scholar 

  11. Voorhees, E.M.: Evaluation by highly relevant documents. In: Croft, W.B., et al. (eds.) Proceedings of the 24th Annual International ACM SIGIR conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA, pp. 74–82. ACM Press, New York (2001)

    Chapter  Google Scholar 

  12. Järvelin, K., Kekäläinen, J.: IR evaluation methods for retrieving highly relevant documents. In: Belkin, N.J., et al. (eds.) Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 41–48. ACM Press, New York (2000)

    Chapter  Google Scholar 

  13. Kekäläinen, J., Järvelin, K.: Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology 53(13), 1120–1129 (2002)

    Article  Google Scholar 

  14. Ford, N.: Information retrieval and creativity: towards support for the original thinker. Journal of Documentation 55(5), 528–542 (1999)

    Article  Google Scholar 

  15. Welty, C., Guarino, N.: Supporting ontological analysis of taxonomic relationships. Institute for systems science and biomedical engineering of the Italian Research Council (CNR), March 13 (2003) (online), Available http://www.labseb.pd.cnr.it/infor/ontology/papers/DKE-2001.pdf

  16. Pepper, S.: The TAO of topic maps: finding the way in the age of infoglut, March 13 (2003) (online), Available http://www.gca.org/papers/xmleurope2000/papers/s11-01.html

  17. Park, H.: Inferential representations of science documents. Information Processing and Management 32(4), 419–429 (1996)

    Article  Google Scholar 

  18. Choi, Y., Rasmussen, E.: User’s relevance criteria in image retrieval in American history. Information Processing and Management 38, 695–726 (2001)

    Article  Google Scholar 

  19. Toms, E.: Information exploration of the third kind: the concept of chance encounters. In: A position paper for the CHI 1998 Workshop on Information exploration, November 21 (2002) (online), Available http://www.fxpal.com/ConferencesWorkshops/CHI98IE/submissions/long/toms/Default.htm

  20. Toms, E.: Serendipitous information retrieval, November 21 (2002) (online), Available http://www.ercim.org/publication/ws-proceedings/DelNoe01/3-Toms.pdf

  21. Figueiredo, A.D.: The serendipity equations. In: Webber, R., Gresse, C. (eds.) Proceedings of the Workshop Program at the 4th International Conference on Case-based Reasoning, ICCBR 2001, Navy Centre for Applied Research in Artificial Intelligence. Naval Research Laboratory, Washington, November 21 (2002) Technical Note AIC-01-003 (online), Available http://www.aic.nrl.navy.mil/papers/2001/AIC-01-003/ws4/ws4toc2.pdf

  22. Fine, G., Deegan, J.: Three principles of serendip: insight, chance and discovery in qualitative research, November 21 (2002) (online), Available http://www.ul.ie/~philos/vol2/Deegan.html

  23. Spink, A., Greisdorf, H.: User’s partial relevance judgements during online searching. Online and CDROM Review 21(5), 271–280 (1997)

    Article  Google Scholar 

  24. Bowman, C.M., Danzig, P.B., Manber, U., Schwartz, F.: Scalable internet resources discovery: research problems and approaches. Communications of the ACM 37(8), 98–107 (1994)

    Article  Google Scholar 

  25. Quiroga, L.M., Mostafa, J.: An experiment in building profiles in information filtering: the role of context of user relevance feedback. Information Processing and Management 38(5), 671–694 (2001)

    Article  Google Scholar 

  26. Borlund, P.: Evaluation of interactive information retrieval systems. Doctoral dissertation. Ã…bo Akademi University Press, Ã…bo (2000)

    MATH  Google Scholar 

  27. Savage-Knepshield, P.A., Belkin, N.: Information retrieval interaction: trends over time. ournal of the American Society for Information Science 50(12), 1067–1082 (1999)

    Google Scholar 

  28. Hakala, J.: Internet metadata and library cataloguing, November 21 (2004) (online), Available http://www.lnb.lt/events/ifla/hakala.html

  29. Cosijn, E., Pirkola, A., Bothma, T., Järvelin, K.: Information access in indigenous languages. In: Bruce, H., et al. (eds.) Emerging frameworks and methods. Proceedings of the Fourth International Conference on Conceptions of Library and Information Science, pp. 221–238. Libraries Unlimited, Colorado (2002)

    Google Scholar 

  30. Yuang, W., Meadow, C.T.: A study of the use of variables in information retrieval user studies. Journal of the American Society for Information Science 50(2), 140–150 (1999)

    Article  Google Scholar 

  31. Ingwersen, P.: Cognitive information retrieval. In: Williams, M.E. (ed.) Annual Review of Information Science and Technology (ARIST), vol. 34, pp. 3–52. Learned Information, Inc., Medford (1999)

    Google Scholar 

  32. Hjørland, B.: Brief communication: Towards a theory of aboutness, topicality, theme, domain, field, content and relevance. Journal of the American Society for Information Science 52(9), 774–778 (2001)

    Article  Google Scholar 

  33. Froelich, T.J.: Relevance reconsidered – towards an agenda for the 21st century: Introduction to special topic issue on relevance research. Journal of the American Society for Information Science 45, 124–133 (1994)

    Article  Google Scholar 

  34. Saracevic, T.: Relevance reconsidered 1996. In: Ingwersen, P., Pors, N.O. (eds.) Information Science: Integration in Perspective, pp. 201–218. Royal School of Library and Information Science, Copenhagen (1996)

    Google Scholar 

  35. Saracevic, T.: Information science. Journal of the American Society for Information Science 50(12), 1051–1063 (1999)

    Article  Google Scholar 

  36. Schamber, L., Eisenberg, M.B., Nilan, M.S.: A re-examination of relevance: Toward a dynamic, situational definition. Information Processing and Management 26(6), 755–776 (1990)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cosijn, E., Bothma, T. (2005). Contexts of Relevance for Information Retrieval System Design. In: Crestani, F., Ruthven, I. (eds) Context: Nature, Impact, and Role. CoLIS 2005. Lecture Notes in Computer Science, vol 3507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11495222_6

Download citation

  • DOI: https://doi.org/10.1007/11495222_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-26178-0

  • Online ISBN: 978-3-540-32101-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics