Skip to main content
SpringerLink
Log in
Book cover

Research Conference on Metadata and Semantic Research

MTSR 2010: Metadata and Semantic Research pp 312–319Cite as

Towards Quality Measures for Evaluating Thesauri

  • Conference paper

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 108))

Abstract

Thesaurus evaluation has often focused on the task of retrieval or analyzed the information environment including factors such as the user, the user interface. Rarely ever has the quality of a thesaurus as an artefact itself been focus of attention. In particular, there are no measures, which provide a holistic description of its intrinsic characteristics as an artefact. This paper suggests a range of abstract measurement constructs based on quality notions in thesaurus literature and inference from other related literature. The suggested measurement constructs allow representing a thesaurus in evaluation approaches, which thereby becomes empirically testable.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nielsen, M.L.: A framework for work task based thesaurus design. Journal of Documentation 57, 774–797 (2001)

    Article  Google Scholar 

  2. Shiri, A., Revie, C.: Query expansion behavior within a thesaurus-enhanced search environment: A user-centered evaluation. Journal of the American Society for Information Science and Technology 57, 462–478 (2006)

    Article  Google Scholar 

  3. Blocks, D., Binding, C., Cunliffe, D., Tudhope, D.: Qualitative Evaluation of Thesaurus-Based Retrieval. In: Research and Advanced Technology for Digital Libraries, pp. 75–107 (2002)

    Google Scholar 

  4. Pizzato, L., de Lima, V.: Evaluation of a Thesaurus-Based Query Expansion Technique. In: Computational Processing of the Portuguese Language, p. 196 (2003)

    Google Scholar 

  5. BS 8723-2: Thesauri. BS 8723: Structured vocabularies for information retrieval. Guide. British Standards Institution (BSI), Committee IDT/2/2 (2005).

    Google Scholar 

  6. BS 8723-1: Definitions, symbols and abbreviations. BS 8723: Structured vocabularies for information retrieval. Guide. British Standards Institution (BSI), Committee IDT/2/2 (2005).

    Google Scholar 

  7. Broughton, V., Hansson, J., Hjørland, B., López-Huertas, M.J.: Knowledge Organization. In: European Curriculum Reflections on Library and Information Science Education, pp. 133–148. The Royal School of Library and Information Science (2005)

    Google Scholar 

  8. Hodge, G.: Systems of Knowledge Organization for Digital Libraries: Beyond Traditional Authority Files. The Digital Library Federation. Council on Library and Information Resources, Washington (2009)

    Google Scholar 

  9. Giunchiglia, F., Zaihrayeu, I.: Lightweight Ontologies. In: Encyclopedia of Database Systems. Springer, Heidelberg (2009)

    Google Scholar 

  10. Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: Modelling Ontology Evaluation and Validation. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 140–154. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  11. Gangemi, A., Catenacci, C., Ciaramita, C., Lehmann, J.: Ontology evaluation and validation (2005)

    Google Scholar 

  12. Yao, H., Orme, A.M., Etzkorn, L.: Cohesion metrics for ontology design and application. Journal of Computer Science 1, 107–113 (2005)

    Article  Google Scholar 

  13. Park, J.: Metadata Quality in Digital Repositories: A Survey of the Current State of the Art. Cataloging & Classification Quarterly 47, 213–228 (2009)

    Article  Google Scholar 

  14. Stvilia, B., Gasser, L., Twidale, M.B., Smith, L.C.: A framework for information quality assessment. Journal of the American Society for Information Science and Technology 58, 1720–1733 (2007)

    Article  Google Scholar 

  15. Moen, W.E., Stewart, E.L., McClure, C.R.: The Role of Content Analysis in Evaluating Metadata for the U.S. Government Information Locator Service (GILS). IEEE, Los Alamitos (1997)

    Google Scholar 

  16. Bruce, T.R., Hillmann, D.I.: The Continuum of Metadata Quality: Defining, Expressing, Exploiting. In: Hillmann, D., Westbrooks, E. (eds.) Metadata in Practice, pp. 238–256. American Library Association Editions, Chicago (2004)

    Google Scholar 

  17. Soergel, D.: Indexing and retrieval performance: The logical evidence. Journal of the American Society for Information Science 45, 589–599 (1994)

    Article  Google Scholar 

  18. BS 8723 Data model: BS 8723 Data model, http://schemas.bs8723.org/Model.aspx

  19. ANSI/NISO Z39.19: Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies (2005)

    Google Scholar 

  20. Aitchison, J., Bawden, D., Gilchrist, A.: Thesaurus Construction and Use: A Practical Manual. Fitzroy Dearborn Publishers (2000)

    Google Scholar 

  21. Blocks, D., Cunliffe, D., Tudhope, D.: A reference model for user-system interaction in thesaurus-based searching. Journal of the American Society for Information Science and Technology 57, 1655–1665 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Melbourne, 111 Barry St, VIC, 3010, Australia

    Daniel Kless & Simon Milton

Authors
  1. Daniel Kless
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simon Milton
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Universidad de Alcalá, Edificio Polité cnico, despacho O-246, Ctra. Meco s/n, 28871, Alcalá de Henares, Spain

    Salvador Sánchez-Alonso

  2. IDSIA/USI-SUPSI, Galleria 2, 6928, Manno, Lugano, Switzerland

    Ioannis N. Athanasiadis

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kless, D., Milton, S. (2010). Towards Quality Measures for Evaluating Thesauri. In: Sánchez-Alonso, S., Athanasiadis, I.N. (eds) Metadata and Semantic Research. MTSR 2010. Communications in Computer and Information Science, vol 108. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16552-8_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16552-8_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16551-1

  • Online ISBN: 978-3-642-16552-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation