Skip to main content
SpringerLink
Log in

Usability inspection of digital libraries: a case study

  • Regular contribution
  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

This paper reports a case study about lessons learned and usability issues encountered in a usability inspection of a digital library system called the Networked Computer Science Technical Reference Library (NCSTRL). Using a co-discovery technique with a team of three expert usability inspectors (the authors), we performed a usability inspection driven by a broad set of anticipated user tasks. We found many good design features in NCSTRL, but the primary result of a usability inspection is a list of usability problems as candidates for fixing. The resulting problems are organized by usability problem type and by system functionality, with emphasis on the details of problems specific to digital library functions. The resulting usability problem list was used to illustrate a cost/importance analysis technique that trades off importance to fix against cost to fix. The problems are sorted by the ratio of importance to cost, producing a priority ranking for resolution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Andre T, Hartson HR, Belz S, McCreary F (2001) The user action framework: a reliable foundation for usability engineering support tools. Int J Hum–Comput Stud 54(1):107–136

    Google Scholar 

  2. Bergmark D (2002) Models and tools for generating digital libraries: collection synthesis. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 253–262

  3. Chen S-S, Choo C-Y (2002) A DL server with OAI capabilities: LOVE. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, p 388 (poster)

  4. Davis JR, Lagoze C (2000) NCSTRL: design and deployment of a globally distributed digital library. J Am Soc Inf Sci 51(3):273–280

    Google Scholar 

  5. Dillon A (2002) Technologies of information: HCI and the digital library. In: Carroll J (ed) Human–computer interaction in the new millennium. ACM Press/Addison-Wesley, New York, pp 457–474

  6. Dorward J, Reinke D, Recker M (2002) Preserving, securing, and assessing digital libraries: an evaluation model for a digital library services tool. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 322–323

  7. France RA (2001) Personal communication

  8. Futrelle J, Chen S-S, Chang KC (2001) A CIS framework for NSDL. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 124–125

  9. Geisler G, Giersch S, McArthur D, McClelland M (2002) Creating virtual collections in digital libraries: benefits and implementation issues. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 210–218

  10. Glover EJ, Lawrence S, Gordon MD, Birmingham WP, Giles CL (2001) Web search – your way. Commun ACM 44(12):97–102

    Google Scholar 

  11. Gupta A, Ludsher B, Moore RW (2002) Ontology services for curriculum development in NSDL. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 219–220

  12. Hackman GS, Biers DW (1992) Team usability testing: are two heads better than one? In: Proceedings of the Human Factors Society 36th annual meeting. Human Factors and Ergonomics Society, Atlanta, GA, pp 1205–1209

  13. Hartson HR (2003) Cognitive, physical, sensory, and functional affordances in interaction design. Accepted for publication in Behav Inf Technol 22(5):315–338

    Google Scholar 

  14. Hartson HR, Castillo JC (1998) Remote evaluation for post-deployment usability improvement. In: Proceedings of AVI’98 (advanced visual interfaces). ACM, L’Aquila, Italy, pp 22–29

  15. Hartson HR, Hix D (2003) Developing user interfaces – ensuring usability through product and process: short course in the usability engineering process. Unpublished Tutorial Notes

  16. Hartson HR, Shivakumar P (2002) Usability inspection report of NCSTRL (TR-02-08). Virginia Tech, Blacksburg, VA

  17. Hix D, Hartson HR (1993) Developing user interfaces: ensuring usability through product & process. Wiley, New York

  18. Janee G, Frew J (2002) Digital libraries for spatial data: the ADEPT digital library architecture. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 342–350

  19. Klaus C, Andrew K (2001) An atmospheric visualization collection for the NSDL. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, p 463

  20. Lagoze C, Van de Sompel H (2001) The Open Archives Initiative: building a low-barrier interoperability framework. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 54–62

  21. Lagoze C, Hoehn W, Millman D, Arms W, Gan S, Hillmann D, Ingram C, Krafft D, Marisa R, Phipps J, Saylor J, Terizzi C, Allan J, Guzman-Lara S, Kalt T (2002) Core services in the architecture of the national digital library for science education (NSDL). In: Proceedings of the second ACM/IEEE–CS joint conference on Digital libraries, Portland, Oregon, USA, pp 201–209

  22. Lagoze C, Terizzi C, Hoehn W, Millman D, Allan J, Guzman-Lara S, Kalt T, Arms W, Gan S, Hillman D, Ingram C, Krafft D, Marisa R, Phipps J, Saylor J (2002) Core services in the architecture of the National Science Digital Library (NSDL). In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, pp 201–209

  23. Laleuf JR, Spalter AM (2001) A component repository for learning objects: a progress report. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 33–40

  24. Landauer TK (1995) The trouble with computers: usefulness, usability, and productivity. MIT Press, Cambridge, MA

  25. Laurel B, Oren T, Don A (1990) Issues in multimedia interface design: media integration and interface agents. In: Proceedings of the CHI conference on human factors in computing systems. ACM Press, New York, pp 133–139

  26. Mayhew DJ (1999) The usability engineering lifecycle. Morgan Kaufmann, San Francisco

  27. Nanard M, Nanard J (2001) Cumulating and sharing end users’ knowledge to improve video indexing in a video digital library. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 282–289

  28. Nielsen J (1993) Usability engineering. Academic, Boston, MA

  29. Nielsen J, Mack RL (eds) (1994) Usability inspection methods. Wiley, New York

  30. Pomerantz J, Lankes RD (2002) Integrating expertise into the NSDL: putting a human face on the digital library. In: Proceedings of the second ACM/IEEE–CS joint conference on digital libraries (JCDL ’02). ACM Press, New York, p 405

  31. Powell AL, French JC (2000) Growth and server availability of the NCSTRL digital library. In: Proceedings of the fifth ACM conference on digital libraries. ACM Press, New York, pp 264–265

  32. Theng YL (1999) Lostness and digital libraries. In: Proceedings of the fourth ACM conference on digital libraries. ACM Press, New York, pp 250–251

  33. Van House NA (1995) User needs assessment and evaluation for the UC Berkeley electronic environmental library project. In: Proceedings of Digital Libraries ’95: the second international conference on the theory and practice of digital libraries, pp 71–76. URL: http://www.csdl.tamu.edu/DL95/papers/vanhouse/vanhouse.html

  34. Van House NA, Butler MH, Ogle V, Schiff L (1996) User-centered iterative design for digital libraries. D-lib Magazine. Retrieved 17 January 2003 from the World Wide Web: http://www.dlib.org/dlib/february96/02vanhouse.html

  35. Yaron D, Milton DJ, Freeland R (2001) Linked active content: a service for digital libraries for education. In: Proceedings of the first ACM/IEEE–CS joint conference on digital libraries (JCDL ’01). ACM Press, New York, pp 25–32

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science – 0106, Virginia Tech, Blacksburg, VA, 24061, USA

    H. Rex Hartson, Priya Shivakumar & Manuel A. Pérez-Quiñones

Authors
  1. H. Rex Hartson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Priya Shivakumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manuel A. Pérez-Quiñones
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to H. Rex Hartson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hartson, H., Shivakumar, P. & Pérez-Quiñones, M. Usability inspection of digital libraries: a case study. Int J Digit Libr 4, 108–123 (2004). https://doi.org/10.1007/s00799-003-0074-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-003-0074-4

Keywords

Search

Navigation