Skip to main content

Digital Library Evaluation by Analysis of User Retrieval Patterns

  • Conference paper
  • First Online:
Research and Advanced Technology for Digital Libraries (ECDL 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2458))

Included in the following conference series:

Abstract

We propose a methodology to evaluate the impact of a Digital Library’s (DL) collection and the characteristics of its user community by an analysis of user retrieval patterns. Patterns of journal and document co-retrievals are reconstructed from DL server logs and used to generate proximity data for journals and documents, resulting in a weighted relation defined over the DL document collection represented by a network of document and journals. A measure of discrepancy between user-defined measures of document impact and the Journal Citation Record (JCR) Impact Factor (IF) published by the Institute for Scientific Information (ISI) is used to analyze characteristics of the DL user community. A preliminary analysis of the Los Alamos National Laboratory (LANL) Research Library (RL) server logs registered in 2001 demonstrates the potential of this approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Johan Bollen. Group user models for personalized hyperlink recommendation. In LNCS 1892-International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH2000), pages 39–50, Trento, August 2000. Springer Verlag.

    Chapter  Google Scholar 

  2. Johan Bollen and Francis Heylighen. A system to restructure hypertext networks into valid user models. The New Review of Hypermedia and Multimedia, 4:189–213, 1998.

    Article  Google Scholar 

  3. Johan Bollen and Luis M. Rocha. An adaptive systems approach to the implementation and evaluation of digital library recommendation systems. In LNCS-Fourth European Conference on Research and Advanced Technology for Digital Libraries (ECDL2000), Lisbon, September 2000. Springer Verlag.

    Google Scholar 

  4. Johan Bollen, Herbert Vandesompel, and Luis M. Rocha. Mining associative relations from website logs and their application to context-dependent retrieval using spreading activation. In Proceedings of the Workshop on Organizing Webspaces (ACM-DL99), Berkeley, California, 1999. in preparation.

    Google Scholar 

  5. Christine L. Borgman and Ronald E. Rice. The convergence of information science and communication: A bibliometric analysis. Journal of the American Society for Information Science, 43(6):397–411, 1992.

    Article  Google Scholar 

  6. Philip K. Chan. Constructing web user profiles: a non-invasive learning approach. In Brij Masand and Myra Spiliopoulou, editors, Web Usage Analysis and User Profiling-tLNAI 1836, San Diego, CA, August 1999. Springer.

    Google Scholar 

  7. Peter W. Foltz. Using latent semantic indexing for information filtering. In R. B. Allen, editor, Proceedings of the Conference on Office Information Systems, pages 40–47, Cambridge, MA, 1990.

    Google Scholar 

  8. Eugene Garfield. Citation Indexing: Its Theory and Application in Science, Technology, and Humanities. John Wiley and Sons, New York, 1979.

    Google Scholar 

  9. Francis Heylighen. Mining associative meanings from the web: from word disambiguation to the global brain. In R. Timmerman and M. Lutjeharms, editors, Proceedings of the International Colloqium: Trends in Special Language and Language Technology, pages 15–44, Antwerpen, Belgium, 2001. Standaard Editions.

    Google Scholar 

  10. Nancy R. Kaplan and Michael L. Nelson. Determining the publication impact of a digital library. Journal of the American Society of Information Science, 51:324–339, 2000.

    Article  Google Scholar 

  11. R. N. Kostoff. The use and misuse of citation analysis in research evaluations. Scientometrics, 43(1):27–43, 1998.

    Article  Google Scholar 

  12. Todd A. Letsche and Michael W. Berry. Large-scale information retrieval with latent semantic indexing. Information Sciences, 100:105–137, 1997.

    Article  Google Scholar 

  13. Michael H. MacRoberts and Barbara R. MacRoberts. Problems of citation analysis: A critical review. Journal of the American Society for Information Science, 40(5):342–349, 1989.

    Article  Google Scholar 

  14. Tobiasa Opthof. Sense and nonsense about the impact factor. Cardiovascular Research, 33:1–7, 1997.

    Article  Google Scholar 

  15. P. Pirolli and J. E. Pitkow. Distributions of surfers’ paths through the world wide web:empirical characterization. World Wide Web, 2(1,2):29–45, 1999.

    Article  Google Scholar 

  16. James Pitkow. In searchof reliable usage data on the www. In Proceedings of the Sixth International WWW Conference, Santa Clara, California, April 7–11 1997.

    Google Scholar 

  17. Jan Reedijk. Sense and nonsense of science citation analyses: comments on the monopoly position of isi and citation inaccuracies. risks of possible misuse and biased citation and impact data. New J. Chem., pages 767–770, 1998.

    Google Scholar 

  18. Luis Mateus Rocha. Talkmine and the adaptive recommendation project. In Proceedings of ACM Digital Libraries 99, Berkeley, California, August 1999.

    Google Scholar 

  19. Herbert Vandesompel. Reference linking in a hybrid library environment (i). D-Lib Magazine, 5(4), 1999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bollen, J., Vemulapalli, S., Xu, W. (2002). Digital Library Evaluation by Analysis of User Retrieval Patterns. In: Agosti, M., Thanos, C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2002. Lecture Notes in Computer Science, vol 2458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45747-X_32

Download citation

  • DOI: https://doi.org/10.1007/3-540-45747-X_32

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44178-6

  • Online ISBN: 978-3-540-45747-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics