Abstract
We propose a methodology to evaluate the impact of a Digital Library’s (DL) collection and the characteristics of its user community by an analysis of user retrieval patterns. Patterns of journal and document co-retrievals are reconstructed from DL server logs and used to generate proximity data for journals and documents, resulting in a weighted relation defined over the DL document collection represented by a network of document and journals. A measure of discrepancy between user-defined measures of document impact and the Journal Citation Record (JCR) Impact Factor (IF) published by the Institute for Scientific Information (ISI) is used to analyze characteristics of the DL user community. A preliminary analysis of the Los Alamos National Laboratory (LANL) Research Library (RL) server logs registered in 2001 demonstrates the potential of this approach.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Johan Bollen. Group user models for personalized hyperlink recommendation. In LNCS 1892-International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH2000), pages 39–50, Trento, August 2000. Springer Verlag.
Johan Bollen and Francis Heylighen. A system to restructure hypertext networks into valid user models. The New Review of Hypermedia and Multimedia, 4:189–213, 1998.
Johan Bollen and Luis M. Rocha. An adaptive systems approach to the implementation and evaluation of digital library recommendation systems. In LNCS-Fourth European Conference on Research and Advanced Technology for Digital Libraries (ECDL2000), Lisbon, September 2000. Springer Verlag.
Johan Bollen, Herbert Vandesompel, and Luis M. Rocha. Mining associative relations from website logs and their application to context-dependent retrieval using spreading activation. In Proceedings of the Workshop on Organizing Webspaces (ACM-DL99), Berkeley, California, 1999. in preparation.
Christine L. Borgman and Ronald E. Rice. The convergence of information science and communication: A bibliometric analysis. Journal of the American Society for Information Science, 43(6):397–411, 1992.
Philip K. Chan. Constructing web user profiles: a non-invasive learning approach. In Brij Masand and Myra Spiliopoulou, editors, Web Usage Analysis and User Profiling-tLNAI 1836, San Diego, CA, August 1999. Springer.
Peter W. Foltz. Using latent semantic indexing for information filtering. In R. B. Allen, editor, Proceedings of the Conference on Office Information Systems, pages 40–47, Cambridge, MA, 1990.
Eugene Garfield. Citation Indexing: Its Theory and Application in Science, Technology, and Humanities. John Wiley and Sons, New York, 1979.
Francis Heylighen. Mining associative meanings from the web: from word disambiguation to the global brain. In R. Timmerman and M. Lutjeharms, editors, Proceedings of the International Colloqium: Trends in Special Language and Language Technology, pages 15–44, Antwerpen, Belgium, 2001. Standaard Editions.
Nancy R. Kaplan and Michael L. Nelson. Determining the publication impact of a digital library. Journal of the American Society of Information Science, 51:324–339, 2000.
R. N. Kostoff. The use and misuse of citation analysis in research evaluations. Scientometrics, 43(1):27–43, 1998.
Todd A. Letsche and Michael W. Berry. Large-scale information retrieval with latent semantic indexing. Information Sciences, 100:105–137, 1997.
Michael H. MacRoberts and Barbara R. MacRoberts. Problems of citation analysis: A critical review. Journal of the American Society for Information Science, 40(5):342–349, 1989.
Tobiasa Opthof. Sense and nonsense about the impact factor. Cardiovascular Research, 33:1–7, 1997.
P. Pirolli and J. E. Pitkow. Distributions of surfers’ paths through the world wide web:empirical characterization. World Wide Web, 2(1,2):29–45, 1999.
James Pitkow. In searchof reliable usage data on the www. In Proceedings of the Sixth International WWW Conference, Santa Clara, California, April 7–11 1997.
Jan Reedijk. Sense and nonsense of science citation analyses: comments on the monopoly position of isi and citation inaccuracies. risks of possible misuse and biased citation and impact data. New J. Chem., pages 767–770, 1998.
Luis Mateus Rocha. Talkmine and the adaptive recommendation project. In Proceedings of ACM Digital Libraries 99, Berkeley, California, August 1999.
Herbert Vandesompel. Reference linking in a hybrid library environment (i). D-Lib Magazine, 5(4), 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bollen, J., Vemulapalli, S., Xu, W. (2002). Digital Library Evaluation by Analysis of User Retrieval Patterns. In: Agosti, M., Thanos, C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2002. Lecture Notes in Computer Science, vol 2458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45747-X_32
Download citation
DOI: https://doi.org/10.1007/3-540-45747-X_32
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44178-6
Online ISBN: 978-3-540-45747-3
eBook Packages: Springer Book Archive