Abstract
This paper discusses new strategies for the performance evaluation of user search behavior. For the Log Analysis for Digital Societies (LADS) task of LogCLEF 2009 are proposed three different levels of user performance: success, failure and strong failure. The goal is to compare and measure session performance on a qualitative as well as on a quantitative level. The results obtained with both methods are in good agreement. Primarily they show that it is possible to investigate user performance from interpreting the user interactions recorded in log files. Both the qualitative and quantitative results give rise to a refinement of our operational definition of performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jansen, B., Spink, A., Taksa, I.: Handbook of Research on Web Log Analysis. IGI Global, Hershey (2009)
Lamping, J., Rao, R., Pirolli, P.: A focus+content technique based on hyperbolic geometry for viewing large hierarchies. In: CHI 1995: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 401–408. ACM Press, New York (1995)
Heo, M., Hirtle, S.C.: An empirical comparison of visualization tools to assist information retrieval on the web. Journal of the American Society for Information Science and Technology (JASIST) 52(8), 666–675 (2001)
Mandl, T., Agosti, M., Di Nunzio, G., Yeh, A., Mani, I., Doran, C., Schulz, J.M.: LogCLEF 2009: the CLEF 2009 Cross-Language Logfile Analysis Track Overview. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 506–515. Springer, Heidelberg (2009)
Lamm, K., Koelle, R., Mandl, T.: Search Path Visualization and Session Success Evaluation with Log Files from The European Library (TEL). In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I, Corfu, Greece. LNCS, vol. 6241, pp. 539–544. Springer, Heidelberg (2010), http://www.clef-campaign.org/2009/working_notes/lamm-paperCLEF2009.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lamm, K., Mandl, T., Koelle, R. (2010). Search Path Visualization and Session Performance Evaluation with Log Files. In: Peters, C., et al. Multilingual Information Access Evaluation I. Text Retrieval Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15754-7_66
Download citation
DOI: https://doi.org/10.1007/978-3-642-15754-7_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15753-0
Online ISBN: 978-3-642-15754-7
eBook Packages: Computer ScienceComputer Science (R0)