Abstract
Log data constitute a relevant aspect in the evaluation process of the quality of a search engine and the quality of a multilingual search service; log data can be used to study the usage of a search engine, and to better adapt it to the objectives the users were expecting to reach. The interest in multilingual log analysis was promoted by the Cross Language Evaluation Forum (CLEF) for the first time with a track named LogCLEF. LogCLEF is an evaluation initiative for the analysis of queries and other logged activities as expression of user behavior. The goal is the analysis and classification of queries in order to understand search behavior especially in multilingual contexts and ultimately to improve search systems. Two tasks were defined: Log Analysis and Geographic Query Identification (LAGI) which aimed at the identification of queries for geographic content and Log Analysis for Digital Societies (LADS) which was based on analyzing the user behavior of the search logs the service of The European Library. Five groups using a variety of approaches submitted experiments. The data for the track, the evaluation methodology and results are presented and discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Agosti, M.: Log Data in Digital Libraries. In: Agosti, M., Esposito, F., Thanos, C. (eds.) Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pp. 115–121. An Association for Digital Libraries, Padova (July 2008)
Agosti, M., Di Nunzio, G.M.: Gathering and Mining Information from Web Log Files. In: Thanos, C., Borri, F., Candela, L. (eds.) DELOS 2007. LNCS, vol. 4877, pp. 104–113. Springer, Heidelberg (2007)
Agosti, M., Di Nunzio, G.M.: Web Log Mining: A Study of User Sessions. In: 10th DELOS Thematic Workshop on Personalized Access, Profile Management, and Context Awareness in Digital Libraries (PersDL 2007), Corfu, Greece, pp. 70–74 (2007)
Bosca, A., Dini, L.: CACAO project at the LogCLEF Track. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241. Springer, Heidelberg (2010)
Di Nunzio, G.M.: LogCLE 2009/03/02 v. 1.0 Description of the The European Library (TEL) Search Action Log Files (2009), http://www.uni-hildesheim.de/logclef/Daten/LogCLEF2009_file_description.pdf
Ghorab, M.R., Leveling, J., Zhou, D., Jones, G., Wade, V.: TCD-DCU at LogCLEF 2009: An Analysis of Queries, Actions, and Interface Languages. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, Springer, Heidelberg (2010)
Hofmann, K., de Rijke, M., Huurnink, B., Meij, E.: A Semantic Perspective on Query Log Analysis. In: Cross Language Evaluation Forum (CLEF) 2009 Working Notes, http://www.clef-campaign.org/2009/working_notes/hofmann_etal-clef2009-querylog.pdf
Iftene, A.: UAIC: Participation in LAGI Task. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 362–365. Springer, Heidelberg (2010)
Lamm, K., Mandl, T., Kölle, R.: Search Path Visualization and Session Performance Evaluation with Log Files from The European Library (TEL). In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 539–544. Springer, Heidelberg (2010)
Li, Z., Wang, C., Xing, X., Ma, W.-Y.: Query Parsing Task for GeoCLEF 2007 Report. In: Cross Language Evaluation Forum, CLEF 2007 (2007), Working Notes http://www.clef-campaign.org/2007/working_notes/LI_OverviewCLEF2007.pdf
Mandl, T., Gey, F., Di Nunzio, G.M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., Xing, X.: GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview. In: Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D.W., Peñas, A., Petras, V., Santos, D. (eds.) CLEF 2007. LNCS, vol. 5152, pp. 745–772. Springer, Heidelberg (2008)
Oakes, M., Xu, Y.: LADS at Sunderland. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, Springer, Heidelberg (2010)
Korolova, A., Kenthapadi, K., Mishra, N., Ntoulas, A.: Releasing search queries and clicks privately. In: Proc. 18th Intl. Conference on World Wide Web, Madrid, Spain, April 20 - 24, pp. 171–180. ACM, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mandl, T. et al. (2010). LogCLEF 2009: The CLEF 2009 Multilingual Logfile Analysis Track Overview. In: Peters, C., et al. Multilingual Information Access Evaluation I. Text Retrieval Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15754-7_62
Download citation
DOI: https://doi.org/10.1007/978-3-642-15754-7_62
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15753-0
Online ISBN: 978-3-642-15754-7
eBook Packages: Computer ScienceComputer Science (R0)