Abstract
The INitiative for the Evaluation of XML retrieval (INEX) has, since 2002, been working towards the goal of establishing an infrastructure, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of content-oriented XML retrieval systems. In 2005, 47 organizations registered to participate in INEX. Throughout the year a number of groups dropped out due to resource requirements, while 11 further groups joined. INEX 2005 concluded with a total of 41 active groups. In addition to the main ad-hoc retrieval track, six further research tracks were included in INEX 2005, each studying different aspects of XML information access: interactive, relevance feedback, heterogeneous, natural language processing, and two new tracks for 2005, multimedia and document mining tracks.
- N. Fuhr, M. Lalmas, S. Malik, and G. Kazai. (eds) Advances in XML Information Retrieval and Evaluation: Proceedings of the Fourth Workshop of the INitiative for the Evaluation of XML Retrieval (INEX 2005), Schloss Dagstuhl, 28-30 November 2005, Lecture Notes in Computer Science, Vol 3977, Springer-Verlag, 2006. Google ScholarDigital Library
- K. Järvelin and J. Kekäläinen. Cumulated Gain-based evaluation of IR techniques. ACM Transactions on Information Systems (ACM TOIS), 20(4):422--446, 2002. Google ScholarDigital Library
- G. Kazai and M. Lalmas. INEX 2005 evaluation metrics. In {1}.Google Scholar
- S. Malik, G. Kazai, M. Lalmas, and N. Fuhr. Overview of INEX 2005. In {1}.Google Scholar
- J. Pehcevski and J. A. Thom. HiXEval: Highlighting XML Retrieval Evaluation. In {1}.Google Scholar
- A. Trotman and M. Lalmas. The Interpretation of CAS. In {1}. Google ScholarDigital Library
- A. Trotman and B. Sigurbjörnsson. Narrowed extended XPATH I (NEXI). In Advances in XML Information Retrieval, Third Workshop of the Initiative for the Evaluation of XML Retrieval (INEX 2004), Dagstuhl, Germany, December 6-8, 2004, Revised Selected Papers, Lecture Notes in Computer Science, Vol 3493, Springer-Verlag, page 16--40, 2005. Google ScholarDigital Library
- A. de Vries, G. Kazai and M. Lalmas. Tolerance to Irrelevance: A User-effort Oriented Evaluation of Retrieval Systems without Predefined Retrieval Unit RIAO 2004 Conference on Coupling approaches, coupling media and coupling languages for information retrieval, University of Avignon (Vaucluse), France, April 2004.Google Scholar
Index Terms
- Report on the ad-hoc track of the INEX 2005 workshop
Recommendations
INEX 2005 multimedia track
INEX'05: Proceedings of the 4th international conference on Initiative for the Evaluation of XML RetrievalThis paper reports on the activities of the INEX 2005 Multimedia track. The track was successful in realizing its objective to provide a pilot evaluation platform for the evaluation of retrieval strategies for XML-based multimedia documents. In this ...
RMIT university at INEX 2005: ad hoc track
INEX'05: Proceedings of the 4th international conference on Initiative for the Evaluation of XML RetrievalDifferent scenarios of XML retrieval are analysed in the INEX 2005 ad hoc track, which reflect different query interpretations and user behaviours that may be observed during XML retrieval. The RMIT University group’s participation in the INEX 2005 ad ...
Report on INEX 2013
INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2013 ...
Comments