skip to main content
review-article

DESIRE 2011: workshop on data infrastructurEs for supporting information retrieval evaluation

Published: 20 May 2012 Publication History
First page of PDF

References

[1]
M. Agosti, G. M. Di Nunzio, and N. Ferro. A Data Curation Approach to Support Indepth Evaluation Studies. In F. C. Gey, N. Kando, C. Peters, and C.-Y. Lin, editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65--68. http://ucdata.berkeley.edu:7101/projects/sigir2006/papers/pdf-final/MLIA-2.pdf, 2006.
[2]
M. Agosti, G. M. Di Nunzio, N. Ferro, and C. Peters. CLEF: Ongoing Activities and Plans for the Future. In N. Kando and D. K. Evans, editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493--504. National Institute of Informatics, Tokyo, Japan, 2007.
[3]
M. Agosti, N. Ferro, and C. Thanos. DESIRE 2011: First International Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. In I. Ounis, I. Ruthven, B. Berendt, A. P. de Vries, and F. Wenfei, editors, Proc. 20th International Conference on Information and Knowledge Management (CIKM 2009), pages 2631--2632. ACM Press, New York, USA, 2009.
[4]
M. Agosti, N. Ferro, and C. Thanos, editors. Proc. Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation (DESIRE 2011). ACM Press, New York, USA, 2011.
[5]
R. E. de Castilho and I. Gurevych. A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval. In Agosti et al. {4}, pages 7--10.
[6]
G. Dupont, G. de Chalendar, K. Khelif, D. Voitsekhovitch, G. Canet, and S. Brunessaux. Evaluation With the VIRTUOSO Platform. In Agosti et al. {4}, pages 13--17.
[7]
N. Fuhr. An Infrastructure for Supporting the Evaluation of Interactive Information Retrieval. In Agosti et al. {4}, page 1.
[8]
D. Harman. Information Retrieval Evaluation. Morgan & Claypool Publishers, 2011.
[9]
J. Karlgren, A. Järvelin, G. Eriksson, and P. Hansen. Use Cases as a Component of Information Access Evaluation. In Agosti et al. {4}, pages 19--24.
[10]
M. Lenzerini. Ontology-based Data Management. In Agosti et al. {4}, page 11.
[11]
M. Lupu. PatOlympics - An Infrastructure for Interactive Evaluation of Patent Retrieval Tools. In Agosti et al. {4}, pages 25--28.
[12]
S. N. Wrigley, R. García-Castro, and C. Trojahn. Infrastructure and Workflow for the Formal Evaluation of Semantic Search Technologies. In Agosti et al. {4}, pages 29--34.
[13]
J. Zobel, W. Webber, M. Sanderson, and A. Moffat. Principles for Robust Evaluation Infrastructure. In Agosti et al. {4}, pages 3--6.

Cited By

View all
  • (2023)An in-depth investigation on the behavior of measures to quantify reproducibilityInformation Processing & Management10.1016/j.ipm.2023.10333260:3(103332)Online publication date: May-2023
  • (2021)A replication study on implicit feedback recommender systems with application to the data visualization recommendationExpert Systems10.1111/exsy.1287139:4Online publication date: 11-Nov-2021
  • (2018)AnseriniJournal of Data and Information Quality10.1145/323957110:4(1-20)Online publication date: 29-Oct-2018
  • Show More Cited By
  1. DESIRE 2011: workshop on data infrastructurEs for supporting information retrieval evaluation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM SIGIR Forum
    ACM SIGIR Forum  Volume 46, Issue 1
    June 2012
    90 pages
    ISSN:0163-5840
    DOI:10.1145/2215676
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 May 2012
    Published in SIGIR Volume 46, Issue 1

    Check for updates

    Qualifiers

    • Review-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)An in-depth investigation on the behavior of measures to quantify reproducibilityInformation Processing & Management10.1016/j.ipm.2023.10333260:3(103332)Online publication date: May-2023
    • (2021)A replication study on implicit feedback recommender systems with application to the data visualization recommendationExpert Systems10.1111/exsy.1287139:4Online publication date: 11-Nov-2021
    • (2018)AnseriniJournal of Data and Information Quality10.1145/323957110:4(1-20)Online publication date: 29-Oct-2018
    • (2017)Reproducibility Challenges in Information Retrieval EvaluationJournal of Data and Information Quality10.1145/30202068:2(1-4)Online publication date: 4-Jan-2017
    • (2016)Increasing Reproducibility in IRACM SIGIR Forum10.1145/2964797.296480850:1(68-82)Online publication date: 27-Jun-2016
    • (2014)CLEF 15th BirthdayACM SIGIR Forum10.1145/2701583.270158748:2(31-55)Online publication date: 23-Dec-2014
    • (2013)Building optimal information systems automaticallyProceedings of the 22nd ACM international conference on Information & Knowledge Management10.1145/2505515.2505692(1421-1430)Online publication date: 27-Oct-2013
    • (2012)PROMISE retreat report prospects and opportunities for information access evaluationACM SIGIR Forum10.1145/2422256.242226546:2(60-84)Online publication date: 21-Dec-2012

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media