skip to main content
review-article

EVIA 2010: the third international workshop on evaluating information access

Published:03 January 2011Publication History
Skip Abstract Section

Abstract

The Third International Workshop on Evaluating Information Access (EVIA 2010) was held at the National Institute of Informatics, Tokyo, on June 15th, 2010. Themes were evaluation depth; the management of collaborative experiments; result diversity; and user studies.

References

  1. Maristella Agosti, Giorgio Maria Di Nunzio, Marco Dussin, and Nicola Ferro. 10 years of CLEF data in DIRECT: Where we are and where we can go. In Sakai et al. {8}, pages 16--24.Google ScholarGoogle Scholar
  2. Katrin Lamm, Thomas Mandl, Christa Womser-Hacker, and Werner Greve. The influence of expectation and system performance on user satisfaction with retrieval systems. In Sakai et al. {8}, pages 60--68.Google ScholarGoogle Scholar
  3. John Nave. Microsoft's Bing and user behaviour evaluation. In Sakai et al. {8}, pages 1--1.Google ScholarGoogle Scholar
  4. Sukomal Pal, Mandar Mitra, and Samaresh Maiti. Estimating pool-depth on per query basis. In Sakai et al. {8}, pages 2--6.Google ScholarGoogle Scholar
  5. Keun Chan Park, Jihee Ryu, Kyung-min Kim, and Sung Hyon Myaeng. A game-based evaluation method for subjective tasks involving text content analysis. In Sakai et al. {8}, pages 69--76.Google ScholarGoogle Scholar
  6. Tetsuya Sakai and Chin-Yew Lin. Ranking retrieval systems without relevance assessments: revisited. In Sakai et al. {8}, pages 25--33.Google ScholarGoogle Scholar
  7. Tetsuya Sakai, Nick Craswell, Ruihua Song, Stephen Robertson, Zhicheng Dou, and Chin-Yew Lin. Simple evaluation metrics for diversified search results. In Sakai et al. {8}, pages 42--50.Google ScholarGoogle Scholar
  8. Tetsuya Sakai, Mark Sanderson, and William Webber, editors. Proceedings of the Third International Workshop on Evaluating Information Access, Tokyo, Japan, June 2010. URL http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings8/EVIA/.Google ScholarGoogle Scholar
  9. Ian Soboroff. Test collection diagnosis and treatment. In Sakai et al. {8}, pages 34--41.Google ScholarGoogle Scholar
  10. Ruihua Song, Dongjie Qi, Hua Liu, Tetsuya Sakai, Jian-Yun Nie, Hsiao-Wuen Hon, and Yong Yu. Constructing a test collection with multi-intent queries. In Sakai et al. {8}, pages 51--59.Google ScholarGoogle Scholar
  11. William Webber, Alistair Moffat, and Justin Zobel. The effect of pooling and evaluation depth on metric stability. In Sakai et al. {8}, pages 7--15.Google ScholarGoogle Scholar

Index Terms

  1. EVIA 2010: the third international workshop on evaluating information access

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM SIGIR Forum
          ACM SIGIR Forum  Volume 44, Issue 2
          December 2010
          83 pages
          ISSN:0163-5840
          DOI:10.1145/1924475
          Issue’s Table of Contents

          Copyright © 2011 Authors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 3 January 2011

          Check for updates

          Qualifiers

          • review-article
        • Article Metrics

          • Downloads (Last 12 months)1
          • Downloads (Last 6 weeks)0

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader