Xiao Hu
ABSTRACT
Given the experimental nature of information retrieval, progress critically depends on analyzing the errors made by existing retrieval approaches and understanding their limitations. Our research explores various hypothesized reasons for hard topics in TREC-8 ad hoc task, and shows that the bad performance is partially due to the existence of highly distracting sub-collections that can dominate the overall performance.
- E. Voorhees and D. Harman, Overview of the Eighth Text REtrieval Conference (TREC-8), In Proceedings of TREC-8, pages 1--24.Google Scholar
Cross Ref
- K. Sparck Jones, Summary Performance Comparisons TREC-2 Through TREC-8, In Proceedings of TREC-8, Pages B-1.Google Scholar
- A. L. Powell, J.C. French, J. Callan, M. Connell, and C.L. Viles, The impact of database selection on distributed searching, In Proceedings of SIGIR 2000, pages 232--239. Google ScholarDigital Library
Index Terms
- Error analysis of difficult TREC topics
Recommendations
TREC: topic engineering exercise
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrievalIn this work, we investigate approaches to engineer better topic sets in information retrieval test collections. By recasting the TREC evaluation exercise from one of building more effective systems to an exercise in building better topics, we present ...
Sentiment analysis with global topics and local dependency
AAAI'10: Proceedings of the Twenty-Fourth AAAI Conference on Artificial IntelligenceWith the development of Web 2.0, sentiment analysis has now become a popular research problem to tackle. Recently, topic models have been introduced for the simultaneous analysis for topics and the sentiment in a document. These studies, which jointly ...
The TREC 2005 robust track
The TREC robust retrieval track explores methods for improving the consistency of retrieval technology by focusing on poorly performing topics. The retrieval task in the track is a traditional ad hoc retrieval task where the evaluation methodology ...
Comments