skip to main content
10.1145/1031171.1031228acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
Article

A design space approach to analysis of information retrieval adaptive filtering systems

Published: 13 November 2004 Publication History

Abstract

In this paper we suggest a new approach to analysis and design of IR systems. We argue for design space exploration in constructing IR systems and in analyzing the effects of individual modules and parameters. We present results of experiments with parametric interpolation, or "homotopy", between two systems, and show, incidentally, that the best results are not achieved at the endpoints, and may lie outside the bounding hypercube defined by our choice of parameterization. Three distinct classes of interpolation are introduced to deal with the complexities of the specific example.

References

[1]
Reuters corpus volume 1. http://about.reuters.com/researchandstandards/corpus/.
[2]
A. Anghelescu, E. Boros, D. Lewis, V. Menkov, D. Neu, and P. Kantor. Rutgers filtering work at trec 2002: Adaptive and batch. In The Eleventh Text REtrieval Conference (TREC-11). NIST, 2002.
[3]
A. Bahuman, K. Rasheed, and B. Bishop. An evolutionary approach for vlsi standard cell design. In The Congress on Evolutionary Computation (CEC'2002), 2002.
[4]
M. Breschuaer and C. Peters. Cross-language evaluation forum: Objectives, results, achievements. Information Retrieval, 7:7--32, 2004.
[5]
F. H. Clarke. Optimization and Nonsmooth Analysis. Wiley Inter-science, New York, New York, 1983.
[6]
A. Gelsey, M. Schwabacher, and D. Smith. Using modeling knowledge to guide design space search. In Artificial Intelligence in Design, Stanford, CA, June 1996.
[7]
D. Harman. Towards more reliable information retrieval technology. 2003 ARDA Workshop
[8]
W. R. Hersh, C. Buckley, T. J. Leone, and D. H. Hickam. OHSUMED: an interactive retrieval evaluation and new large test collection for research. In Proceedings of the 17th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (Special Issue of the SIGIR Forum), pages 192--201, 1994.
[9]
N. Kando. Evaluation of information access technologies at ntcir workshop. In Results of the CLEF 2003 Cross-Language System Evaluation Campaign, pages 445--454, August 2003.
[10]
S. Robertson and I. Soboroff. The TREC 2002 filtering track report. In The Eleventh Text REtrieval Conference (TREC-11). NIST, 2002.
[11]
J. J. Rocchio. Relevance feedback in information retrieval. In G. Salton, editor, The SMART Retrieval System: Experiments in Automatic Document Processing, pages 313--323. Prentice Hall, Inc., Englewood CLiffs, New Jersey, 1971.
[12]
M. Schwabacher and A. Gelsey. Intelligent gradientbased search of incompletely defined design spaces. Technical Report HPCD-TR-38, Department of Computer Science, Rutgers University, New Brunswick, NJ, 1996.
[13]
L. Steinberg and K. Rasheed. Optimization by searching a tree of populations. In Genetic and Evolutionary Computation Conference (GECCO'99), 1999.
[14]
S. Szykman. Optimization as a driver for design space exploration. In The Optimization in Industry Conference, Palm Coast, Florida, March 1997.
[15]
B. Wang. Personal communication, January 2003.
[16]
H. Xu, Z. Yang, B. Wang, B. Liu, J. Cheng, Y. Liu, Z. Yang, X. Cheng, and S. Bai. TREC-11 experiments at CAS-ICT: Filtering and web. In The Eleventh Text REtrieval Conference (TREC-11). NIST, 2002.
[17]
W. I. Zangwill and C. B. Garcia. Pathways to Solutions, Fixed Points, and Equilibria. Prentice Hall, 1981.
[18]
G.-C. Zha, D. Smith, M. Schwabacher, K. Rasheed, A. Gelsey, D. Knight, and M. Haas. High performance supersonic missle inlet design using automated optimization. In 6th AIAA/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, 1996.

Cited By

View all
  • (2009)Efficient Topic-Based File Sharing in Hybrid Wireless NetworksProceedings of the 42nd Hawaii International Conference on System Sciences10.1109/HICSS.2009.180(1-9)Online publication date: 5-Jan-2009
  • (2008)Intelligent interactions in email using social networks and aiCHI '08 Extended Abstracts on Human Factors in Computing Systems10.1145/1358628.1358731(2629-2632)Online publication date: 5-Apr-2008

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '04: Proceedings of the thirteenth ACM international conference on Information and knowledge management
November 2004
678 pages
ISBN:1581138741
DOI:10.1145/1031171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive filtering
  2. homotopy
  3. rocchio

Qualifiers

  • Article

Conference

CIKM04
Sponsor:
CIKM04: Conference on Information and Knowledge Management
November 8 - 13, 2004
D.C., Washington, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2009)Efficient Topic-Based File Sharing in Hybrid Wireless NetworksProceedings of the 42nd Hawaii International Conference on System Sciences10.1109/HICSS.2009.180(1-9)Online publication date: 5-Jan-2009
  • (2008)Intelligent interactions in email using social networks and aiCHI '08 Extended Abstracts on Human Factors in Computing Systems10.1145/1358628.1358731(2629-2632)Online publication date: 5-Apr-2008

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media