Steven M. Beitzel
ABSTRACT
We describe a method for improving the precision of metasearch results based upon scoring the visual features of documents' surrogate representations. These surrogate scores are used during fusion in place of the original scores or ranks provided by the underlying search engines. Visual features are extracted from typical search result surrogate information, such as title, snippet, URL, and rank. This approach specifically avoids the use of search engine-specific scores and collection statistics that are required by most traditional fusion strategies. This restriction correctly reflects the use of metasearch in practice, in which knowledge of the underlying search engines' strategies cannot be assumed. We evaluate our approach using a precision-oriented test collection of manually-constructed binary relevance judgments for the top ten results from ten web search engines over 896 queries. We show that our visual fusion approach significantly outperforms the rCombMNZ fusion algorithm by 5.71%, with 99% confidence, and the best individual web search engine by 10.9%, with 99% confidence.
- Fox, E. and Shaw, J.A. Combination of Multiple Searches. NIST, TREC-2, 1994.Google Scholar
- Beitzel, S., et. al. Fusion of Effective Retrieval Strategies in the Same Information Retrieval System. JASIST, 2004. Google ScholarDigital Library
- Montague, M. and J. Aslam. Condorcet Fusion for Improved Retrieval. ACM-CIKM, 2002. Google ScholarDigital Library
- Chowdhury, A. and G. Pass. Operational Requirements for Scalable Search Systems. ACM-CIKM, 2003. Google ScholarDigital Library
- Jensen, E., et. al. A Framework for Determining Necessary Query Set Sizes to Evaluate Web Search Effectiveness. WWW, 2005. Google ScholarDigital Library
- J. Platt. Fast Training of Support Vector Machines using Sequential Minimal Optimization. Advances in Kernel Methods, Support Vector Learning. MIT Press, 1999. Google ScholarDigital Library
- Buckley, C. and E. Voorhees. Evaluating Evaluation Measure Stability. ACM-SIGIR, 2000. Google ScholarDigital Library
Index Terms
- Surrogate scoring for improved metasearch precision
Recommendations
Building efficient and effective metasearch engines
Frequently a user's information needs are stored in the databases of multiple search engines. It is inconvenient and inefficient for an ordinary user to invoke multiple search engines and identify useful documents from the returned results. To support ...
Rank aggregation using ant colony approach for metasearch
Metasearch engines provide a plethora of information to the user through World Wide Web. They are the prominent sources of query-based search and centralized human---world interactions. Metasearch engine shows a list of Web sites to a particular query ...
Advanced metasearch engines
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge managementA metasearch engine is a system, which is connected to different search engines. In response to a user query, it invokes suitable search engines for the query, merges the information returned by these search engines and output the merged result. There ...
Comments