research-article

Categorizing and ranking search engine's results by semantic similarity

Authors:

Liu WenyinAuthors Info & Claims

ICUIMC '08: Proceedings of the 2nd international conference on Ubiquitous information management and communication

Pages 284 - 288

https://doi.org/10.1145/1352793.1352854

Published: 31 January 2008 Publication History

Abstract

An automatic method for text categorizing and ranking search engine's results by semantic similarity is proposed in this paper. We first obtain nouns and verbs from snippets obtained from search engine using Name Entity Recognition and part-of speech. A semantic similarity algorithm based on WordNet is proposed to calculate the similarity of each snippet to each of the pre-defined categories. A balanced similarity ranking method combined with Google's rank and timeliness of the pages is proposed to rank these snippets. Preliminary experiments with 500 labeled questions from TREC03 show that 72.7% are correctly categorized.

References

[1]

Google. http://www.google.com, 2007.

[2]

WordNet. http://wordnet.princeton.edu/, 2007.

[3]

500 labeled TREC 03 question set. http://l2r.cs.uiuc.edu/~cogcomp/Data/QA/QC/TREC_10.label, 2007.

[4]

UIUC. http://www.cs.uiuc.edu/, 2007.

[5]

Mihalcea, R., Corley, C., and Strapparava C. Corpus-based and knowledge-based measures of text semantic similarity. In Proceedings of AAAI'06, 2006.

Digital Library

[6]

Lapata, M., and Barzilay, R. Automatic evaluation of text coherence: models and representations. In Proceedings of the 19th International Joint Conference on Artificial Intelligence, 2005.

Digital Library

[7]

Joachims, T. A probabilistic analysis of the rocchio algorithm with TFIDF for text categorization, In Proceedings of the Fourteenth International Conference on Machine Learning, 1997.

Digital Library

[8]

Salton, G., and Buckley, C. Term weighting approaches in automatic text retrieval. In Readings in Information Retrieval. San Francisco, CA: Morgan Kaufmann Publishers, 1997.

Digital Library

[9]

Wu, Z., and Palmer, M. Verb semantics and lexical selection. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, 1994.

Digital Library

[10]

Leacock, C., and Chodorow, M. Combining local context and WordNet sense similarity for word sense identification, In WordNet, An Electronic Lexical Database. The MIT Press, 1998.

[11]

Turney, P. Mining the web for synonyms: PMI-IR versus LSA on TOEFL. In Proceedings of the Twelfth European Conference on Machine Learning, 2001.

Digital Library

[12]

Lin, C., and Hovy, E. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of Human Language Technology Conference, 2003.

Digital Library

[13]

Landauer, T. K., Foltz, P., and Laham, D. Introduction to latent semantic analysis. Discourse Processes 25, 1998.

[14]

Salton, G., and Lesk, M. Computer evaluation of indexing and text processing. Prentice Hall, Ing. Englewood Cliffs, New Jersey, 1971.

[15]

Rocchio, J. Relevance feedback in information retrieval. Prentice Hall, Ing. Englewood Cliffs, New Jersey, 1997.

[16]

Yang, Y. Expert network: Effective and efficient learning from human decisions in text categorization and retrieval. In Proceedings of 17th Ann Int ACM SI- GIR Conference on Research and Development in Information Retrieval, SIGIR'94, 1994.

Digital Library

[17]

Hao, T. Y., Hu, D. W., Liu, W. Y., and Zeng, Q. T. Semantic patterns for user-interactive question answering, Concurrency and Computation: Practice and Experience, vol. 20, 1--17, 2007.

Digital Library

[18]

Stop word list. http://www.dcs.gla.ac.uk/idom/ir_resources/linguistic_utils/stop_words, 2007.

[19]

TreeTagger. http://www.ims.unistuttgart.de/projekte/corplex/TreeTagger/, 2007.

[20]

Semantic similarity based on WordNet. http://www.codeproject.com/KB/string/semanticsimilaritywordnet.aspx, 2007.

[21]

Page, L., Brin, S., Motwani, R. and Winograd, T. The pagerank citation ranking: bringing order to the Web. Stanford Digital Libraries Working Paper, 1998.

[22]

Javatools. http://www.mpiinf.mpg.ed/~suchanek/downloads/javatools/, 2007.

[23]

Definition of topic list. http://l2r.cs.uiuc.edu/~cogcomp/Data/QA/QC/definition.html, 2007.

Cited By

Hao TRusanov ABoland MWeng C(2014)Clustering clinical trials with similar eligibility criteria featuresJournal of Biomedical Informatics10.1016/j.jbi.2014.01.00952:C(112-120)Online publication date: 1-Dec-2014
https://dl.acm.org/doi/10.1016/j.jbi.2014.01.009
Liu CLi J(2012)Semantic-Based Composite Document RankingProceedings of the 2012 IEEE Sixth International Conference on Semantic Computing10.1109/ICSC.2012.28(126-129)Online publication date: 19-Sep-2012
https://dl.acm.org/doi/10.1109/ICSC.2012.28
Kramer MGregorowicz AIyer BAguiar ABernstein M(2008)Wiki trust metrics based on phrasal analysisProceedings of the 4th International Symposium on Wikis10.1145/1822258.1822291(1-10)Online publication date: 8-Sep-2008
https://dl.acm.org/doi/10.1145/1822258.1822291

Index Terms

Categorizing and ranking search engine's results by semantic similarity
1. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results
      1. Relevance assessment
    2. Retrieval tasks and goals
      1. Document filtering
      2. Information extraction

Recommendations

Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

This work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...
What's Going on in Search Engine Rankings?
AINAW '08: Proceedings of the 22nd International Conference on Advanced Information Networking and Applications - Workshops

Many people use search engines every day to retrieve documents from the Web. Although the social influence of search engine rankings has become significant, ranking algorithms are not disclosed. In this paper, we have investigated three major search ...
How to Improve Your Search Engine Ranking: Myths and Reality

Search engines have greatly influenced the way people access information on the Internet, as such engines provide the preferred entry point to billions of pages on the Web. Therefore, highly ranked Web pages generally have higher visibility to people ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICUIMC '08: Proceedings of the 2nd international conference on Ubiquitous information management and communication

January 2008

604 pages

ISBN:9781595939937

DOI:10.1145/1352793

General Chairs:
Won Kim
Sungkyunkwan University
,
Hyung Jin Choi
Sungkyunkwan University

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data

In-Cooperation

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 January 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

China Semantic Grid Research Plan
City University of Hong Kong

Conference

ICUIMC08

Sponsor:

SIGKDD

ICUIMC08: The Second International Conference on Ubiquitous Information Management and Communication

January 31 - February 1, 2008

Suwon, Korea

Acceptance Rates

Overall Acceptance Rate 251 of 941 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
515
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hao TRusanov ABoland MWeng C(2014)Clustering clinical trials with similar eligibility criteria featuresJournal of Biomedical Informatics10.1016/j.jbi.2014.01.00952:C(112-120)Online publication date: 1-Dec-2014
https://dl.acm.org/doi/10.1016/j.jbi.2014.01.009
Liu CLi J(2012)Semantic-Based Composite Document RankingProceedings of the 2012 IEEE Sixth International Conference on Semantic Computing10.1109/ICSC.2012.28(126-129)Online publication date: 19-Sep-2012
https://dl.acm.org/doi/10.1109/ICSC.2012.28
Kramer MGregorowicz AIyer BAguiar ABernstein M(2008)Wiki trust metrics based on phrasal analysisProceedings of the 4th International Symposium on Wikis10.1145/1822258.1822291(1-10)Online publication date: 8-Sep-2008
https://dl.acm.org/doi/10.1145/1822258.1822291

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten