Somnath Banerjee
ABSTRACT
Subscribers to the popular news or blog feeds (RSS/Atom) often face the problem of information overload as these feed sources usually deliver large number of items periodically. One solution to this problem could be clustering similar items in the feed reader to make the information more manageable for a user. Clustering items at the feed reader end is a challenging task as usually only a small part of the actual article is received through the feed. In this paper, we propose a method of improving the accuracy of clustering short texts by enriching their representation with additional features from Wikipedia. Empirical results indicate that this enriched representation of text items can substantially improve the clustering accuracy when compared to the conventional bag of words representation.
- E. Gabrilovich. Feature Generation for Textual Information Retrieval Using World Knowledge. PhD Thesis, Department of Computer Science, Technion -- Israel Institute of Technology, Haifa, Israel, 2006.Google Scholar
- A. Hotho, S. Staab, and G. Stumme. Ontologies Improve Text Document Clustering, In the Proc of the Third IEEE International Conference on Data Mining (ICDM'03), Melbourne, Florida, USA, 2003. Google ScholarDigital Library
- G. Salton, editor. Automatic text processing. Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA, 1988. Google ScholarDigital Library
Index Terms
- Clustering short texts using wikipedia
Recommendations
Does Wikipedia Information Help Netflix Predictions?
ICMLA '08: Proceedings of the 2008 Seventh International Conference on Machine Learning and ApplicationsWe explore several ways to estimate movie similarity from the free encyclopedia Wikipedia with the goal of improving our predictions for the Netflix Prize. Our system first uses the content and hyperlink structure of Wikipedia articles to identify ...
Weighting strategies for a recommender system using item clustering based on genres
An original clustering approach for recommender systems.The approach is based on item metadata informations (item genres).Items are clustered in several clusters.Weighting strategies are used to combine clusters evaluations.MAE is improved between 0.3 ...
Improving the accuracy of collaborative filtering recommendations using clustering and association rules mining on implicit data
The recommender systems are recently becoming more significant in the age of rapid development of the Internet technology due to their ability in making a decision to users on appropriate choices. Collaborative filtering (CF) is the most successful and ...
Comments