Dominik Kowald
Elisabeth Lex
ABSTRACT
To date, the evaluation of tag recommender algorithms has mostly been conducted in limited ways, including p-core pruned datasets, a small set of compared algorithms and solely based on recommender accuracy. In this study, we use an open-source evaluation framework to compare a rich set of state-of-the-art algorithms in six unfiltered, open datasets via various metrics, measuring not only accuracy but also the diversity, novelty and computational costs of the approaches. We therefore provide a transparent and reproducible tag recommender evaluation in real-world folksonomies. Our results suggest that the efficacy of an algorithm highly depends on the given needs and thus, they should be of interest to both researchers and developers in the field of tag-based recommender systems.
- F. Belém, E. Martins, J. Almeida, and M. Gonçalves. Exploiting novelty and diversity in tag recommendation. In Advances in Information Retrieval, pages 380--391. Springer, 2013. Google Scholar
Digital Library
- S. Doerfel and R. Jaschke. An analysis of tag-recommender evaluation procedures. In Proc. of RecSys'13, pages 343--346. ACM, 2013. Google ScholarDigital Library
- J. Gemmell, T. Schimoler, M. Ramezani, L. Christiansen, and B. Mobasher. Improving folkrank with item-based collaborative filtering. Recommender Systems & the Social Web, 2009.Google Scholar
- D. Helic, C. Körner, M. Granitzer, M. Strohmaier, and C. Trattner. Navigational efficiency of broad vs. narrow folksonomies. In Proc. of HT'12, pages 63--72. ACM, 2012. Google ScholarDigital Library
- R. Jaschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in folksonomies. In Knowledge Discovery in Databases: PKDD 2007, pages 506--514. Springer, 2007. Google ScholarDigital Library
- R. Jaschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in social bookmarking systems. Ai Communications, 21(4):231--247, 2008. Google ScholarDigital Library
- D. Kowald, S. Kopeinik, P. Seitlinger, T. Ley, D. Albert, and C. Trattner. Refining frequency-based tag reuse predictions by means of time and semantic context. In Mining, Modeling, and Recommending 'Things' in Social Media, pages 55--74. Springer, 2015.Google ScholarCross Ref
- D. Kowald, E. Lacic, and C. Trattner. Tagrec: towards a standardized tag recommender benchmarking framework. In Proc. of HT'14, pages 305--307. ACM, 2014. Google ScholarDigital Library
- D. Kowald, P. Seitlinger, S. Kopeinik, T. Ley, and C. Trattner. Forgetting the words but remembering the meaning: Modeling forgetting in a verbal and semantic tag recommender. In Mining, Modeling, and Recommending 'Things' in Social Media, pages 75--95. Springer, 2015.Google ScholarCross Ref
- R. Krestel, P. Fankhauser, and W. Nejdl. Latent dirichlet allocation for tag recommendation. In Proc. of RecSys'09, pages 61--68. ACM, 2009. Google ScholarDigital Library
- M. Lipczak. Hybrid tag recommendation in collaborative tagging systems. PhD thesis, Dalhousie University Halifax, 2012.Google Scholar
- L. B. Marinho and L. Schmidt-Thieme. Collaborative tag recommendations. In Data Analysis, Machine Learning and Applications, pages 533--540. Springer, 2008.Google ScholarCross Ref
- S. Rendle, L. Balby Marinho, A. Nanopoulos, and L. Schmidt-Thieme. Learning optimal ranking with tensor factorization for tag recommendation. In Proc. of KDD'09, pages 727--736. ACM, 2009. Google ScholarDigital Library
- S. Rendle and L. Schmidt-Thieme. Pairwise interaction tensor factorization for personalized tag recommendation. In Proc. of WSDM'10, pages 81--90. ACM, 2010. Google ScholarDigital Library
- L. Zhang, J. Tang, and M. Zhang. Integrating temporal usage pattern into personalized tag prediction. In Web Technologies and Applications. Springer, 2012. Google ScholarDigital Library
Index Terms
- Evaluating Tag Recommender Algorithms in Real-World Folksonomies: A Comparative Study
Recommendations
A Novel Framework for Improving Recommender Diversity
International Workshop on Behavior and Social Informatics on Behavior and Social Computing - Volume 8178Recommender systems are being used to assist users in finding relevant items from a large set of alternatives in many online applications. However, while most research up to this point has focused on improving the accuracy of recommender systems, other ...
Investigating serendipity in recommender systems based on real user feedback
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied ComputingOver the past several years, research in recommender systems has emphasized the importance of serendipity, but there is still no consensus on the definition of this concept and whether serendipitous items should be recommended is still not a well-...
User Similarity Adjustment for Improved Recommendations
MIKE 2015: Proceedings of the Third International Conference on Mining Intelligence and Knowledge Exploration - Volume 9468Recommender systems are becoming more and more attractive in both research and commercial communities due to Information overload problem and the popularity of the Internet applications. Collaborative Filtering, a popular branch of recommendation ...
Comments