Guy Shani
ABSTRACT
In this tutorial we discuss the evaluation of recommender systems. We discuss the main reason for evaluating recommender systems, i.e., the selection task. We overview some general guidelines for conducting evaluation tests. We then discuss the evaluation of the system accuracy given specific system tasks. We also overview many properties of recommender systems, and explain how these properties can be evaluated.
- }}Gunawardana, A. and Shani, G. 2009. A Survey of Accuracy Evaluation Metrics of Recommendation Tasks. J. Mach. Learn. Res. 10 (Dec. 2009), 2935--2962. Google Scholar
Digital Library
- }}Gunawardana, A. and Shani, G. 2010. Evaluating Recommendation Systems. In Recommender Systems Handbook. Kantor, Ricci, Rokach, Shpira (Eds.).Google Scholar
- }}Herlocker, J. L., Konstan, J. A., Terveen, L. G., and Riedl, J. T. 2004. Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst. 22, 1 (Jan. 2004), 5--53. Google ScholarDigital Library
- }}McNee, S. M., Riedl, J., and Konstan, J. A. 2006. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI '06 Extended Abstracts on Human Factors in Computing Systems. 2006. Google ScholarDigital Library
Index Terms
- Tutorial on evaluating recommender systems
Recommendations
Evaluating collaborative filtering recommender systems
Recommender systems have been evaluated in many, often incomparable, ways. In this article, we review the key decisions in evaluating collaborative filtering recommender systems: the user tasks being evaluated, the types of analysis and datasets being ...
A survey of serendipity in recommender systems
We summarize most efforts on serendipity in recommender systems.We compare definitions of serendipity in recommender systems.We classify the state-of-the-art serendipity-oriented recommendation algorithms.We review methods to assess serendipity in ...
Tutorial: Sequence-Aware Recommender Systems
WWW '19: Companion Proceedings of The 2019 World Wide Web ConferenceRecommender systems are widely used in online applications to help users find items of interest and help them deal with information overload. In this tutorial, we discuss the class of sequence-aware recommender systems. Differently from the traditional ...
Comments