Abstract
The topic of recommender systems is rapidly gaining interest in the user-behaviour modeling research domain. Over the years, various recommender algorithms based on different mathematical models have been introduced in the literature. Researchers interested in proposing a new recommender model or modifying an existing algorithm should take into account a variety of key performance indicators, such as execution time, recall and precision. Till date and to the best of our knowledge, no general cross-validation scheme to evaluate the performance of recommender algorithms has been developed. To fill this gap we propose an extension of conventional cross-validation. Besides splitting the initial data into training and test subsets, we also split the attribute description of the dataset into a hidden and visible part. We then discuss how such a splitting scheme can be applied in practice. Empirical validation is performed on traditional user-based and item-based recommender algorithms which were applied to the MovieLens dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Deshpande, M., Karypis, G.: Item-based top-n recommendation algorithms. J. ACM Transactions on Information Systems 22(1), 143–177 (2004)
Sarwar, B.M., Karypis, J., Konstan, J.A., Riedl, J.: Analysis of recommendation algorithms for e-commerce. In: ACM Conference on Electronic Commerce, pp. 158–167 (2001)
Goldberg, D., Nichols, D.A., Oki, B.M., Terry, D.B.: Using Collaborative Filtering to Weave an Information Tapestry. Communications of the ACM 35(12), 61–70 (1992)
Ignatov, D.I., Kuznetsov, S.O.: Concept-based Recommendations for Internet Advertisement. In: Sixth International Conference on Concept Lattices and Their Applications, pp. 157–166. Palacky University, Olomouc (2008)
Ignatov, D.I., Kuznetsov, S.O.: Data Mining techniques for Internet Advertisement Recommender System. In: Proc. of 11th National Conference on Artificial Intelligence, Lenand, Moscow, vol. 2, pp. 34–42 (2008) (in Russian)
del Olmo, F.H., Gaudioso, E.: Evaluation of recommender systems: A new approach. J. Expert Systems with Applications 35, 790–804 (2008)
Segaran, T.: Programming Collective Intelligence. O’Reilly Media, Sebastopol (2007)
Symeonidis, P., Nanopoulos, A., Papadopoulos, A.N., Manolopoulos, Y.: Nearest-biclusters collaborative filtering based on constant and coherent values. J. Information Retrieval 11, 51–75 (2007)
Poelmans, J., Elzinga, P., Viaene, S., Dedene, G.: Curbing domestic violence: instantiating C-K theory with formal concept analysis and emergent self-organizing maps. Int. Syst. in Accounting, Finance and Management 17(3-4), 167–191 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ignatov, D.I., Poelmans, J., Dedene, G., Viaene, S. (2012). A New Cross-Validation Technique to Evaluate Quality of Recommender Systems. In: Kundu, M.K., Mitra, S., Mazumdar, D., Pal, S.K. (eds) Perception and Machine Intelligence. PerMIn 2012. Lecture Notes in Computer Science, vol 7143. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27387-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-27387-2_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27386-5
Online ISBN: 978-3-642-27387-2
eBook Packages: Computer ScienceComputer Science (R0)