Abstract
This paper systematically evaluates the user experience of a recommender system. Using both behavioral data and subjective measures of user experience, we demonstrate that choice satisfaction and system effectiveness increase when a system provides personalized recommendations (compared to the same system that provides random recommendations). We furthermore demonstrate that despite privacy issues, this higher choice satisfaction and system effectiveness increases users’ intention to provide feedback about their preference. Due to an intention-behavior gap, this may however not necessarily influence the users’ actual feedback behavior.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Xiao, B., Benbasat, I.: E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact. Mis. Quarterly 31, 137–209 (2007)
McNee, S.M., Riedl, J., Konstan, J.A.: Being Accurate Is Not Enough: How Accuracy Metrics Have Hurt Recommender Systems. In: CHI’06 Extended Abstracts on Human Factors in Computing Systems, pp. 1097–1101. ACM, New York (2006)
Ziegler, C.N., McNee, S.M., Konstan, J.A., Lausen, G.: Improving Recommendation Lists Through Topic Diversification. In: Proceedings of the 14th International Conference on World Wide Web, pp. 22–32. ACM, New York (2005)
McNee, S.M., Riedl, J., Konstan, J.A.: Making Recommendations Better: an Analytic Model for Human-Recommender Interaction. In: CHI’06 Extended Abstracts on Human Factors in Computing Systems, pp. 1103–1108. ACM, New York (2006)
Knijnenburg, B.P., Meesters, L.M.J., Marrow, P., Bouwhuis, D.G.: User-Centric Evaluation Framework for Multimedia Recommender Systems. In: UCMedia 2009 Workshop Experience Design and Evaluation of Social UCM Applications (2009) (in press)
Cosley, D., Lam, S.K., Albert, I., Konstan, J.A., Riedl, J.: Is Seeing Believing?: How Recommender System Interfaces Affect Users’ Opinions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 585–592. ACM, New York (2003)
Herlocker, J.L., Konstan, J.A., Terveen, K., Riedl, J.T.: Evaluating Collaborative Filtering Recommender Systems. ACM Transactions on Information Systems 22, 5–53 (2004)
Kohrs, A., Merialdo, B.: Using Category-Based Collaborative Filtering in the Active WebMuseum. In: Proceedings of IEEE International Conference on Multimedia and Expo., pp. 351–354. IEEE Press, New York (2000)
McNee, S. M., Albert, I., Cosley, D., Gopalkrishnan, P., Lam, S.K., Rashid, A.M., Konstan, J.A., Riedl, J.: On the Recommending of Citations for Research Papers. In: Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work, pp. 116–125. ACM, New York (2002)
Torres, R., McNee, S.M., Abel, M., Konstan, J.A., Riedl, J.: Enhancing Digital Libraries With TechLens+. In: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 228–236. ACM, New York (2004)
Häubl, G., Dellaert, B.G.C., Murray, K.B., Trifts, V.: Buyer Behavior in Personalized Shopping Environments. In: Karat, C.M., Blom, J.O., Karat, J. (eds.), pp. 207–229. Springer, Netherlands (2004)
Kobsa, A.: Personalized Hypermedia and International Privacy. Communications of the ACM 45, 64–67 (2002)
Hui, K.L., Tan, B.C.Y., Goh, C.Y.: Online Information Disclosure: Motivators and Measurements. ACM Transactions on Internet Technology (TOIT) 6, 415–441 (2006)
Resnick, P., Varian, H.R.: Recommender Systems. Communications of the ACM 40, 56–58 (1997)
Metzger, M.J.: Privacy, Trust, and Disclosure: Exploring Barriers to Electronic Commerce. Journal of Computer-Mediated Communication (2006), http://jcmc.indiana.edu/vol9/issue4/metzger.html
Herlocker, J.L.: Explanations in Recommender Systems. In: CHI’99 Workshop on Interacting With Recommender Systems (1999), http://www.patrickbaudisch.com/interactingwithrecommendersystems/WorkingNotes/JonHerlockerExplanationsInRecommenderSystems.pdf
Chellappa, R.K., Sin, R.G.: Personalization Versus Privacy: An Empirical Examination of the Online Consumer’s Dilemma. Information Technology and Management 6, 181–202 (2005)
Teltzrow, M., Kobsa, A.: Impacts of User Privacy Preferences on Personalized Systems. In: Karat, C., Blom, J.O., Karat, J. (eds.) Designing Personalized User Experiences in eCommerce, pp. 315–332. Springer, Netherlands (2004)
Ackerman, M.S., Cranor, L.F., Reagle, J.: Privacy in E-Commerce: Examining User Scenarios and Privacy Preferences. In: Proceedings of the 1st ACM Conference on Electronic Commerce, pp. 1–8. ACM, New York (1999)
Spiekermann, S., Grossklags, J., Berendt, B.: E-Privacy in 2nd Generation E-Commerce: Privacy Preferences Versus Actual Behavior. In: Proceedings of the 3rd ACM Conference on Electronic Commerce, pp. 38–47. ACM, New York (2001)
Brodie, C., Karat, C.M., Karat, J.: Creating an E-Commerce Environment Where Consumers Are Willing to Share Personal Information. In: Karat, C., Blom, J.O., Karat, J. (eds.) Designing Personalized User Experiences in eCommerce, pp. 185–206. Springer, Netherlands (2004)
Kobsa, A., Teltzrow, M.: Contextualized Communication of Privacy Practices and Personalization Benefits: Impacts on Users’ Data Sharing and Purchase Behavior. In: Martin, D., Serjantov, A. (eds.) PET 2004. LNCS, vol. 3424, pp. 329–343. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Knijnenburg, B.P., Willemsen, M.C., Hirtbach, S. (2010). Receiving Recommendations and Providing Feedback: The User-Experience of a Recommender System. In: Buccafurri, F., Semeraro, G. (eds) E-Commerce and Web Technologies. EC-Web 2010. Lecture Notes in Business Information Processing, vol 61. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15208-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-15208-5_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15207-8
Online ISBN: 978-3-642-15208-5
eBook Packages: Computer ScienceComputer Science (R0)