Dirk Bollen
Bart P. Knijnenburg
Martijn C. Willemsen
Mark Graus
ABSTRACT
Even though people are attracted by large, high quality recommendation sets, psychological research on choice overload shows that choosing an item from recommendation sets containing many attractive items can be a very difficult task. A web-based user experiment using a matrix factorization algorithm applied to the MovieLens dataset was used to investigate the effect of recommendation set size (5 or 20 items) and set quality (low or high) on perceived variety, recommendation set attractiveness, choice difficulty and satisfaction with the chosen item. The results show that larger sets containing only good items do not necessarily result in higher choice satisfaction compared to smaller sets, as the increased recommendation set attractiveness is counteracted by the increased difficulty of choosing from these sets. These findings were supported by behavioral measurements revealing intensified information search and increased acquisition times for these large attractive sets. Important implications of these findings for the design of recommender system user interfaces will be discussed.
Supplemental Material
- }}R. Dhar. The effect of decision strategy on deciding to defer choice. Journal of Behavioral Decision Making, 9(4):265--281, 1998.Google Scholar
Cross Ref
- }}K. Diehl and C. Poynor. Great Expectations?! Assortment Size, Expectations and Satisfaction. Journal of Marketing Research, 47(3):312--322, 2010.Google ScholarCross Ref
- }}B. Fasolo, R. Hertwig, M. Huber, and M. Ludwig. Size, entropy, and density: What is the difference that makes the difference between small and large real-world assortments. Psychology & Marketing, 26(3):254--79, 2009.Google ScholarCross Ref
- }}G. Häubl and V. Trifts. Consumer decision making in online shopping environments: The effects of interactive decision aids. Marketing Science, 19(1):4--21, 2000. Google ScholarDigital Library
- }}G. Haynes. Testing the boundaries of the choice overload phenomenon: The effect of number of options and time pressure on decision difficulty and satisfaction. Psychology and Marketing, 26(3):204--212, 2009.Google ScholarCross Ref
- }}J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems, 22(1):5--53, 2004. Google ScholarDigital Library
- }}S. S. Iyengar and M. R. Lepper. When choice is demotivating: Can one desire too much of a good thing? Journal of Personality and Social Psychology, 79(6):995--1006, 2000.Google ScholarCross Ref
- }}B. Knijnenburg, L. Meesters, P. Marrow, and D. Bouwhuis. User-Centric Evaluation Framework for Multimedia Recommender Systems. pages 366--369. Springer, 2010.Google Scholar
- }}B. P. Knijnenburg and M. C. Willemsen. Understanding the effect of adaptive preference elicitation methods on user satisfaction of a recommender system. In RecSys '09: Proceedings of the third ACM conference on Recommender systems, pages 381--384, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- }}B. P. Knijnenburg, M. C. Willemsen, and S. Hirtbach. Receiving recommendations and providing feedback: The user-experience of a recommender system. In Lecture Notes in Business Information Processing: Proceedings of the 11th International Conference on Electronic Commerce and Web Technologies, 2010 (in press).Google Scholar
- }}S. M. McNee, I. Albert, D. Cosley, P. Gopalkrishnan, S. K. Lam, A. M. Rashid, J. A. Konstan, and J. Riedl. On the recommending of citations for research papers. In CSCW '02: Proceedings of the 2002 ACM conference on Computer supported cooperative work, pages 116--125, New York, NY, USA, 2002. ACM. Google ScholarDigital Library
- }}S. M. McNee, J. Riedl, and J. A. Konstan. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI '06: CHI '06 extended abstracts on Human factors in computing systems, pages 1097--1101, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- }}E. Reutskaja and R. Hogarth. Satisfaction in choice as a function of the number of alternatives: When "goods satiate". Psychology and Marketing, 26(3):197--203, 2009.Google ScholarCross Ref
- }}B. Scheibehenne, R. Greifeneder, and P. Todd. Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload. Journal of Consumer Research, to be published in oktober 2010.Google Scholar
- }}B. Scheibehenne, R. Greifeneder, and P. Todd. What moderates the too-much-choice effect? Psychology and Marketing, 26(3):229--53, 2009.Google ScholarCross Ref
- }}B. Schwartz. The paradox of choice. Ecco New York, 2004.Google Scholar
- }}B. Schwartz. The tyranny of choice. Scientific American Mind, pages 70--75, 2004.Google ScholarCross Ref
- }}A. Shah and G. Wolford. Buying behavior as a function of parametric variation of number of choices. Psychological Science, 18(5):369--370, 2007.Google ScholarCross Ref
- }}I. Simonson. The effect of purchase quantity and timing on variety-seeking behavior. Journal of Marketing Research, 27(2):150--162, 1990.Google ScholarCross Ref
- }}E. Van Herpen and R. Pieters. The variety of an assortment: An extension to the attribute-based approach. Marketing Science, 21(3):331--341, 2002. Google ScholarDigital Library
- }}C.-N. Ziegler, S. M. McNee, J. A. Konstan, and G. Lausen. Improving recommendation lists through topic diversification. In WWW '05: Proceedings of the 14th international conference on World Wide Web, pages 22--32, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
Index Terms
- Understanding choice overload in recommender systems
Recommendations
Understanding the role of latent feature diversification on choice difficulty and satisfaction
People like variety and often prefer to choose from large item sets. However, large sets can cause a phenomenon called "choice overload": they are more difficult to choose from, and as a result decision makers are less satisfied with their choices. It ...
Choice overload and recommendation effectiveness in related-article recommendations: Analyzing the Sowiport digital library
AbstractChoice overload describes a situation in which a person has difficulty in making decisions due to too many options. We examine choice overload when displaying related-article recommendations in digital libraries, and examine the effectiveness of ...
Acquiring User Information Needs for Recommender Systems
WI-IAT '13: Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 03Most recommender systems attempt to use collaborative filtering, content-based filtering or hybrid approach to recommend items to new users. Collaborative filtering recommends items to new users based on their similar neighbours, and content-based ...
Comments