skip to main content
10.1145/3617023.3617051acmotherconferencesArticle/Chapter ViewAbstractPublication PageswebmediaConference Proceedingsconference-collections
short-paper

A User Study on Explanations with Different Levels of Detail in Recommender Systems

Published:23 October 2023Publication History

ABSTRACT

Explanations are a useful feature to improve the transparency and reliability of recommender systems. However, the amount of information presented to the user regarding a recommendation is an important parameter that is not usually considered. On the one hand, large explanations may carry more information than the users would like, which could be a potential case of the information overload problem. Similarly, if short explanations are provided, some users may find insufficient information to make decisions. In this context, our main objective is to analyze perceptions of users that were presented to explanations with varying level of detail. In our validation process, we conducted user experiments and identified a correlation between users reporting that the ability to choose the level of detail in the explanation aids in finding a recommendation that aligns with their interests, and their subsequent acceptance of the recommendation.

References

  1. Charu C Aggarwal 2016. Recommender systems. Vol. 1. Springer, New York.Google ScholarGoogle Scholar
  2. Ramesh Baral, XiaoLong Zhu, S. S. Iyengar, and Tao Li. 2018. ReEL: Review Aware Explanation of Location Recommendation. In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization (Singapore, Singapore) (UMAP ’18). Association for Computing Machinery, New York, NY, USA, 23––32. https://doi.org/10.1145/3209219.3209237Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Mohamed Amine Chatti, Mouadh Guesmi, Laura Vorgerd, Thao Ngo, Shoeb Joarder, Qurat Ul Ain, and Arham Muslim. 2022. Is More Always Better? The Effects of Personal Characteristics and Level of Detail on the Perception of Explanations in a Recommender System. In Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization (Barcelona, Spain) (UMAP ’22). Association for Computing Machinery, New York, NY, USA, 254–264. https://doi.org/10.1145/3503252.3531304Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Martijn Millecamp, Cristina Conati, and Katrien Verbert. 2022. "Knowing me, knowing you": personalized explanations for a music recommender system. User Model. User Adapt. Interact. 32, 1-2 (2022), 215–252. https://doi.org/10.1007/s11257-021-09304-9Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Martijn Millecamp, Nyi Nyi Htun, Cristina Conati, and Katrien Verbert. 2019. To Explain or Not to Explain: The Effects of Personal Characteristics When Explaining Music Recommendations. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 397––407. https://doi.org/10.1145/3301275.3302313Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Cataldo Musto, Pasquale Lops, Marco de Gemmis, and Giovanni Semeraro. 2019. Justifying Recommendations through Aspect-Based Sentiment Analysis of Users Reviews. In Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization (Larnaca, Cyprus) (UMAP ’19). Association for Computing Machinery, New York, NY, USA, 4––12. https://doi.org/10.1145/3320435.3320457Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cataldo Musto, Gaetano Rossiello, Marco de Gemmis, Pasquale Lops, and Giovanni Semeraro. 2019. Combining Text Summarization and Aspect-Based Sentiment Analysis of Users’ Reviews to Justify Recommendations. In Proceedings of the 13th ACM Conference on Recommender Systems (Copenhagen, Denmark) (RecSys ’19). Association for Computing Machinery, New York, NY, USA, 383–387. https://doi.org/10.1145/3298689.3347024Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Arpit Rana and Derek Bridge. 2018. Explanations That Are Intrinsic to Recommendations. In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization (Singapore, Singapore) (UMAP ’18). Association for Computing Machinery, New York, NY, USA, 187–195. https://doi.org/10.1145/3209219.3209230Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Francesco Ricci, Lior Rokach, and Bracha Shapira. 2015. Recommender Systems: Introduction and Challenges. Springer US, Boston, MA, 1–34. https://doi.org/10.1007/978-1-4899-7637-6_1Google ScholarGoogle ScholarCross RefCross Ref
  10. Luan Soares de Souza and Marcelo Garcia Manzato. 2022. Aspect-Based Summarization: An Approach With Different Levels of Details to Explain Recommendations. In Proceedings of the Brazilian Symposium on Multimedia and the Web (Curitiba, Brazil) (WebMedia ’22). Association for Computing Machinery, New York, NY, USA, 202–210. https://doi.org/10.1145/3539637.3557002Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Nava Tintarev and Judith Masthoff. 2015. Explaining Recommendations: Design and Evaluation. Springer US, Boston, MA, 353–382. https://doi.org/10.1007/978-1-4899-7637-6_10Google ScholarGoogle ScholarCross RefCross Ref
  12. Yongfeng Zhang and Xu Chen. 2020. Explainable Recommendation: A Survey and New Perspectives. Foundations and Trends® in Information Retrieval 14, 1 (2020), 1–101. https://doi.org/10.1561/1500000066Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A User Study on Explanations with Different Levels of Detail in Recommender Systems

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            WebMedia '23: Proceedings of the 29th Brazilian Symposium on Multimedia and the Web
            October 2023
            285 pages
            ISBN:9798400709081
            DOI:10.1145/3617023

            Copyright © 2023 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 23 October 2023

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • short-paper
            • Research
            • Refereed limited

            Acceptance Rates

            Overall Acceptance Rate270of873submissions,31%
          • Article Metrics

            • Downloads (Last 12 months)20
            • Downloads (Last 6 weeks)2

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader