Skip to main content
SpringerLink
Log in

The effects of controllability and explainability in a social recommender system

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

In recent years, researchers in the field of recommender systems have explored a range of advanced interfaces to improve user interactions with recommender systems. Some of the major research ideas explored in this new area include the explainability and controllability of recommendations. Controllability enables end users to participate in the recommendation process by providing various kinds of input. Explainability focuses on making the recommendation process and the reasons behind specific recommendation more clear to the users. While each of these approaches contributes to making traditional “black-box” recommendation more attractive and acceptable to end users, little is known about how these approaches work together. In this paper, we investigate the effects of adding user control and visual explanations in a specific context of an interactive hybrid social recommender system. We present Relevance Tuner+, a hybrid recommender system that allows the users to control the fusion of multiple recommender sources while also offering explanations of both the fusion process and each of the source recommendations. We also report the results of a controlled study (N = 50) that explores the impact of controllability and explainability in this context.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Abdollahpouri, H., Adomavicius, G., Burke, R., Guy, I., Jannach, D., Kamishima, T., Krasnodebski, J., Pizzato, L.: Beyond personalization: Research directions in multistakeholder recommendation. arXiv preprint arXiv:190501986 (2019)

  • Ahn, Jw, Brusilovsky, P., Grady, J., He, D., Florian, R.: Semantic annotation based exploratory search for information analysts. Inf. Process. Manag. 46(4), 383–402 (2010)

    Article  Google Scholar 

  • Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P.N., Inkpen, K. et al.: Guidelines for human-AI interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, p. 3. ACM (2019)

  • Baeza-Yates, R., Ribeiro-Neto, B., et al.: Modern Information Retrieval, vol. 463. ACM Press, New York (1999)

    Google Scholar 

  • Bailey, S.M., Wei, J.A., Wang, C., Parra, D., Brusilovsky, P.: Cnvis: A web-based visual analytics tool for exploring conference navigator data. Electron. Imaging 2018(1), 1–11 (2018)

    Article  Google Scholar 

  • Bogers, T.: Tag-based recommendation. In: Brusilovsky, P., He, D. (eds.) Social Information Access: Systems and Technologies, pp. 441–479. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90092-6_12

    Chapter  Google Scholar 

  • Bostandjiev, S., O’Donovan, J., Höllerer, T.: Tasteweights: a visual interactive hybrid recommender system. In: Proceedings of the Sixth ACM Conference on Recommender Systems, pp. 35–42. ACM (2012)

  • Brusilovsky, P., Oh, J.S., López, C., Parra, D., Jeng, W.: Linking information and people in a social system for academic conferences. New Rev. Hypermedia Multimed. 23(2), 81–111 (2017). https://doi.org/10.1080/13614568.2016.1179796

    Article  Google Scholar 

  • Burke, R.: Hybrid web recommender systems. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web: Methods and Strategies of Web Personalization, pp. 377–408. Springer, Berlin, Heidelberg (2007). https://doi.org/10.1007/978-3-540-72079-9_12

    Chapter  Google Scholar 

  • Chen, J., Geyer, W., Dugan, C., Muller, M., Guy, I.: Make new friends, but keep the old: recommending people on social networking sites. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 201–210. ACM (2009)

  • Chen, L., Wang, F.: Explaining recommendations based on feature sentiments in product reviews. In: Proceedings of the 22nd International Conference on Intelligent User Interfaces, ACM, New York, NY, USA, IUI ’17, pp. 17–28 (2017). https://doi.org/10.1145/3025171.3025173

  • Clarke, C.L., Kolla, M., Cormack, G.V., Vechtomova, O., Ashkan, A., Büttcher, S., MacKinnon, I.: Novelty and diversity in information retrieval evaluation. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 659–666. ACM (2008)

  • Cramer, H., Evers, V., Ramlal, S., Van Someren, M., Rutledge, L., Stash, N., Aroyo, L., Wielinga, B.: The effects of transparency on trust in and acceptance of a content-based art recommender. User Model. User Adapt. Interact. 18(5), 455 (2008)

    Article  Google Scholar 

  • di Sciascio, C., Sabol, V., Veas, E.E.: Rank as you go: user-driven exploration of search results. In: Proceedings of the 21st International Conference on Intelligent User Interfaces, pp 118–129. ACM (2016)

  • di Sciascio, C., Brusilovsky, P., Veas, E.: A study on user-controllable social exploratory search. In: International Conference on Intelligent User Interfaces (2018)

  • Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., Hussmann, H.: Bringing transparency design into practice. In: 23rd International Conference on Intelligent User Interfaces, pp. 211–223. ACM (2018)

  • Ekstrand, M.D., Kluver, D., Harper, F.M., Konstan, J.A.: Letting users choose recommender algorithms: An experimental study. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 11–18. ACM (2015)

  • Gedikli, F., Jannach, D., Ge, M.: How should i explain? a comparison of different explanation types for recommender systems. Int. J. Hum. Comput. Stud. 72(4), 367–382 (2014)

    Article  Google Scholar 

  • Gretarsson, B., O’Donovan, J., Bostandjiev, S., Hall, C., Höllerer, T.: Smallworlds: visualizing social recommendations. In: Computer Graphics Forum, pp. 833–842. Wiley Online Library (2010)

  • Guy, I.: Social recommender systems. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 511–543. Springer, Boston, MA (2015). https://doi.org/10.1007/978-1-4899-7637-6_15

    Chapter  Google Scholar 

  • Guy, I.: People recommendation on social media. In: Brusilovsky, P., He, D. (eds.) Social Information Access: Systems and Technologies, pp. 570–623. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90092-6_15

    Chapter  Google Scholar 

  • Guy, I., Ronen, I., Wilcox, E.: Do you know?: recommending people to invite into your social network. In: Proceedings of the 14th International Conference on Intelligent User Interfaces, pp. 77–86. ACM (2009)

  • Han, S., He, D., Jiang, J., Yue, Z.: Supporting exploratory people search: a study of factor transparency and user control. In: Proceedings of the 22nd ACM International Conference on Information & Knowledge Management, pp. 449–458. ACM (2013)

  • Harper, F.M., Xu, F., Kaur, H., Condiff, K., Chang, S., Terveen, L.: Putting users in control of their recommendations. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 3–10. ACM (2015)

  • He, C., Parra, D., Verbert, K.: Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Expert Syst. Appl. 56, 9–27 (2016)

    Article  Google Scholar 

  • Herlocker, J.L., Konstan, J.A., Riedl, J.: Explaining collaborative filtering recommendations. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 241–250. ACM (2000)

  • Jannach, D., Naveed, S., Jugovac, M.: User control in recommender systems: overview and interaction challenges. In: International Conference on Electronic Commerce and Web Technologies, pp. 21–33. Springer (2016)

  • Keane, M., O’Brien, M., Smyth, B.: Are people biased in their use of search engines? Commun. ACM 51(2), 49–52 (2008)

    Article  Google Scholar 

  • Kluver, D., Ekstrand, M.D., Konstan, J.A.: Rating-based collaborative filtering: algorithms and evaluation. In: Brusilovsky, P., He, D. (eds.) Social Information Access: Systems and Technologies, pp. 344–390. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90092-6_10

    Chapter  Google Scholar 

  • Knijnenburg, B.P., Willemsen, M.C.: Evaluating recommender systems with user experiments. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 309–352. Springer, Boston, MA (2015). https://doi.org/10.1007/978-1-4899-7637-6_9

    Chapter  Google Scholar 

  • Knijnenburg, B.P., Bostandjiev, S., O’Donovan, J., Kobsa, A.: Inspectability and control in social recommenders. In: Proceedings of the Sixth ACM Conference on Recommender Systems, pp. 43–50. ACM (2012)

  • Kobsa, A., Koenemann, J., Pohl, W.: Personalised hypermedia presentation techniques for improving online customer relationships. Knowl. Eng. Rev. 16(2), 111–155 (2001)

    Article  Google Scholar 

  • Kouki, P., Schaffer, J., Pujara, J., O’Donovan, J., Getoor, L.: User preferences for hybrid explanations. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 84–88. ACM (2017)

  • Lee, D., Brusilovsky, P.: Recommendations based on social links. In: Brusilovsky, P., He, D. (eds.) Social Information Access: Systems and Technologies, pp. 391–440. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90092-6_11

    Chapter  Google Scholar 

  • Manning, C., Raghavan, P., Schütze, H.: Introduction to information retrieval. Nat. Lang. Eng. 16(1), 100–103 (2010)

    Article  Google Scholar 

  • Musto, C., Narducci, F., Lops, P., de Gemmis, M., Semeraro, G.: Linked open data-based explanations for transparent recommender systems. Int. J. Hum. Comput. Stud. 121, 93–107 (2019a)

    Article  Google Scholar 

  • Musto, C., Rossiello, G., de Gemmis, M., Lops, P., Semeraro, G.: Combining text summarization and aspect-based sentiment analysis of users’ reviews to justify recommendations. In: Proceedings of the 13th ACM Conference on Recommender Systems, pp. 383–387 (2019b)

  • O’Donovan, J., Smyth, B., Gretarsson, B., Bostandjiev, S., Höllerer, T.: Peerchooser: visual interactive recommendation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1085–1088. ACM (2008)

  • O’Donovan, J., Gretarsson, B., Bostandjiev, S., Hollerer, T., Smyth, B.: A visual interface for social information filtering. In: International Conference on Computational Science and Engineering, 2009. CSE’09. vol. 4, pp. 74–81. IEEE (2009)

  • O’Mahony, M.P., Smyth, B.: From opinions to recommendations. In: Brusilovsky, P., He, D. (eds.) Social Information Access: Systems and Technologies, pp. 480–509. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90092-6_13

    Chapter  Google Scholar 

  • Papadimitriou, A., Symeonidis, P., Manolopoulos, Y.: A generalized taxonomy of explanations styles for traditional and social recommender systems. Data Min. Knowl. Discov. 24(3), 555–583 (2012)

    Article  Google Scholar 

  • Parra, D., Brusilovsky, P.: User-controllable personalization: a case study with setfusion. Int. J. Hum. Comput. Stud. 78, 43–67 (2015)

    Article  Google Scholar 

  • Pu, P., Chen, L.: Trust-inspiring explanation interfaces for recommender systems. Knowl. Based Syst. 20(6), 542–556 (2007)

    Article  Google Scholar 

  • Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of the Fifth ACM Conference on Recommender Systems, pp. 157–164. ACM (2011)

  • Schafer, J.B., Konstan, J.A., Riedl, J.: Meta-recommendation systems: user-controlled integration of diverse recommendations. In: Proceedings of the Eleventh International Conference on Information and Knowledge Management, pp. 43–51. ACM (2002)

  • Schaffer, J., O’Donovan, J., Michaelis, J., Raglin, A., Höllerer, T.: I can do better than your ai: expertise and explanations. In: IUI, pp. 240–251 (2019)

  • Sharma, A., Cosley, D.: Do social explanations work?: studying and modeling the effects of social explanations in recommender systems. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 1133–1144. ACM (2013)

  • Sie, R.L., Drachsler, H., Bitter-Rijpkema, M., Sloep, P.: To whom and why should i connect? co-author recommendation based on powerful and similar peers. Int. J. Technol. Enhanc. Learn. 4(1/2), 121–137 (2012)

    Article  Google Scholar 

  • Swearingen, K., Sinha, R.: Beyond algorithms: an HCI perspective on recommender systems. In: ACM SIGIR 2001 Workshop on Recommender Systems (2001)

  • Tintarev, N., Masthoff, J.: Designing and evaluating explanations for recommender systems. In: Ricci, F., Rokach, L., Shapira, B., Kantor, P.B. (eds.) Recommender Systems Handbook, pp. 479–510. Springer, Boston, MA (2011). https://doi.org/10.1007/978-0-387-85820-3_15

    Chapter  Google Scholar 

  • Tintarev, N., Masthoff, J.: Evaluating the effectiveness of explanations for recommender systems. User Model. User Adapt. Inter. 22(4–5), 399–439 (2012)

  • Tintarev, N., Masthoff, J.: Explaining recommendations: design and evaluation. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 353–382. Springer, Boston, MA (2015). https://doi.org/10.1007/978-1-4899-7637-6_10

    Chapter  Google Scholar 

  • Tsai, C.H., Brusilovsky, P.: Providing control and transparency in a social recommender system for academic conferences. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, pp. 313–317. ACM (2017)

  • Tsai, C.H., Brusilovsky, P.: Beyond the ranked list: User-driven exploration and diversification of social recommendation. In: 23rd International Conference on Intelligent User Interfaces, IUI ’18, pp. 239–250 (2018)

  • Tsai, C.H., Brusilovsky, P.: Designing explanation interfaces for transparency and beyond. In: Workshop on Intelligent User Interfaces for Algorithmic Transparency in Emerging Technologies (2019a)

  • Tsai, C.H., Brusilovsky, P.: Evaluating visual explanations for similarity-based recommendations: User perception and performance. In: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, pp. 22–30. ACM (2019b)

  • Tsai, C.H., Brusilovsky, P.: Explaining recommendations in an interactive hybrid social recommender. In: Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 391–396. ACM (2019c)

  • Verbert, K., Parra, D., Brusilovsky, P., Duval, E.: Visualizing recommendations to support exploration, transparency and controllability. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 351–362. ACM (2013)

  • Vig, J., Sen, S., Riedl, J.: Tagsplanations: explaining recommendations using tags. In: Proceedings of the 14th International Conference on Intelligent User Interfaces, pp. 47–56. ACM (2009)

  • Wang, W., Benbasat, I.: Recommendation agents for electronic commerce: effects of explanation facilities on trusting beliefs. J. Manag. Inf. Syst. 23(4), 217–246 (2007)

    Article  Google Scholar 

  • Wu, Y., Ester, M.: Flame: a probabilistic model combining aspect based opinion mining and collaborative filtering. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, ACM, New York, NY, USA, WSDM ’15, pp. 199–208 (2015) https://doi.org/10.1145/2684822.2685291

Download references

Author information

Authors and Affiliations

  1. The Pennsylvania State University, State College, PA, USA

    Chun-Hua Tsai

  2. University of Pittsburgh, Pittsburgh, PA, USA

    Peter Brusilovsky

Authors
  1. Chun-Hua Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter Brusilovsky
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chun-Hua Tsai.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tsai, CH., Brusilovsky, P. The effects of controllability and explainability in a social recommender system. User Model User-Adap Inter 31, 591–627 (2021). https://doi.org/10.1007/s11257-020-09281-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-020-09281-5

Keywords

Search

Navigation