Abstract
This paper reports on the use of transparency in recommender a system that facilitates serendipitous encounters for users. Currently, there are serendipitous recommender systems that facilitate serendipitous encounters; however, there are no studies on the connection-making process or on the process of achieving connection-making through a user interface design. Adding to our previous work on connection-making and serendipity-facilitating recommender systems, we examine transparency in recommender systems as it relates to connection-making we studied transparency of recommendations to foster connection-making. This study is novel as it introduces a new user interface design for recommender system in academia and new study methods and approaches and studies a large group of users who are using this recommender system. The user interface components such as bubble messages on recommender system mechanism, user controls on manipulating the recommender system outcomes and showing authors work addition to recommendation. Repeated measure design of research was used to study serendipity and task load among users for Google Scholar and JabRef related work user interface (User interface developed for Experiment). Subjective evaluation of user interface was done along with NASA-Task Load Index for workload measurement. Further sentiment analysis was conducted for validations of findings. Our study finds that serendipitous recommendations and user satisfaction is facilitated via transparency in recommender systems. Furthermore, we found that transparency enhances interactivity for users who are looking for novel and useful recommendations related to their work. This work contributes to human computer interaction studies of recommender systems and reviews the leading literature on transparency, serendipity, and recommender systems in learning environments.
Similar content being viewed by others
References
Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749
Afridi AH (2018a) Stakeholders analysis for serendipitous recommenders system in learning environments. Procedia Computer Science 130:222–230. https://doi.org/10.1016/j.procs.2018.04.033
Afridi AH (2018b) User control and serendipitous recommendations in learning environments. The 9th international conference on ambient systems, networks and technologies (ANT 2018). Porto: Elsevier B.V
Afridi AH (2018c) Visualizing serendipitous recommendations in user controlled recommender system for learning. Procedia Computer Science 141:496–502. https://doi.org/10.1016/j.procs.2018.10.136
Afridi AH (2019a) Serendipitous recommenders for teachers in higher education. In Handbook of research on faculty development for digital teaching and learning. IGI
Afridi AH (2019b) Transparency for beyond-accuracy experiences: a novel user interface for recommender systems. 10th international conference on ambient systems, networks and technologies (ANT-2019). Elsevier B.V
Afridi AH, Yasar A, Shakshuki EM (2019) Facilitating research through serendipity of recommendations. Journal of Ambient Intelligence and Humanized Computing. https://doi.org/10.1007/s12652-019-01354-7
Beel J, Gipp B, Langer S, Genzmehr M, Wilde E, Nürnberger A, Pitman J (2011) Introducing Mr. DLib,. Proceeding of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries - JCDL ‘11, (January), 463. https://doi.org/10.1145/1998076.1998187
Burke R (2002) Hybrid recommender systems: survey and experiments. User Model User-Adap Inter 12(4):331–370
Drachsler H, Verbert K, Santos O, Manouselis N (2015) Panorama of recommender systems to support learning. Springer
Fazeli S, Drachsler H, Bitter-Rijpkema M, Brouns F, van der V W, Sloep PB (2016) Accuracy is just the tip of the iceberg: a data-centric vs. user-centric evaluation. IEEE Transaction onLearning Technologies 11(3):294–306
Feyer S, Siebert S, Gipp B, Aizawa A, Beel J (2017) Integration of the scientific recommender system Mr. DLib into the reference manager JabRef European Conference on Information Retrieval, 770–774
Goodman B, Flaxman S (2016) European Union regulations on algorithmic decision-making and a “right to explanation.” https://doi.org/10.1609/aimag.v38i3.2741
Hart SG, Staveland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload (pp. 139–183). https://doi.org/10.1016/S0166-4115(08)62386-9
He C, Parra D, Verbert K (2016a) Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Expert Syst Appl 56:9–27. https://doi.org/10.1016/j.eswa.2016.02.013
He C, Parra D, Verbert K (2016b) Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Expert Syst Appl 56:9–27. https://doi.org/10.1016/j.eswa.2016.02.013
Kefalidou G, Sharples S (2016) Encouraging serendipity in research: designing technologies to support connection-making. Int J Hum Comput Stud 89:1–23. https://doi.org/10.1016/j.ijhcs.2016.01.003
Kizilcec RF (2016) How much information?: effects of transparency on trust in an algorithmic interface. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ‘16. https://doi.org/10.1145/2858036.2858402
Kotkov D, Veijalainen J, Wang S (2016a) Challenges of serendipity in recommender systems. Proceedings of the 12th international conference on web information systems and technologies, 251–256. https://doi.org/10.5220/0005879802510256
Kotkov D, Wang S, Veijalainen J (2016b) A survey of serendipity in recommender systems. Know-Based Syst 111(C):180–192. https://doi.org/10.1016/j.knosys.2016.08.014
Kotkov D, Konstan JA, Zhao Q, Veijalainen J (2018) Investigating serendipity in recommender systems based on real user feedback. Proceedings of the 33rd Annual ACM Symposium on Applied Computing - SAC ‘18. https://doi.org/10.1145/3167132.3167276
McCay-Peet L, Toms EG, Kelloway EK (2015) Examination of relationships among serendipity, the environment, and individual differences. Inf Process Manage 51(4):391–412. https://doi.org/10.1016/j.ipm.2015.02.004
Nasa (2006) NASA Task Load Index. Human Mental Workload 1(6):21–21. https://doi.org/10.1055/s-0028-1097222
Resnick P, Varian HR (1997) Recommender systems. Commun ACM 40(3):56–59
Sato M, Ahsan B, Nagatani K, Sonoda T, Zhang Q, Ohkuma T (2018) Explaining recommendations using contexts. Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - IUI ‘18. https://doi.org/10.1145/3172944.3173012
Sinha R, Swearingen K (2002) The role of transparency in recommender systems. CHI ‘02 Extended Abstracts on Human Factors in Computing Systems, 830–831. https://doi.org/10.1145/506443.506619
Sugiyama K, Kan M-Y (2011) Serendipitous recommendation for scholarly papers considering relations among researchers. Proceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries, 307–310. https://doi.org/10.1145/1998076.1998133
Thudt A, Hinrichs U, Carpendale S (2012) The bohemian bookshelf: supporting serendipitous book discoveries through information visualization. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1461–1470. https://doi.org/10.1145/2207676.2208607
Tintarev N, Masthoff J (2012) Evaluating the effectiveness of explanations for recommender systems. User Model User-Adap Inter 22(4–5):399–439. https://doi.org/10.1007/s11257-011-9117-5
Tsai C-H (2018) Diversity-enhanced recommendation interface and evaluation. Proceedings of the 2018 Conference on Human Information Interaction & Retrieval, 360–362. https://doi.org/10.1145/3176349.3176357
Tsai C-H, Brusilovsky P (2018a) Beyond the ranked list: user-driven exploration and diversification of social recommendation. 23rd international conference on intelligent user interfaces, 239–250
Tsai C-H, Brusilovsky P (2018b) Beyond the ranked list: user-driven exploration and diversification of social recommendation. Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - IUI ‘18, Part F1351, 239–250. https://doi.org/10.1145/3172944.3172959
Verbert K, Manouselis N, Xavier O, Wolpers M, Drachsler H, Ivana B, Duval E (2012) Context-aware recommender systems for learning: Asurvey and future challenges. IEEE Transactions on Learning Technologies (TLT) 5(4):318–335 Retrieved from http://dspace.ou.nl/handle/1820/3855
Verbert K, Parra D, Brusilovsky P, Duval E (2013) Visualizing recommendations to support exploration, transparency and controllability. Proceedings of the 2013 international conference on intelligent user interfaces, 351–362. https://doi.org/10.1145/2449396.2449442
Verbert K, Brusilovsky P, Wongchokprasitti C, Parra D, Cardoso B (2017) Supporting conference attendees with visual decision making interfaces. Proceedings of the 22Nd international conference on intelligent user interfaces companion, 161–164. https://doi.org/10.1145/3030024.3038273
Acknowledgments
The authors would like to extend their appreciation to Zayed University, UAE, for funding this research under the Cluster Research Grant # R17075.
The authors would like to extend their appreciation to Institute of Management Sciences, Peshawar, Pakistan.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
ANNEXTURE
ANNEXTURE
Users Comments for the User Interface Improvements for JabRef-related Work Tab Developed for This Experiment.
-
User interface is very helpful and informative for researchers and schools, but I suggest toadd an option at year wise recommendation. User interface data was highly helpful
-
User interface is good but should be more clear,self-explanatory
-
The user interface is simple and graphic support product is efficient
-
Simple UI, need color change and click count, and paper clicked portion can be at the bottom of UI. The data suggested were seems useful to use
-
It’s good. UI is good, search should be more wide
-
Filter feature, future work not showing
-
He has put some pages work on a single platform it’s more helpful for research field. Beautifully arranged, very impressive
-
The UI is overall good, if there is a filter by year by research field that would be more user-friendly
-
It is a productive software
-
Color theme is a bit dull, otherwise it’s good. Interface is a bit scattered
-
The interface is better and easy to use. I think you need to add at least 10 papers at a time to see in reviews, which is related to key
-
The graph is easy to understand, shows more detail about the research. Interfaces are good, show research paper recommendations
-
To the point, interesting graphs, easy to use, colors are little dull. 7 m time taken, 1 page viewed
-
All type of graphical things can be displayed on it, easier to get related documents. Make a graph to explore the author profile which is based on citation
-
Filter must be included,conclusion of articles, too dark, it must be brighter so it should be clearly visible
-
User-friendly. Is easy should also have conclusion. Charts in bar are friendly
-
Interface is good but need some color changes and titles for charts
-
Color themes used are hard which creates visibility problems. It’s possible the contents should be covered in available screen site rather than scrolling
-
Search field is required
-
Good, but if the search paper will categorize into 3 to 4 stages like abstract, introduction, explanation or working and conclusion individually
Rights and permissions
About this article
Cite this article
Afridi, A.H., Outay, F. Triggers and connection-making for serendipity via user interface in recommender systems. Pers Ubiquit Comput 25, 77–92 (2021). https://doi.org/10.1007/s00779-020-01371-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-020-01371-w