Abstract
Recommender systems are used to suggest items that are useful to users. The recommendations can be surprising and may be categorized as serendipitous recommendations. One of the limitations with serendipitous recommendations is that the user interface of such a recommender system rarely supports the user to switch from accuracy orientation to serendipity facilitations. Using serendipitous recommendations can be challenging. This is because the user might not fully benefit from and understand the serendipitous recommendations. One main advantage of this type of system is that a serendipity-oriented recommender system can be used for the supervision of research students. It can help them to find a novel topic in the area of their research interests. This paper reports on a novel user interface design for facilitating serendipitous recommendations generation in educational environments. The user interface of this recommender system provides students with user controls and visualization in order to explore research articles. This research comprises user experience experiments conducted in an academic environment and evaluated by means of a user centered design evaluation. It involves research articles recommender system named JabRef. The recommender systems were used by students at the undergraduate level. Users reported an enhanced user experience while using the user controls and visualization and serendipitous resource discovery. It was found that user interface design can facilitate a serendipity recommender system in the learning environment. University professors supervising students during the research can also benefit from the recommender system.
Similar content being viewed by others
References
Afridi AH (2018a) Stakeholders analysis for serendipitous recommenders system in learning environments. Proced Comput Sci 130:222–230. https://doi.org/10.1016/j.procs.2018.04.033
Afridi AH (2018b) User control and serendipitous recommendations in learning environments. Proced Comput Sci. https://doi.org/10.1016/j.procs.2018.04.032
Afridi AH (2018c) Visualizing serendipitous recommendations in user controlled recommender system for learning. Proced Comput Sci 141:496–502. https://doi.org/10.1016/j.procs.2018.10.136
Afridi AH (2019a) Serendipitous recommenders for teachers in higher education. In: Handbook of research on faculty development for digital teaching and learning. IGI Global, Hershey
Afridi AH (2019b) Transparency for beyond-accuracy experiences a novel user interface for recommender systems. In: 10th International conference on ambient systems, networks and technologies (ANT-2019), Elsevier B.V
Alexander E, Kohlmann J, Valenza R, Witmore M, Gleicher M (2015) Serendip: topic model-driven visual exploration of text corpora. In: 2014 IEEE conference on visual analytics science and technology, VAST 2014—proceedings, pp 173–182. https://doi.org/10.1109/VAST.2014.7042493
Bach B, Sicat R, Pfister H, Quigley A (2017) Drawing into the AR-Canvas: designing embedded visualizations for augmented reality. In: Workshop on immersive analytics, IEEE vis. http://www.aviz.fr/~bbach/arcanvas/Bach2017arcanvas.pdf. Accessed May 2019
Beel J, Gipp B, Langer S, Genzmehr M, Wilde E, Nürnberger A, Pitman J (2011) Introducing Mr. DLib. In: Proceeding of the 11th annual international ACM/IEEE joint conference on digital libraries—JCDL’11, January, p 463. https://doi.org/10.1145/1998076.1998187
Beel J, Langer S, Genzmehr M, Gipp B, Breitinger C, Nürnberger A (2013) Research paper recommender system evaluation: a quantitative literature survey. In: Proceedings of the international workshop on reproducibility and replication in recommender systems evaluation, New York, NY, USA: ACM, pp 15–22. https://doi.org/10.1145/2532508.2532512
Beel J, Gipp B, Langer S, Breitinger C (2015) Research-paper recommender systems: a literature survey. Int J Digit Libr. https://doi.org/10.1007/s00799-015-0156-0
Bruns S, Valdez AC, Greven C, Ziefle M, Schroeder U (2015) What should i read next? A personalized visual publication recommender system. In: Yamamoto S (ed) Human interface and the management of information. Information and knowledge in context. Springer International Publishing, Cham, pp 89–100
Calero Valdez A, Bruns S, Greven C, Schroeder U, Ziefle M (2015) What do my colleagues know? Dealing with cognitive complexity in organizations through visualizations. In: Zaphiris P, Ioannou A (eds) Learning and collaboration technologies. Springer International Publishing, Cham, pp 449–459
Chiu YS, Lin KH, Chen JS (2011) A social network-based serendipity recommender system. In: 2011 International symposium on intelligent signal processing and communications systems: “the decade of intelligent and green signal processing and communications”, ISPACS 2011. https://doi.org/10.1109/ISPACS.2011.6146073
Cleverley P, Burnett S (2015) Creating sparks: comparing search results using discriminatory search term word co-occurrence to facilitate serendipity in the enterprise. J Inf Knowl Manag. https://doi.org/10.1142/S0219649215500070
de Gemmis M, Lops P, Semeraro G, Musto C (2015) An investigation on the serendipity problem in recommender systems. Inf Process Manag 51(5):695–717. https://doi.org/10.1016/j.ipm.2015.06.008
Drachsler H (2011) Recommender systems and learning analytics in TEL
Drachsler H, Bogers T, Vuorikari R, Verbert K, Duval E, Manouselis N, Wolpers M (2010) Issues and considerations regarding sharable data sets for recommender systems in technology enhanced learning. Proced Comput Sci 1(2):2849–2858. https://doi.org/10.1016/j.procs.2010.08.010
Drachsler H, Verbert K, Santos O, Manouselis N (2015) Panorama of recommender systems to support learning. Springer, Boston
Dumas B, Moerman B, Trullemans S, Signer B (2014) ArtVis: combining advanced visualisation and tangible interaction for the exploration, analysis and browsing of digital artwork collections. In: Proceedings of the workshop on advanced visual interfaces AVI. https://doi.org/10.1145/2598153.2598159
Ekstrand MD, Kluver D, Harper FM, Konstan JA (2015) Letting users choose recommender algorithms: an experimental study. In: Proceedings of the 9th ACM conference on recommender systems, New York, NY, USA: ACM, pp 11–18. https://doi.org/10.1145/2792838.2800195
Erdt M, Fernandez A, Rensing C (2015) Evaluating recommender systems for technology enhanced learning: a quantitative survey. IEEE Trans Learn Technol. https://doi.org/10.1109/TLT.2015.2438867
Harper FM, Xu F, Kaur H, Condiff K, Chang S, Terveen L (2015) Putting users in control of their recommendations. In: Proceedings of the 9th ACM conference on recommender systems, New York, NY, USA: ACM, pp 3–10. https://doi.org/10.1145/2792838.2800179
He C, Parra D, Verbert K (2016) Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2016.02.013
Hinrichs U, Forlini S, Moynihan B (2016) Speculative practices: utilizing InfoVis to explore untapped literary collections. IEEE Trans Vis Comput Gr 22(1):429–438. https://doi.org/10.1109/TVCG.2015.2467452
Jiang L, Cheng Y, Yang L, Li J, Yan H, Wang X (2018) A trust-based collaborative filtering algorithm for E-commerce recommendation system. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-018-0928-7
Kaklauskas A, Zavadskas EK, Seniut M, Stankevic V, Raistenskis J, Simkevičius C, Gribniak V (2013) Recommender system to analyze student’s academic performance. Expert Syst Appl 40(15):6150–6165
Kim HM, Ghiasi B, Spear M, Laskowski M, Li J (2017) Online serendipity: the case for curated recommender systems. Bus Horiz 60(5):613–620. https://doi.org/10.1016/j.bushor.2017.05.005
Kleiner E, Rädle R, Reiterer H (2013) Blended shelf: reality-based presentation and exploration of library collections. In: Extended abstracts of the international conference on human factors in computing systems (CHI’13), pp 577–582. https://doi.org/10.1145/2468356.2468458
Knijnenburg BP, Willemsen MC (2015) Evaluating recommender systems with user experiments. Recommender systems handbook, 2nd edn. Springer, Boston. https://doi.org/10.1007/978-1-4899-7637-6_9
Kotkov D, Wang S, Veijalainen J (2016) A survey of serendipity in recommender systems. Knowl Based Syst 111:180–192. https://doi.org/10.1016/j.knosys.2016.08.014
Lu J, Wu D, Mao M, Wang W, Zhang G (2015) Recommender system application developments: a survey. Decis Support Syst. https://doi.org/10.1016/j.dss.2015.03.008
Maksai A, Garcin F, Faltings B (2015) Predicting online performance of news recommender systems through richer evaluation metrics. In: Proceedings of the 9th ACM conference on recommender systems, New York, NY, USA: ACM, pp 179–186. https://doi.org/10.1145/2792838.2800184
Mark B, Ronald S, Marcus F (2013) Gelatine: making coworking places gel for better collaboration and social learning. In: Proceedings of the 25th Australian computer-human interaction conference: augmentation, application, innovation, collaboration, pp 427–436. https://doi.org/10.1145/2541016.2541027
Mashal I, Alsaryrah O, Chung T-Y (2016) Testing and evaluating recommendation algorithms in internet of things. J Ambient Intell Humaniz Comput 7(6):889–900. https://doi.org/10.1007/s12652-016-0357-4
Maxwell D, Woods M, Makri S, Bental D, Kefalidou G, Sharples S (2012) Designing a semantic sketchbook to create opportunities for serendipity. Proc BCS HCI 2012:357–362
McCay-Peet L, Toms EG, Kelloway EK (2015) Examination of relationships among serendipity, the environment, and individual differences. Inf Process Manag 51(4):391–412. https://doi.org/10.1016/j.ipm.2015.02.004
McKay D, Buchanan G, Chang S (2015) Tyranny of distance: understanding academic library browsing by refining the neighbour effect. In: Kapidakis S, Mazurek C, Werla M (eds) Research and advanced technology for digital libraries. Springer International Publishing, Cham, pp 280–294
Melville P, Sindhwani V (2010) Recommender systems. In: Sammut C, Webb GI (eds) Encyclopedia of machine learning. Springer, Boston, pp 829–838. https://doi.org/10.1007/978-0-387-30164-8_705
Murakami T, Mori K, Orihara R (2008) Metrics for evaluating the serendipity of recommendation lists. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 4914, LNAI, pp 40–46. https://doi.org/10.1007/978-3-540-78197-4_5
Pang PCI, Verspoor K, Pearce J, Chang S (2015) Better health explorer: designing for health information seekers. In: Proceedings of the annual meeting of the Australian special interest group for computer human interaction, New York, NY, USA: ACM, pp 588–597. https://doi.org/10.1145/2838739.2838772
Park J-H (2019) Resource recommender system based on psychological user type indicator. J Ambient Intell Humaniz Comput 10(1):27–39. https://doi.org/10.1007/s12652-017-0583-4
Parra D, Brusilovsky P (2015) User-controllable personalization. Int J Hum Comput Stud 78:43–67. https://doi.org/10.1016/j.ijhcs.2015.01.007
Pla Karidi D, Stavrakas Y, Vassiliou Y (2018) Tweet and followee personalized recommendations based on knowledge graphs. J Ambient Intell Humaniz Comput 9(6):2035–2049. https://doi.org/10.1007/s12652-017-0491-7
Pu P, Chen L (2010) A user-centric evaluation framework of recommender systems. In: CEUR workshop proceedings, vol 612, pp 14–21. https://doi.org/10.1145/2043932.2043962
Pu P, Chen L, Hu R (2012) Evaluating recommender systems from the user’s perspective: survey of the state of the art. User Model User Adapt Interact 22(4–5):317–355. https://doi.org/10.1007/s11257-011-9115-7
Rädle R, Weiler A, Huber S, Jetter HC, Mansmann S, Reiterer H, Scholl MH (2012) eBook meets tabletop: using collaborative visualization for search and serendipity in on-line book repositories. In: Proceedings of the workshop on research advances in large digital book repositories and complementary media (BooksOnline’12), pp 3–6. https://doi.org/10.1145/2390116.2390120
Shani G, Gunawardana A (2011) Evaluating recommendation systems. Recommender systems handbook. Springer, Boston, pp 257–298. https://doi.org/10.1007/978-0-387-85820-3_8
Thudt A, Hinrichs U, Carpendale S (2012) The Bohemian Bookshelf: supporting serendipitous book discoveries through information visualization. In: Proceedings of the SIGCHI conference on human factors in computing systems, New York, NY, USA: ACM, pp 1461–1470. https://doi.org/10.1145/2207676.2208607
Thudt A, Hinrichs U, Carpendale S (2015) A modular approach to promote creativity and inspiration in search. Proceedings of the 2015 ACM SIGCHI conference on creativity and cognition—C&C’15, pp 245–254. https://doi.org/10.1145/2757226.2757253
Verbert K, Ochoa X, Bosnic I, Duval E (2007) Recommender systems for learning: a data-oriented survey and future challenges. Network 6(1):1–20
Verbert K, Manouselis N, Ochoa X, Wolpers M, Drachsler H, Bosnic I, Duval E (2012) Context-aware recommender systems for learning: a survey and future challenges. IEEE Trans Learn Technol 6(1): 2007. http://dspace.ou.nl/handle/1820/3855
Xiao Z, Che F, Miao E, Lu M (2014) Increasing serendipity of recommender system with ranking topic model. Appl Math Inf Sci. https://doi.org/10.12785/amis/080463
Yang Y, Hooshyar D, Jo J, Lim H (2018) A group preference-based item similarity model: comparison of clustering techniques in ambient and context-aware recommender systems. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-018-1039-1
Zhang K, Seifi H (n.d.) VibViz: visualizing a vibration library. http://www-devel.cs.ubc.ca/~tmm/courses/infovis/projects/kailun-hasti/report.pdf. Accessed May 2019
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Comments from various students (users)
Appreciated work, good design |
Quite productive and good quality work |
1. It is highly recommended to install this recommender in universities, this will allow students to select a variety of topics for research with ease 2. The recommender should recommend the latest topics for research in which work is already in process |
The recommender takes more time to load comparatively. It only shows the research paper while in BS, only research papers should not be recommended. Along with such papers previous projects and related course in order to build that project should be shown |
1. Must tell me about the no of individuals who are working/selecting same research topic e.g. which area/field is very popular 2. Suggestions after selecting research topic e.g. scope of it 3. should also show visualization through paragraph about paper popularity or area/field scope for coming areas |
1. Show more graph for the better understanding and for showing more details of particular selected topic 2. Create section for comparing topic related to selected topic 3. Create separate section for different other related topics 4. Provide specific and looking good interface for the author name 5. It is very helpful recommender system |
1. Helpful 2. System is slow |
A very powerful and helpful software if used correctly |
It is a very useful and helpful product which can help every student for their educational work. I only have one problem with the product and that is the interface. It should be more visible and easy to understand |
System’s functionality of recommending some different papers is not necessary i guess |
Rights and permissions
About this article
Cite this article
Afridi, A.H., Yasar, A. & Shakshuki, E.M. Facilitating research through serendipity of recommendations. J Ambient Intell Human Comput 11, 2263–2275 (2020). https://doi.org/10.1007/s12652-019-01354-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-019-01354-7