Abstract
Learning analytics (LA) is an emerging field of science due to its great potential to better understand, support and improve the learning and teaching process. Many higher education institutions (HEIs) have already included LA in their digitalisation strategies. This process has been additionally accelerated during the COVID-19 pandemic when HEIs transitioned from face-2-face learning environments to hybrid and e-learning environments and entirely relied on technology to continue operating. Undoubtedly, there was never a time when so much student data was collected, analysed, and reported, which brings numerous ethical and data protection concerns to the forefront. For example, a critical issue when implementing LA is to determine which data should be processed to fulfil pedagogical purposes while making sure that LA is in line with ethical principles and data protection law, such as the European General Data Protection Regulation (GDPR).
This article contributes to the discussion on how to design LA applications that are not only useful and innovative but also trustworthy and enable higher education learners to make data-informed decisions about their learning process. For that purpose, we first present the idea and methodology behind the development of our interdisciplinary Criteria Catalogue for trustworthy LA applications intended for students. The Criteria Catalogue is a new normative framework that supports students to assess the trustworthiness of LA applications. It consists of seven defined Core Areas (i.e., autonomy, protection, respect, non-discrimination, responsibility and accountability, transparency, and privacy and good data governance) and corresponding criteria and indicators. Next, we apply this normative framework to learning diaries as a specific LA application. Our goal is to demonstrate how ethical and legal aspects could be translated into specific recommendations and design implications that should accompany the whole lifecycle of LA applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Clipa, O., Ignat, A.A., Stanciu, M.: Learning diary as a tool for metacognitive strategies. Soc. Behav. Sci. 33, 905–909 (2012). https://doi.org/10.1016/j.sbspro.2012.01.253
Drachsler, H., Greller, W.: Privacy and analytics - it's a DELICATE issue. a checklist for trusted learning analytics. In: LAK16: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pp. 89–98 (2016). https://doi.org/10.1145/2883851.2883893
Dörrenbächer, L., Perels, F.: More is more? Evaluation of interventions to foster self-regulated learning in college. Int. J. Educ. Res. 78, 50–65 (2016). https://doi.org/10.1016/j.ijer.2016.05.010
European Union. 2016. Consolidated text: Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) (Text with EEA relevance). RL 2016/679/EU
European Union. 2022. European Declaration on Digital Rights and Principles for the Digital Decade COM(2022)28 final
Floridi, L.: Soft ethics and the governance of the digital. Philos. Technol. 31(1), 1–8 (2018)
Friedman, B., Kahn, P., Borning, A.: Value sensitive design and information systems. In: Zhang, P., Galletta, D. (eds.) HCI and Management Information Systems: Foundations. Advances in Management Information Systems, (Armonk: M.E. Sharpe, 2006), pp. 348–372 (2006)
Gosch, N., et al.: Learning analytics as a service for empowered learners: from data subjects to controllers. In: LAK21: 11th International Learning Analytics and Knowledge Conference (LAK21). Association for Computing Machinery, New York, NY, USA, pp. 475–481 (2021). https://doi.org/10.1145/3448139.3448186
Kay, D., Korn, N., Oppenheim, C.: Legal, risk and ethical aspects of analytics in higher education. CETIS Anal. Ser. 1(6) (2012)
Khalil, M., Ebner, M.: Learning analytics: principles and constraints. In: Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2015, pp. 1326–1336. Chesapeake, VA: AACE (2015)
Slade, S., Prinsloo, P.: Learning Analytics - ethical issues and dilemmas. Am. Behav. Sci. 57(10) (2013). DOI:https://doi.org/10.1177/0002764213479366
Slade, S., Tait, A.: Global guidelines: Ethics in learning analytics (2019)
Slade, S., Boroowa, A.: Policy on Ethical Use of Student Data for Learning Analytics. Open University UK, Milton Keynes (2014)
Williams, G.: “Responsibility”, The Internet Encyclopedia of Philosophy. Accessed Mar 2022
Acknowledgements
This work was co-funded by the Federal Ministry of Education, Science and Research, Austria, as part of the 2019 call for proposals for digital and social transformation in higher education for the project “LA – Students in Focus” (2021–2024, partners: University of Vienna, Graz University of Technology, University of Graz).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Veljanova, H., Barreiros, C., Gosch, N., Staudegger, E., Ebner, M., Lindstaedt, S. (2022). Towards Trustworthy Learning Analytics Applications: An Interdisciplinary Approach Using the Example of Learning Diaries. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2022 Posters. HCII 2022. Communications in Computer and Information Science, vol 1582. Springer, Cham. https://doi.org/10.1007/978-3-031-06391-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-06391-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06390-9
Online ISBN: 978-3-031-06391-6
eBook Packages: Computer ScienceComputer Science (R0)