short-paper

Learning analytics dashboards: the past, the present and the future

Authors:

Katrien Verbert,

Robin De Croon,

Raphael A. Dourado,

Tinne De LaetAuthors Info & Claims

LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge

Pages 35 - 40

https://doi.org/10.1145/3375462.3375504

Published: 23 March 2020 Publication History

Abstract

Learning analytics dashboards are at the core of the LAK vision to involve the human into the decision-making process. The key focus of these dashboards is to support better human sense-making and decision-making by visualising data about learners to a variety of stakeholders. Early research on learning analytics dashboards focused on the use of visualisation and prediction techniques and demonstrates the rich potential of dashboards in a variety of learning settings. Present research increasingly uses participatory design methods to tailor dashboards to the needs of stakeholders, employs multimodal data acquisition techniques, and starts to research theoretical underpinnings of dashboards. In this paper, we present these past and present research efforts as well as the results of the VISLA19 workshop on "Visual approaches to Learning Analytics" that was held at LAK19 with experts in the domain to identify and articulate common practices and challenges for the domain. Based on an analysis of the results, we present a research agenda to help shape the future of learning analytics dashboards.

References

[1]

Stephen J. Aguilar and Clare Baek. 2019. Motivated Information Seeking and Graph Comprehension Among College Students. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge (LAK19). ACM, New York, NY, USA, 280--289.

Digital Library

[2]

Kimberly E Arnold and Matthew D Pistilli. 2012. Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd international conference on learning analytics and knowledge. ACM, 267--270.

Digital Library

[3]

John Barr and Ananda Gunawardena. 2012. Classroom salon: a tool for social collaboration. In Proceedings of the 43rd ACM technical symposium on Computer Science Education. ACM, 197--202.

Digital Library

[4]

Robert Bodily and Katrien Verbert. 2017. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies 10, 4 (2017), 405--418.

Digital Library

[5]

Sven Charleer, Andrew Vande Moere, Joris Klerkx, Katrien Verbert, and Tinne De Laet. 2017. Learning analytics dashboards to support adviser-student dialogue. IEEE Transactions on Learning Technologies 11, 3 (2017), 389--399.

[6]

Dan Davis, Ioana Jivet, René F. Kizilcec, Guanliang Chen, Claudia Hauff, and Geert-Jan Houben. 2017. Follow the Successful Crowd: Raising MOOC Completion Rates Through Social Comparison at Scale. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (LAK '17). ACM, New York, NY, USA, 454--463.

Digital Library

[7]

Shane Dawson, Aneesha Bakharia, Elizabeth Heathcote, et al. 2010. SNAPP: Realising the affordances of real-time SNA within networked learning environments. Networked Learning.

[8]

Vanessa Echeverria, Roberto Martinez-Maldonado, Roger Granda, Katherine Chiluiza, Cristina Conati, and Simon Buckingham Shum. 2018. Driving Data Storytelling from Learning Design. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK '18). ACM, New York, NY, USA, 131--140.

Digital Library

[9]

Mohamed Ez-Zaouia and Elise Lavoué. 2017. EMODA: a tutor oriented multimodal and contextual emotional dashboard. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference. ACM, 429--438.

Digital Library

[10]

Wade Fagen and Sam Kamin. 2012. Developing device-independent applications for active and collaborative learning with the SLICE framework. In EdMedia+ Innovate Learning. Association for the Advancement of Computing in Education (AACE), 1565--1572.

[11]

Simon Skov Fougt, Amanda Siebert-Evenstone, Brendan Eagan, Sara Tabatabai, and Morten Misfeldt. 2018. Epistemic Network Analysis of Students' Longer Written Assignments As Formative/Summative Evaluation. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK '18). ACM, New York, NY, USA, 126--130.

Digital Library

[12]

Josh Gardner, Christopher Brooks, and Ryan Baker. 2019. Evaluating the Fairness of Predictive Student Models Through Slicing Analysis. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge. ACM, 225--234.

Digital Library

[13]

Sten Govaerts, Katrien Verbert, Erik Duval, and Abelardo Pardo. 2012. The student activity meter for awareness and self-reflection. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 869--884.

Digital Library

[14]

David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2 (2017).

[15]

Francisco Gutiérrez, Xavier Ochoa, Karsten Seipp, Tom Broos, and Katrien Verbert. 2019. Benefits and Trade-Offs of Different Model Representations in Decision Support Systems for Non-expert Users. In IFIP Conference on Human-Computer Interaction. Springer, 576--597.

[16]

Kenneth Holstein, Gena Hong, Mera Tegene, Bruce M. McLaren, and Vincent Aleven. 2018. The Classroom As a Dashboard: Co-designing Wearable Cognitive Augmentation for K-12 Teachers. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK '18). ACM, New York, NY, USA, 79--88.

Digital Library

[17]

Kenneth Holstein, Gena Hong, Mera Tegene, Bruce M McLaren, and Vincent Aleven. 2018. The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers. In Proceedings of the 8th international conference on learning Analytics and knowledge. ACM, 79--88.

Digital Library

[18]

Ioana Jivet, Maren Scheffel, Marcus Specht, and Hendrik Drachsler. 2018. License to Evaluate: Preparing Learning Analytics Dashboards for Educational Practice. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK '18). ACM, New York, NY, USA, 31--40.

Digital Library

[19]

Ioana Jivet, Maren Scheffel, Marcus Specht, and Hendrik Drachsler. 2018. License to evaluate: preparing learning analytics dashboards for educational practice. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. ACM, 31--40.

Digital Library

[20]

Joris Klerkx, Katrien Verbert, and Erik Duval. 2017. Learning Analytics Dashboards. In The Handbook of Learning Analytics (1 ed.), Charles Lang, George Siemens, Alyssa Friend Wise, and Dragan Gaševic (Eds.). Society for Learning Analytics Research (SoLAR), Alberta, Canada, 143--150. http://solaresearch.org/hla-17/hla17-chapter1

[21]

Amna Liaqat, Benett Axtell, Cosmin Munteanu, and C Demmans Epp. 2018. Contextual Inquiry, Participatory Design, and Learning Analytics: An Example. In Companion Proceedings 8th International Conference on Learning Analytics & Knowledge.

[22]

Steven Lonn, Stephen J Aguilar, and Stephanie D Teasley. 2015. Investigating student motivation in the context of a learning analytics intervention during a summer bridge program. Computers in Human Behavior 47 (2015), 90--97.

Digital Library

[23]

Martijn Millecamp, Francisco Gutiérrez, Sven Charleer, Katrien Verbert, and Tinne De Laet. 2018. A Qualitative Evaluation of a Learning Dashboard to Support Advisor-student Dialogues. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK '18). ACM, New York, NY, USA, 56--60.

Digital Library

[24]

Xavier Ochoa, AWDG Charles Lang, and George Siemens. 2017. Multimodal learning analytics. The Handbook of Learning Analytics 1 (2017), 129--141.

[25]

Alexander Pohl, François Bry, Jeannette Schwarz, and Marlene Gottstein. 2012. Sensing the classroom: Improving awareness and self-awareness of students in Backstage. In 2012 15th International Conference on Interactive Collaborative Learning (ICL). IEEE, 1--8.

[26]

Jose Luis Santos, Katrien Verbert, Sten Govaerts, and Erik Duval. 2013. Addressing learner issues with StepUp!: an evaluation. In Proceedings of the Third International Conference on Learning Analytics and Knowledge. ACM, 14--22.

Digital Library

[27]

Maren Scheffel, Hendrik Drachsler, Karel Kreijns, Joop de Kraker, and Marcus Specht. 2017. Widget, Widget As You Lead, I Am Performing Well Indeed!: Using Results from an Exploratory Offline Study to Inform an Empirical Online Study About a Learning Analytics Widget in a Collaborative Learning Environment. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (LAK '17). ACM, New York, NY, USA, 289--298.

Digital Library

[28]

Beat A Schwendimann, Maria Jesus Rodriguez-Triana, Andrii Vozniuk, Luis P Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2016. Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies 10, 1 (2016), 30--41.

Digital Library

[29]

Gayane Sedrakyan, Erik Mannens, and Katrien Verbert. 2018. Guiding the choice of learning dashboard visualizations: Linking dashboard design and data visualization concepts. Journal of Visual Languages and Computing 50 (2018).

[30]

George Siemens and Ryan SJ d Baker. 2012. Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of the 2nd international conference on learning analytics and knowledge. ACM, 252--254.

Digital Library

[31]

George Siemens and Phil Long. 2011. Penetrating the fog: Analytics in learning and education. EDUCAUSE review 46, 5 (2011), 30.

[32]

Thilo Spinner, Udo Schlegel, Hanna Schäfer, and Mennatallah El-Assady. 2019. explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning. IEEE transactions on visualization and computer graphics (2019).

[33]

Katrien Verbert, Sten Govaerts, Erik Duval, Jose Luis Santos, Frans Assche, Gonzalo Parra, and Joris Klerkx. 2014. Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing 18, 6 (2014), 1499--1514.

Digital Library

[34]

Françeska Xhakaj, Vincent Aleven, and Bruce M McLaren. 2017. Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. In European Conference on Technology Enhanced Learning. Springer, 315--329.

[35]

Yesom Yoo, Hyeyun Lee, Il-Hyun Jo, and Yeonjeong Park. 2015. Educational dashboards for smart learning: Review of case studies. In Emerging issues in smart learning. Springer, 145--155.

Cited By

Jin YYang KYan LEcheverria VZhao LAlfredo RMilesi MFan JLi XGasevic DMartinez-Maldonado R(2025)Chatting with a Learning Analytics Dashboard: The Role of Generative AI Literacy on Learner Interaction with Conventional and Scaffolding ChatbotsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706545(579-590)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706545
Baker RMills CChoi J(2025)The Difficulty of Achieving High Precision with Low Base Rates for High-Stakes InterventionProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706477(790-796)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706477
Dülger Mvan Leeuwen AJanssen JKester L(2025)Designing a classroom-level teacher dashboard to foster primary school teachers’ direct instruction of self-regulated learning strategiesEducation and Information Technologies10.1007/s10639-025-13389-9Online publication date: 31-Jan-2025
https://doi.org/10.1007/s10639-025-13389-9
Show More Cited By

Index Terms

Learning analytics dashboards: the past, the present and the future
1. Applied computing
  1. Education
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools
  2. Visualization
    1. Visualization design and evaluation methods

Recommendations

Automated insightful drill-down recommendations for learning analytics dashboards
LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge

The big data revolution is an exciting opportunity for universities, which typically have rich and complex digital data on their learners. It has motivated many universities around the world to invest in the development and implementation of learning ...
Recommending Insightful Drill-Downs Based on Learning Processes for Learning Analytics Dashboards
Artificial Intelligence in Education
Abstract
Learning Analytics Dashboards (LADs) make use of rich and complex data about students and their learning activities to assist educators in understanding and making informed decisions about student learning and the design and improvement of ...
A Data Pipeline Approach for Building Learning Analytics Dashboards
SETN '22: Proceedings of the 12th Hellenic Conference on Artificial Intelligence

In the era of data abundance, the ability to leverage data to assess the learning process is of great importance. Learning Analytics has been widely used and different approaches of deployment methods have been proposed, aiming to improve teaching and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge

March 2020

679 pages

ISBN:9781450377126

DOI:10.1145/3375462

General Chairs:
Christoph Rensing
Technische Universität Darmstadt, Germany
,
Hendrik Drachsler
DIPF Leibniz Institute for Research and Information in Education & University of Frankfurt, Germany
,
Program Chairs:
Vitomir Kovanović
University of South Australia, Australia
,
Niels Pinkwart
Humboldt-Universität zu Berlin, Germany
,
Maren Scheffel
Open Universiteit, Netherlands
,
Katrien Verbert
KU Leuven, Belgium

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 March 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

European Commission

Conference

LAK '20

LAK '20: 10th International Conference on Learning Analytics and Knowledge

March 23 - 27, 2020

Frankfurt, Germany

Acceptance Rates

LAK '20 Paper Acceptance Rate 80 of 261 submissions, 31%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

75
Total Citations
View Citations
2,853
Total Downloads

Downloads (Last 12 months)442
Downloads (Last 6 weeks)33

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jin YYang KYan LEcheverria VZhao LAlfredo RMilesi MFan JLi XGasevic DMartinez-Maldonado R(2025)Chatting with a Learning Analytics Dashboard: The Role of Generative AI Literacy on Learner Interaction with Conventional and Scaffolding ChatbotsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706545(579-590)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706545
Baker RMills CChoi J(2025)The Difficulty of Achieving High Precision with Low Base Rates for High-Stakes InterventionProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706477(790-796)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706477
Dülger Mvan Leeuwen AJanssen JKester L(2025)Designing a classroom-level teacher dashboard to foster primary school teachers’ direct instruction of self-regulated learning strategiesEducation and Information Technologies10.1007/s10639-025-13389-9Online publication date: 31-Jan-2025
https://doi.org/10.1007/s10639-025-13389-9
Masiello IMohseni ZPalma FNordmark SAugustsson HRundquist R(2024)A Current Overview of the Use of Learning Analytics DashboardsEducation Sciences10.3390/educsci1401008214:1(82)Online publication date: 11-Jan-2024
https://doi.org/10.3390/educsci14010082
Nascimento BSantos RHenriques JBernardo MCaldeira F(2024)Availability, Scalability, and Security in the Migration from Container-Based to Cloud-Native ApplicationsComputers10.3390/computers1308019213:8(192)Online publication date: 9-Aug-2024
https://doi.org/10.3390/computers13080192
Kim DLee DLim K(2024)Classroom Orchestration in CSCL: Exploring Functions and Visualizations of Teacher DashboardsThe Journal of Korean Association of Computer Education10.32431/kace.2024.27.7.00727:7(63-82)Online publication date: 31-Oct-2024
https://doi.org/10.32431/kace.2024.27.7.007
Tretow-Fish TKhalid M(2024)Applying Kano’s two-factor theory to prioritize learning analytics dashboard features for learning technology designersContemporary Educational Technology10.30935/cedtech/1428616:2(ep496)Online publication date: 2024
https://doi.org/10.30935/cedtech/14286
Fernandez-Nieto GMartinez-Maldonado REcheverria VKitto KGašević DBuckingham Shum S(2024)Data Storytelling Editor: A Teacher-Centred Tool for Customising Learning Analytics Dashboard NarrativesProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636930(678-689)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636930
Milesi MMartinez-Maldonado R(2024)Data Storytelling in Learning Analytics? A Qualitative Investigation into Educators’ Perceptions of Benefits and RisksProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636865(167-177)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636865
Yan LMartinez-Maldonado RGasevic D(2024)Generative Artificial Intelligence in Learning Analytics: Contextualising Opportunities and Challenges through the Learning Analytics CycleProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636856(101-111)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636856
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten