research-article

The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings

Authors:

Roberto Martinez-Maldonado,

Abelardo Pardo,

Negin Mirriahi,

Andrew ClayphanAuthors Info & Claims

LAK '15: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge

Pages 1 - 10

https://doi.org/10.1145/2723576.2723583

Published: 16 March 2015 Publication History

Abstract

Designing, deploying and validating learning analytics tools for instructors or students is a challenge requiring techniques and methods from different disciplines, such as software engineering, human-computer interaction, educational design and psychology. Whilst each of these disciplines has consolidated design methodologies, there is a need for more specific methodological frameworks within the cross-disciplinary space defined by learning analytics. In particular there is no systematic workflow for producing learning analytics tools that are both technologically feasible and truly underpin the learning experience. In this paper, we present the LATUX workflow, a five-stage workflow to design, deploy and validate awareness tools in technology-enabled learning environments. LATUX is grounded on a well-established design process for creating, testing and re-designing user interfaces. We extend this process by integrating the pedagogical requirements to generate visual analytics to inform instructors' pedagogical decisions or intervention strategies. The workflow is illustrated with a case study in which collaborative activities were deployed in a real classroom.

References

[1]

Arnold, K. E. and Pistilli, M. D. Course Signals at Purdue: Using learning analytics to increase student success. In Proc. LAK 2012. ACM, (2012), 267--270.

Digital Library

[2]

Balacheff, N. and Lund, K. Multidisciplinarity vs. Multivocality, the case of "learning analytics". In Proc. LAK 2013. ACM, (2013), 5--13.

Digital Library

[3]

Beer, C., Jones, D. and Clark, D. Analytics and complexity: Learning and leading for the future. In Proc. ASCILITE, 2012, 78--87.

[4]

Bevan, N. International standards for usability should be more widely used. Journal of Usability Studies, 4, 3 (2009), 106--113.

[5]

Blikstein, P. Multimodal learning analytics. In Proc. LAK 2013. ACM, (2013), 102--106.

Digital Library

[6]

Brown, B., Reeves, S. and Sherwood, S. Into the wild: challenges and opportunities for field trial methods. In Proc. CHI'11. ACM, (2011), 1657--1666.

Digital Library

[7]

Chaka, C. Collaborative Learning: Leveraging Concept Mapping and Cognitive Flexibility Theory. Handbook of Research on Collaborative Learning Using Concept Mapping. Birmingham, UK, 2010, 152--170.

[8]

Dillenbourg, P., Zufferey, G., Alavi, H., Jermann, P., Do-Lenh, S. and Bonnard, Q. Classroom orchestration: The third circle of usability. In Proc. CSCL 2011, ISLS (2011), 510--517.

[9]

ISO DIS. 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems (formerly known as 13407). 2009.

[10]

Duval, E. Attention please!: learning analytics for visualization and recommendation. In Proc. LAK 2011. ACM, (2011), 9--17.

Digital Library

[11]

Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A. and Schroeder, U. Design and Implementation of a Learning Analytics Toolkit for Teachers. Educational Technology & Society, 15, 3 (2012), 58--76.

[12]

Ferguson, R. The State of Learning Analytics in 2012: A Review and Future Challenges a review and future challenges. Technical Report KMI-12-01, Knowledge Media Institute, The Open University, UK.,(March)(2012).

[13]

Gluga, R., Kay, J., Lister, R., Simon, S., Charleston, M., Harland, J. and Teague, D. M. A conceptual model for reflecting on expected learning vs. demonstrated student performance. In Proc. ACE 2013, ACS, (2013), 77--86.

Digital Library

[14]

Greller, W. and Drachsler, H. Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society (2012) 42--57.

[15]

Hartson, R. and Pyla, P. S. The UX book: process and guidelines for ensuring a quality user experience. Elsevier, 2012.

Digital Library

[16]

Helms, J. W., Arthur, J. D., Hix, D. and Hartson, H. R. A field study of the Wheel---a usability engineering process model. Journal of Systems and Software, 79, 6 (2006), 841--858.

Digital Library

[17]

Knight, S., Shum, S. B. and Littleton, K. Epistemology, pedagogy, assessment and learning analytics. In Proc. LAK 2013. ACM, (2013), 75--84.

Digital Library

[18]

Lockyer, L., Heathcote, E. and Dawson, S. Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57, 10 (2013), 1439--1459.

[19]

Macfadyen, L. P. and Dawson, S. Mining LMS data to develop an "early warning system" for educators: A proof of concept. Computers & Education, 54, 2 (2010), 588--599.

Digital Library

[20]

Martinez-Maldonado, R., Kay, J. and Yacef, K. Visualisations for longitudinal participation, contribution and progress of a collaborative task at the tabletop. In Proc. CSCL 2011, ISLS (2011), 25--32.

[21]

Martinez-Maldonado, R., Yacef, K., Kay, J. and Schwendimann, B. An interactive teacher's dashboard for monitoring multiple groups in a multi-tabletop learning environment. In Proc. ITS 2012, (2012), 482--492.

Digital Library

[22]

Martinez-Maldonado, R., Dimitriadis, Y., Kay, J., Yacef, K. and Edbauer, M.-T. MTClassroom and MTDashboard: supporting analysis of teacher attention in an orchestrated multi-tabletop classroom. In Proc. CSCL2013, ISLS (2013), 119--128.

[23]

Martinez-Maldonado, R. Analysing, visualising and supporting collaborative learning using interactive tabletops. PhD thesis, The University of Sydney, 2014.

[24]

Martinez-Maldonado, R., Clayphan, A., Ackad, C. and Kay, J. Multi-touch Technology in a Higher Education Classroom: Lessons In-the-wild. In Proc. OzCHI'14, (2014), 189--192.

Digital Library

[25]

Mendiburo, M., Sulcer, B. and Hasselbring, T. Interaction design for improved analytics. In Proc. LAK 2014. ACM,(2014), 78--82.

Digital Library

[26]

Olmos, M. and Corrin, L. Academic analytics in a medical curriculum: Enabling educational excellence. Australasian Journal of Educational Technology, 28, 1 (2012), 1--15.

[27]

Prieto, L. P., Dlab, M. H., Gutiérrez, I., Abdulwahed, M. and Balid, W. Orchestrating technology enhanced learning: a literature review and a conceptual framework. International Journal of Technology Enhanced Learning, 3, 6 (2011), 583--598.

Digital Library

[28]

Rodríguez Triana, M. J., Martínez Monés, A., Asensio Pérez, J. I. and Dimitriadis, Y. Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations. British Journal of Educational Technology (2014) (In press).

[29]

Siemens, G. Learning analytics: envisioning a research discipline and a domain of practice. In Proc. LAK 2012. ACM,(2012), 4--8.

Digital Library

[30]

Siemens, G. and Baker, R. S. J. d. Learning analytics and educational data mining: towards communication and collaboration. In Proc. LAK 2012. ACM,(2012), 252--254.

Digital Library

[31]

Sommerville, I. Software Engineering. Pearson, 2011.

Digital Library

[32]

Tohidi, M., Buxton, W., Baecker, R. and Sellen, A. Getting the right design and the design right. In Proc. CHI'06. ACM, (2006), 1243--1252.

Digital Library

[33]

Verbert, K., Govaerts, S., Duval, E., Santos, J., Assche, F., Parra, G. and Klerkx, J. Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing (2013), 1--16.

Digital Library

Cited By

Hadi Nezhad MCastro FWoolf BArroyo I(2024)Math Teachers’ In-Class Information Needs and Usage for Effective Design of Classroom Orchestration ToolsTechnology Enhanced Learning for Inclusive and Equitable Quality Education10.1007/978-3-031-72315-5_21(299-314)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72315-5_21
López-Pernas SMisiejuk KTikka SKopra JHeinäniemi MSaqr M(2024)Visualizing and Reporting Educational Data with RLearning Analytics Methods and Tutorials10.1007/978-3-031-54464-4_6(151-194)Online publication date: 19-Feb-2024
https://doi.org/10.1007/978-3-031-54464-4_6
GÜYER TSOMYÜREK SYURDUGÜL HAYDIN FGÜLMEZ A(2023)Öğrenme Analitiği Göstergelerini Raporlayan Açık Erişimli Çevrimiçi Bir Öğrenme Platformunun Kullanılabilirliğinin DeğerlendirilmesiEvaluating of the Usability of an Open Access Online Learning Platform Reporting Learning Analytics IndicatorsAbant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi10.17240/aibuefd.2023..-1182359Online publication date: 4-Nov-2023
https://doi.org/10.17240/aibuefd.2023..-1182359
Show More Cited By

Index Terms

The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings
1. Applied computing
  1. Education
  2. Enterprise computing

Recommendations

Interactive surfaces and learning analytics: data, orchestration aspects, pedagogical uses and challenges
LAK '16: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge

The proliferation of varied types of multi-user interactive surfaces (such as digital whiteboards, tabletops and tangible interfaces) is opening a new range of applications in face-to-face (f2f) contexts. They offer unique opportunities for Learning ...
Tools to Support Self-Regulated Learning in Online Environments: Literature Review
Lifelong Technology-Enhanced Learning
Abstract
Self-regulated learning (SRL) skills are especially important in Massive Open Online Courses (MOOCs), where teacher guidance is scarce, and learners must engage in their learning process trying to succeed and achieve their learning goals. However,...
Supporting open-ended discourse with transparent groupware

Web-based learning communities need tools that provide specific support to their progressive and open-ended efforts. The paper starts with an overview of some fundamental principles and phenomena underlying the activities of learning communities, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK '15: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge

March 2015

448 pages

ISBN:9781450334174

DOI:10.1145/2723576

Conference Chairs:
Josh Baron
Marist College
,
Grace Lynch
SoLAR
,
Nicole Maziarz
Marist College
,
Program Chairs:
Paulo Blikstein
Stanford University
,
Agathe Merceron
Beuth University of Applied Sciences Berlin
,
George Siemens
University of Texas at Arlington

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Smart Services CRC, Australia, CONACYT, Mexico
Fundación Pablo García, Mexico

Conference

LAK '15

LAK '15: the 5th International Learning Analytics and Knowledge Conference

March 16 - 20, 2015

New York, Poughkeepsie

Acceptance Rates

LAK '15 Paper Acceptance Rate 20 of 74 submissions, 27%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
841
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hadi Nezhad MCastro FWoolf BArroyo I(2024)Math Teachers’ In-Class Information Needs and Usage for Effective Design of Classroom Orchestration ToolsTechnology Enhanced Learning for Inclusive and Equitable Quality Education10.1007/978-3-031-72315-5_21(299-314)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72315-5_21
López-Pernas SMisiejuk KTikka SKopra JHeinäniemi MSaqr M(2024)Visualizing and Reporting Educational Data with RLearning Analytics Methods and Tutorials10.1007/978-3-031-54464-4_6(151-194)Online publication date: 19-Feb-2024
https://doi.org/10.1007/978-3-031-54464-4_6
GÜYER TSOMYÜREK SYURDUGÜL HAYDIN FGÜLMEZ A(2023)Öğrenme Analitiği Göstergelerini Raporlayan Açık Erişimli Çevrimiçi Bir Öğrenme Platformunun Kullanılabilirliğinin DeğerlendirilmesiEvaluating of the Usability of an Open Access Online Learning Platform Reporting Learning Analytics IndicatorsAbant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi10.17240/aibuefd.2023..-1182359Online publication date: 4-Nov-2023
https://doi.org/10.17240/aibuefd.2023..-1182359
Kaliisa RJivet IPrinsloo P(2023)A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboardsInternational Journal of Educational Technology in Higher Education10.1186/s41239-023-00394-620:1Online publication date: 3-May-2023
https://doi.org/10.1186/s41239-023-00394-6
Sabuncuoglu ASezgin T(2023)Developing a Multimodal Classroom Engagement Analysis Dashboard for Higher-EducationProceedings of the ACM on Human-Computer Interaction10.1145/35932407:EICS(1-23)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593240
Zhang HSun XZhang YWang QYao C(2023)Towards Personalized Instruction: Co-designing a Teacher-Centered Dashboard for Learning Engagement Analysis in Blended Learning EnvironmentsLearning and Collaboration Technologies10.1007/978-3-031-34411-4_38(563-574)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-34411-4_38
Amarasinghe IMichos KCrespi FHernández‐Leo D(2022)Learning analytics support to teachers' design and orchestrating tasksJournal of Computer Assisted Learning10.1111/jcal.1271140:6(2416-2431)Online publication date: 20-Jul-2022
https://doi.org/10.1111/jcal.12711
Swai CMangowi S(2022)Mining school teachers' MOOC training responses to infer their face-to-face teaching strategy preferenceThe International Journal of Information and Learning Technology10.1108/IJILT-07-2021-010239:1(82-94)Online publication date: 20-Jan-2022
https://doi.org/10.1108/IJILT-07-2021-0102
Zamecnik AKovanović VGrossmann GJoksimović SJolliffe GGibson DPardo A(2022)Team interactions with learning analytics dashboardsComputers & Education10.1016/j.compedu.2022.104514185:COnline publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1016/j.compedu.2022.104514
Peraić IGrubišić A(2022)Development and Evaluation of a Learning Analytics Dashboard for Moodle Learning Management SystemHCI International 2022 - Late Breaking Papers. Interaction in New Media, Learning and Games10.1007/978-3-031-22131-6_30(390-408)Online publication date: 25-Nov-2022
https://doi.org/10.1007/978-3-031-22131-6_30
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten