Elham Beheshti
ABSTRACT
Data-driven dashboards have been increasingly integrated into various contexts, particularly in educational settings. There is a growing need to understand how to design learning dashboards to help educators support learning experiences by providing real-time formative feedback. We are studying the design of a learning dashboard that can support educational facilitation tasks in a museum setting. In our approach, we use discrete facilitation tasks as the cornerstone of our design process. Using this task-based approach, we conducted pilot studies and participatory design sessions to better understand the context of design. In this paper, we offer preliminary findings and design considerations for supporting and digitally augmenting facilitation tasks in a highly interactive, open-ended learning environment.
- June Ahn, Fabio Campos, Maria Hays, and Daniela DiGiacomo. 2019. Designing in Context: Reaching beyond Usability in Learning Analytics Dashboard Design. Journal of Learning Analytics 6, 2 (2019), 70--85.Google Scholar
Cross Ref
- Sue Allen. 2003. Looking for learning in visitor talk: A methodological exploration. In Learning conversations in museums. Routledge, 265--309.Google Scholar
- Elham Beheshti, Leilah Lyons, Wren Thompson, and Stephen Uzzo. 2020. Human-in-the-Loop: Supporting Facilitators' Scaffolding of Visitor Engagement and Learning in Science Museums. To be presented at the Annual Meeting of the American Educational Research Association (2020).Google Scholar
- Elham Beheshti, Mmachi Obiorah, and Michael S. Horn. 2015. "Let's Dive into It!" : Learning Electricity with Multiple Representations. In Proceedings of the 14th International Conference on Interaction Design and Children - IDC '15 (2015). 263--266.Google ScholarDigital Library
- Hugh Beyer and Karen Holtzblatt. 1999. Contextual design. interactions 6, 1 (1999), 32--42.Google ScholarDigital Library
- Minda Borun, Margaret Chambers, and Ann Cleghorn. 1996. Families are learning in science museums. Curator: The Museum Journal 39, 2 (1996), 123--138.Google ScholarCross Ref
- César Coll, María José Rochera, and Ines de Gispert. 2014. Supporting online collaborative learning in small groups: Teacher feedback on learning content, academic task and social participation. Computers & Education 75 (2014), 53--64.Google ScholarCross Ref
- Anna Lea Dyckhoff, Dennis Zielke, Mareike Bültmann, Mohamed Amine Chatti, and Ulrik Schroeder. 2012. Design and implementation of a learning analytics toolkit for teachers. Journal of Educational Technology & Society 15, 3 (2012), 58--76.Google Scholar
- Vanessa Echeverria, Roberto Martinez-Maldonado, and Simon Buckingham Shum. 2019. Towards Collaboration Translucence. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. 1--16. DOI: http://dx.doi.org/10.1145/3290605.3300269Google ScholarDigital Library
- Ferdio. 2019. Data Viz Project. (2019). https://datavizproject.com/Google Scholar
- Stephen Few. 2006. Information Dashboard Design The Effective Visual Communication of Data. O'Reilly. 223 pages. https://dl.acm.org/citation.cfm?id=1206491Google Scholar
- Joshua Gutwill. 2002. Providing explanations to visitors affects their inquiry behavior: A study of the Downhill Race exhibit. Available from the Exploratorium 3601 (2002).Google Scholar
- Priscilla Jimenez-Pazmino, Brenda Lopez Silva, Brian Slattery, and Leilah Lyons. 2013. Teachable mo[bil]ment. In CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13. ACM Press, New York, New York, USA, 643. DOI: http://dx.doi.org/10.1145/2468356.2468470Google ScholarDigital Library
- Priscilla Jimenez Pazmino, Brian Slattery, Leilah Lyons, and Benjamin Hunt. 2015. Designing for youth interpreter professional development: A sociotechnologically-framed participatory design approach. In Proceedings of IDC 2015: The 14th International Conference on Interaction Design and Children. DOI: http://dx.doi.org/10.1145/2771839.2771840Google ScholarDigital Library
- Kirsty Kitto, Mandy Lupton, Kate Davis, and Zak Waters. 2017. Designing for student-facing learning analytics. Australasian Journal of Educational Technology 33, 5 (2017), 152--168. DOI: http://dx.doi.org/10.14742/ajet.3607Google ScholarCross Ref
- Robert Kozma. 2003. The material features of multiple representations and their cognitive and social affordances for science understanding. Learning and Instruction 13, 2 (apr 2003), 205--226. DOI: http://dx.doi.org/10.1016/S0959--4752(02)00021-XGoogle ScholarCross Ref
- Vishesh Kumar, Michael Tissenbaum, and Matthew Berland. 2017. What are visitors up to?. In Proceedings of the Seventh International Learning Analytics and Knowledge Conference on - LAK '17. ACM Press, New York, 558--559. DOI: http://dx.doi.org/10.1145/3027385.3029456Google ScholarDigital Library
- Richard Lehrer and Leona Schauble. 2002. Symbolic communication in mathematics and science: Co-constituting inscription and thought. In Language, literacy, and cognitive development: The development and consequences of symbolic communication, E Amsel and JP Byrnes (Eds.). 167--192.Google Scholar
- Aditi Mallavarapu, Leilah Lyons, Stephen Uzzo, Wren Thompson, Rinat Levy-Cohen, and Brian Slattery. 2019. Connect-to-Connected Worlds: Piloting a Mobile, Data-Driven Reflection Tool for an Open-Ended Simulation at a Museum. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article Paper 7, 14 pages. DOI: http://dx.doi.org/10.1145/3290605.3300237Google ScholarDigital Library
- Roberto Martinez-Maldonado, Yannis Dimitriadis, Alejandra Martinez-Monés, Judy Kay, and Kalina Yacef. 2013. Capturing and analyzing verbal and physical collaborative learning interactions at an enriched interactive tabletop. International Journal of Computer-Supported Collaborative Learning 8, 4 (2013), 455--485. DOI: http://dx.doi.org/10.1007/s11412-013--9184--1Google ScholarCross Ref
- Roberto Martinez-Maldonaldo, Abelardo Pardo, Negin Mirriahi, Kalina Yacef, Judy Kay, and Andrew Clayphan. 2016. LATUX: An iterative workflow for designing, validating, and deploying learning analytics visualizations. 2, 3 (2016), 9--39. http://dx.doi.org/10.18608/jla.2015.23.3Google ScholarCross Ref
- Camillia Matuk, Michael Tissenbaum, Matthew Berland, Leilah Lyons, Felipe Cocco, Marcia Linn, Jan L. Plass, Nik Hajny, Al Olsen, Beat Schwendimann, Mina Shirvani Boroujeni, James D. Slotta, Jonathan M. Vitale, Libby Gerard, and Pierre Dillenbourg. 2016. Real-Time Visualization of Student Activities to Support Classroom Orchestration. In ICLS 2016. ACM Press, New York, 1120--1127.Google Scholar
- Yeonjeong Park and Il-Hyun Hyun Jo. 2015. Development of the learning analytics dashboard to support students' learning performance. Journal of Universal Computer Science 21, 1 (2015), 110--133. DOI:http://dx.doi.org/10.3217/jucs-021-01-0110Google ScholarCross Ref
- Jim Pellegrino, Naomi Chudowsky, and Robert Glaser. 2001. Knowing What Students Know: The Science and Design of Educational Assessment. National Academy Press.Google Scholar
- Jeremy Roschelle, William R Penuel, Louise Yarnall, Nicole Shechtman, and Deborah Tatar. 2005. Handheld Tools that "Informate" Assessment of Student Learning in Science : A Requirements Analysis. Journal of Computer Assisted learning 21 (2005), 190--203. https: //www.researchgate.net/publication/221229798Google ScholarCross Ref
- Christina V. Schwarz, Brian J. Reiser, Elizabeth A. Davis, Lisa Kenyon, Andres Achér, David Fortus, Yael Shwartz, Barbara Hug, and Joe Krajcik. 2009. Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners. Journal of Research in Science Teaching 46, 6 (aug 2009), 632--654. DOI: http://dx.doi.org/10.1002/tea.20311Google ScholarCross Ref
- Beat A Schwendimann, María Jesús Rodríguez-Triana, Andrii Vozniuk, Luis P Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2016. Understanding learning at a glance. In Proceedings of the Sixth International Conference on Learning Analytics and Knowledge LAK '16. 532--533. DOI: http://dx.doi.org/10.1145/2883851.2883930Google ScholarDigital Library
- Ben Shneiderman. 2002. Promoting universal usability with multi-layer interface design. ACM SIGCAPH Computers and the Physically Handicapped 73--74 (2002), 1--8.Google Scholar
- Valerie J Shute. 2008. Focus on formative feedback. Review of educational research 78, 1 (2008), 153--189.Google Scholar
- Brian Slattery, Leilah Lyons, Priscilla Jimenez-Pazmino, Brenda Lopez Silva, and Thomas Moher. 2014. How interpreters make use of technological supports in an interactive zoo exhibit. In Proceedings of the 11th International Conference of the Learning Sciences (ICLS 2014), Vol. 1. Boulder, CO, 198--205.Google Scholar
- Mike Tissenbaum, Vishesh Kumar, and Matthew Berland. 2016. Modeling Visitor Behavior in a Game-Based Engineering Museum Exhibit with Hidden Markov Models. Proceedings of the 9th International Conference on Educational Data Mining (2016), 517--522.Google Scholar
- Katrien Verbert, Sten Govaerts, Erik Duval, Jose Luis Santos, Frans Van Assche, Gonzalo Parra, and Joris Klerkx. 2013. Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing 18, 6 (nov 2013), 1499--1514. DOI: http://dx.doi.org/10.1007/s00779-013-0751--2Google ScholarCross Ref
- Alyssa Friend Wise. 2014. Designing pedagogical interventions to support student use of learning analytics. 203--211. DOI: http://dx.doi.org/10.1145/2567574.2567588Google ScholarDigital Library
Index Terms
- Design Considerations for Data-Driven Dashboards: Supporting Facilitation Tasks for Open-Ended Learning
Recommendations
Open learner models and learning analytics dashboards: a systematic review
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and KnowledgeThis paper aims to link student facing Learning Analytics Dashboards (LADs) to the corpus of research on Open Learner Models (OLMs), as both have similar goals. We conducted a systematic review of literature on OLMs and compared the results with a ...
Model-driven assessment of learners in open-ended learning environments
LAK '13: Proceedings of the Third International Conference on Learning Analytics and KnowledgeOpen-ended learning environments (OELEs) provide students with opportunities to take part in authentic and complex problem-solving tasks. However, many students struggle to succeed in such complex learning endeavors. Without support, these students ...
Design a Dashboard for Secondary School Learners to Support Mastery Learning in a Gamified Learning Environment
Educating for a New Future: Making Sense of Technology-Enhanced Learning AdoptionAbstractAlthough prior studies have shown the benefits of using learning analytics dashboards (LADs) in non-gamified contexts in higher education, few have focused on pre-college users and gamified learning environments. In this paper, we present the ...
Comments