Skip to main content

How Can We Co-design Learning Analytics for Game-Based Assessment: ENA Analysis

  • Conference paper
  • First Online:
Advances in Quantitative Ethnography (ICQE 2022)

Abstract

The broader education research community has adopted co-design, or participatory design, as a method to increase adoption of innovations in classrooms and to support professional learning of teachers. However, it can be challenging, due to co-design’s dynamic nature, to closely investigate how the co-process played out over time, and how it led to changes in teachers’ perceptions, beliefs, and/or practices. Applying Quantitative Ethnography, we investigate how teachers and researchers collaboratively designed assessment metrics and data visualizations for an educational math game; we discuss the interactions among the co-design activities, teachers’ learning, and qualities of the dashboard created as the output of the process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Clark, D.B., Tanner-Smith, E.E., Killingsworth, S.S.: Digital games, design, and learning: a systematic review and meta-analysis. Rev. Educ. Res. 86, 79–122 (2016). https://doi.org/10.3102/0034654315582065

    Article  Google Scholar 

  2. Shute, V.J., Masduki, I., Donmez, O.: Conceptual Framework for Modeling, Assessing and Supporting Competencies within Game Environments, pp. 1–25 (2011)

    Google Scholar 

  3. Lodge, J.M., Horvath, J.C., Corrin, L.: Learning Analytics in the Classroom: Translating Learning Analytics Research for Teachers. Routledge, Abingdon (2018)

    Book  Google Scholar 

  4. Sanders, E.B.-N., Stappers, P.J.: Co-creation and the new landscapes of design. Co-design 4, 5–18 (2008)

    Google Scholar 

  5. Sanders, E.B.-N., Stappers, P.J.: Probes, toolkits and prototypes: three approaches to making in codesigning. CoDesign 10, 5–14 (2014)

    Article  Google Scholar 

  6. Kumar, V.: 101 Design Methods: A Structured Approach for Driving Innovation in Your Organization. Wiley, Hoboken (2012)

    Google Scholar 

  7. Gravemeijer, K., van Eerde, D.: Design research as a means for building a knowledge base for teachers and teaching in mathematics education. Elementary Sch. J. 109, 510–524 (2009)

    Article  Google Scholar 

  8. Voogt, J., Laferrière, T., Breuleux, A., Itow, R., Hickey, D., McKenney, S.: Collaborative design as a form of professional development: in the context of curriculum reform. In: 2015 Annual Meeting of the American Educational Research Association: Toward Justice: Culture, Language, and Heritage in Education Research and Praxis (2015)

    Google Scholar 

  9. Tsai, Y.-S., Gasevic, D.: Learning analytics in higher education—Challenges and policies: a review of eight learning analytics policies. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 233–242 (2017)

    Google Scholar 

  10. Luckin, R.: Machine Learning and Human Intelligence: The future of education for the 21st century. ERIC (2018)

    Google Scholar 

  11. Rudin, C.: Algorithms for interpretable machine learning. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p. 1519 (2014)

    Google Scholar 

  12. Kim, Y.J., Lin, G., Ruipérez-Valiente, J.A.: Expanding teacher assessment literacy with the use of data visualizations in game-based assessment. In: Sahin, M., Ifenthaler, D. (eds.) Visualizations and Dashboards for Learning Analytics. AALT, pp. 399–419. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-81222-5_18

  13. Marquart, C., Swiecki, Z., Eagan, B., Shaffer, D.W.: ncodeR: techniques for automated classifiers [R package] (2019)

    Google Scholar 

  14. Brohinsky, J., Marquart, C., Wang, J., Ruis, A.R., Shaffer, D.W.: Trajectories in epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 106–121. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_8

    Chapter  Google Scholar 

  15. Knowles, M., Shaffer, D.W.: Hierarchical epistemic network analysis. In: Second International Conference on Quantitative Ethnography: Conference Proceedings Supplement. ICQE (2021)

    Google Scholar 

  16. Buckingham Shum, S., Crick, R.D.: Learning analytics for 21st century competencies. J. Learn. Anal. 3, 6–21 (2016)

    Article  Google Scholar 

  17. Ahn, J., Campos, F., Hays, M., DiGiacombo, D.: Designing in context: reaching beyond usability in learning analytics dashboard design. JLA 6, 70–85 (2019). https://doi.org/10.18608/jla.2019.62.5

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yoon Jeon Kim .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kim, Y.J., Scianna, J., Knowles, M.A. (2023). How Can We Co-design Learning Analytics for Game-Based Assessment: ENA Analysis. In: Damşa, C., Barany, A. (eds) Advances in Quantitative Ethnography. ICQE 2022. Communications in Computer and Information Science, vol 1785. Springer, Cham. https://doi.org/10.1007/978-3-031-31726-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31726-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31725-5

  • Online ISBN: 978-3-031-31726-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics