Abstract
Technological advances, changing demands of students and employers as well as the stiff competition among higher education (HE) institutions are leading to the exploration and adoption of innovative learning technologies in HE. The use of immersive technologies for education is rising given their potential to complement current methods of delivering learning content to students. Among the benefits of these technologies to education is their ability to promote active, experiential and higher-order learning. However, what is still unclear to educators is how to measure learning in immersive environments. This paper proposes a framework developed to guide educators through the process of designing and implementing assessments when using immersive technologies. The assessment framework presented in this paper builds upon the principle of Constructive Alignment (CA) and the Evidence-Centered Design (ECD) framework. A qualitative evaluation of the proposed framework was conducted to evaluate how easy it is for educators to understand and use it for assessment design around immersive learning activities. The framework was found to provide familiar and user-friendly assessment design guidelines for educators. Lastly, this paper also presents a suggestion for the application of the proposed assessment framework to the design of assessments for an augmented reality game. It also outlines best practices when considering immersive technologies for assessments in HE.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shute, V., Rahimi, S., Emihovich, B.: Assessment for learning in immersive environments. In: Liu, D., Dede, C., Huang, R., Richards, J. (eds.) Virtual, Augmented, and Mixed Realities in Education, pp. 71–87. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-5490-7
Plass, J.L., Homer, B.D., Kinzer, C.K.: Foundations of game-based learning. Educ. Psychol. 50, 258–283 (2015). https://doi.org/10.1080/00461520.2015.1122533
Squire, K.: Video games in education. Int. J. Intell. Games Simul. 2 (2003). https://doi.org/10.4018/978-1-61520-781-7.ch020
de Freitas, S.: Learning in immersive worlds: a review of game-based learning. JISC e-Learn. Innov. 3, 73 (2006)
Razak, A.A., Connolly, T., Hainey, T.: Teachers’ views on the approach of digital games-based learning within the curriculum for excellence. Int. J. Game-Based Learn. 2, 33–51 (2012). https://doi.org/10.4018/ijgbl.2012010103
Routledge, H.: Games-based learning in the classroom and how it can work! In: Connolly, T., Stansfield, M., and Boyle, L. (eds.) Games-Based Learning Advancements for Multi-Sensory Human Computer Interfaces, pp. 274–286. IGI Global, Pennsylvania (2009)
Biggs, J.: Aligning teaching for constructing learning. High. Educ. Acad. 1, 1–4 (2003)
Mislevy, R., Steinberg, L.S., Almond, R.G.: Focus article: on the structure of educational assessments. Meas. Interdiscip. Res. Perspect. 1, 3–62 (2003). https://doi.org/10.1207/s15366359mea0101_02
Behrens, J.T., Mislevy, R.J., Dicerbo, K.E., Levy, R.: Evidence centered design for learning and assessment in the digital world. In: Technology-Based Assessments for 21st Century Skills, pp. 13–53 (2012)
Arieli-Attali, M., Ward, S., Thomas, J., Deonovic, B., von Davier, A.A.: The expanded evidence-centered design (e-ECD) for learning and assessment systems: a framework for incorporating learning goals and processes within assessment design. Front. Psychol. 10, 1–17 (2019). https://doi.org/10.3389/fpsyg.2019.00853
Smith, G., Shute, V., Muenzenberger, A.: Designing and validating a stealth assessment for calculus competencies. J. Appl. Test. Technol. 20, 52–59 (2019)
Min, W., et al.: DeepStealth: game-based learning stealth assessment with deep neural networks. IEEE Trans. Learn. Technol. 13, 312–325 (2020). https://doi.org/10.1109/TLT.2019.2922356
Kim, Y.J., Almond, R.G., Shute, V.J.: Applying evidence-centered design for the development of game-based assessments in physics playground. Int. J. Test. 16, 142–163 (2016). https://doi.org/10.1080/15305058.2015.1108322
Westera, W.: Why and how serious games can become far more effective: accommodating productive learning experiences, learner motivation and the monitoring of learning gains. Educ. Technol. Soc. 22, 59–69 (2019)
Westera, W., et al.: Artificial intelligence moving serious gaming: presenting reusable game AI components. Educ. Inf. Technol. 25, 351–380 (2020). https://doi.org/10.1007/s10639-019-09968-2
Ali, L.: The design of curriculum, assessment and evaluation in higher education with constructive alignment. J. Educ. e-Learning Res. 5, 72–78 (2018). https://doi.org/10.20448/journal.509.2018.51.72.78
Biggs, J., Tang, C.: Applying constructive alignment to outcomes-based teaching and learning. In: Training Material for “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers, pp. 23–25. Ministry of Higher Education, Kuala Lumpur (2010)
Biggs, J., Collis, K.F.: Evaluating the Quality of Learning: The SOLO Taxonomy. Academic Press, New York (1982)
Anderson, L.: A Taxonomy for Learning, Teaching and Assesing: A Revision of Bloom’s Taxonomy. Pearson, New York (2013)
Dawson, P.: Assessment rubrics: towards clearer and more replicable design, research and practice. Assess. Eval. High. Educ. 42, 347–360 (2017). https://doi.org/10.1080/02602938.2015.1111294
Jonsson, A., Svingby, G.: The use of scoring rubrics: reliability, validity and educational consequences. Educ. Res. Rev. 2, 130–144 (2007). https://doi.org/10.1016/j.edurev.2007.05.002
Udeozor, C., Russo Abegão, F., Glassey, J.: Measuring learning in digital games: applying a game-based assessment framework. Br. J. Educ. Technol. (2023)
Domínguez Alfaro, J.L., et al.: Mobile augmented reality laboratory for learning acid-base titration. J. Chem. Educ. 99, 531–537 (2022). https://doi.org/10.1021/acs.jchemed.1c00894
Shute, V., Ventura, M.: Stealth Assessment: Measuring and Supporting Learning in Video Games. MIT Press, London (2013)
Shute, V.J., Rahimi, S.: Stealth assessment of creativity in a physics video game. Comput. Human Behav. 116, 106647 (2021). https://doi.org/10.1016/j.chb.2020.106647
Acknowledgement
This project has received funding from the European Union’s EU Framework Programme for Research and Innovation Horizon 2020 under Grant Agreement No [812716].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Udeozor, C., Dominguez Alfaro, J.L., Glassey, J. (2024). Assessment Framework for Immersive Learning: Application and Evaluation. In: Bourguet, ML., Krüger, J.M., Pedrosa, D., Dengel, A., Peña-Rios, A., Richter, J. (eds) Immersive Learning Research Network. iLRN 2023. Communications in Computer and Information Science, vol 1904. Springer, Cham. https://doi.org/10.1007/978-3-031-47328-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-47328-9_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47327-2
Online ISBN: 978-3-031-47328-9
eBook Packages: Computer ScienceComputer Science (R0)