Abstract
Prior research has demonstrated the advantages of applying mobile game-based learning (MGBL) applications to supporting students’ learning. However, studies that specifically examine the effects of game quality and different types of cognitive loads on learning effectiveness in MGBL contexts are scarce. Therefore, this study aims to address this research gap by developing and validating a research model of cognitive loads and learning performance in MGBL contexts. Data collected from 130 college students who were asked to use an MGBL application developed specifically for this study were analyzed to validate the research model. The results indicate that both game quality of MGBL applications and extraneous cognitive load of the users of the MGBL application have significant effects on their perceived and actual learning effectiveness, while their germane cognitive load significantly influences their perceived learning effectiveness only. Implications for theory and for practice of the research results are discussed subsequently.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Data will be made available on reasonable request.
References
Abdul Jabbar, A. I., & Felicia, P. (2015). Gameplay engagement and learning in game-based learning: A systematic review. Review of Educational Research, 85(4), 740–779. https://doi.org/10.3102/0034654315577210
Bagozzi, R. P., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74–94. https://doi.org/10.1007/BF02723327
Brom, C., Děchtěrenko, F., Frollová, N., Stárková, T., Bromová, E., & D’Mello, S. K. (2017). Enjoyment or involvement? Affective-motivational mediation during learning from a complex computerized simulation. Computers & Education, 114, 236–254. https://doi.org/10.1016/j.compedu.2017.07.001
Buchinger, D., & Hounsell, M. (2018). Guidelines for designing and using collaborative-competitive serious games. Computers & Education, 118, 133–149. https://doi.org/10.1016/j.compedu.2017.11.007
Chang, C. C., Liang, C., Chou, P. N., & Lin, G. Y. (2017). Is game-based learning better in flow experience and various types of cognitive load than non-game-based learning? Perspective from multimedia and media richness. Computers in Human Behavior, 71, 218–227. https://doi.org/10.1016/j.chb.2017.01.031
Chang, C. C., Warden, C. A., Liang, C., & Lin, G. Y. (2018). Effects of digital game-based learning on achievement, flow, and overall cognitive load. Australasian Journal of Educational Technology, 34(4), 155–167. https://doi.org/10.14742/ajet.2961
Chen, C. H., Law, V., & Huang, K. (2019). The roles of engagement and competition on learner’s performance and motivation in game-based science learning. Educational Technology Research and Development, 67(4), 1003–1024. https://doi.org/10.1007/s11423-019-09670-7
Cheng, S. C., Hwang, G. J., & Chen, C. H. (2019). From reflective observation to active learning: A mobile experiential learning approach for environmental science education. British Journal of Educational Technology, 50(5), 2251–2270. https://doi.org/10.1111/bjet.12845
Chiang, T. H., Yang, S. J., & Hwang, G. J. (2014). An augmented reality-based mobile learning system to improve students’ learning achievements and motivations in natural science inquiry activities. Educational Technology & Society, 17(4), 352–365. https://www.jstor.org/stable/jeductechsoci.17.4.352. Accessed 5 May 2023
Chrysafiadi, K., & Virvou, M. (2013). PeRSIVA: An empirical evaluation method of a student model of an intelligent e-learning environment for computer programming. Computers & Education, 68, 322–333. https://doi.org/10.1016/j.compedu.2013.05.020
Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065
Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18(3), 75–88. https://www.jstor.org/stable/jeductechsoci.18.3.75. Accessed 5 May 2023
Ebadi, S., & Ashrafabadi, F. (2022). An exploration into the impact of augmented reality on EFL learners’ Reading comprehension. Education and Information Technologies, 27, 9745–9765. https://doi.org/10.1007/s10639-022-11021-8
Erhel, S., & Jamet, E. (2019). Improving instructions in educational computer games: Exploring the relations between goal specificity, flow experience and learning outcomes. Computers in Human Behavior, 91, 106–114. https://doi.org/10.1016/j.chb.2018.09.020
Fornell, C. R., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312
Fu, F. L., Su, R. C., & Yu, S. C. (2009). EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education, 52(1), 101–112. https://doi.org/10.1016/j.compedu.2008.07.004
Fowler, C. (2015). Virtual reality and learning: Where is the pedagogy? British Journal of Educational Technology, 46(2), 412–422. https://doi.org/10.1111/bjet.12135
Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467. https://doi.org/10.1177/1046878102238607
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis: A Global Perspective (7th ed.). Pearson Education.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). Sage Publications.
Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045
Hawlitschek, A., & Joeckel, S. (2017). Increasing the effectiveness of digital educational games: The effects of a learning instruction on students’ learning, motivation and cognitive load. Computers in Human Behavior, 72, 79–86. https://doi.org/10.1016/j.chb.2017.01.040
Hong, J. C., Hwang, M. Y., Tai, K. H., & Lin, P. H. (2017). Intrinsic motivation of Chinese learning in predicting online learning self-efficacy and flow experience relevant to students’ learning progress. Computer Assisted Language Learning, 30(6), 552–574. https://doi.org/10.1080/09588221.2017.1329215
Huang, C. F., Nien, W. P., & Yeh, Y. S. (2015). Learning effectiveness of applying automated music composition software in the high grades of elementary school. Computers & Education, 83, 74–89. https://doi.org/10.1016/j.compedu.2015.01.003
Huizenga, J., Admiraal, W., ten Dam, G., & Voogt, J. (2019). Mobile game-based learning in secondary education: Students’ immersion, game activities, team performance and learning outcomes. Computers in Human Behavior, 99, 137–143. https://doi.org/10.1016/j.chb.2019.05.020
Iten, N., & Petko, D. (2014). Learning with serious games: Is fun playing the game a predictor of learning success? British Journal of Educational Technology, 47(1), 151–163. https://doi.org/10.1111/bjet.12226
Kiili, K., Lainema, T., de Freitas, S., & Arnab, S. (2014). Flow framework for analyzing the quality of educational games. Entertainment Computing, 5(4), 367–377. https://doi.org/10.1016/j.entcom.2014.08.002
Kirkpatrick, D. L. (1998). Evaluating Training Programs: The Four Levels (2nd ed.). Berrett-Koehler.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating Training Programs: The Four Levels (3rd ed.). Berrett-Koehler.
Krath, J., Schurmann, L., & von Korflesch, H. F. O. (2021). Revealing the theoretical basis of gamification: A systematic review and analysis of theory in research on gamification, serious games and game-based learning. Computers & Education, 125, 106963. https://doi.org/10.1016/j.chb.2021.106963
Krajcsi, A., Csapodi, C., & Stettner, E. (2021). Algotaurus: An educational computer programming game for beginners. Interactive Learning Environments, 29(4), 634–647. https://doi.org/10.1080/10494820.2019.1593862
Leppink, J., Paas, F., Van Gog, T., van Der Vleuten, C. P., & van Merriënboer, J. J. (2014). Effects of pairs of problems and examples on task performance and different types of cognitive load. Learning and Instruction, 30, 32–42. https://doi.org/10.1016/j.learninstruc.2013.12.001
Liao, C. W., Chen, C. H., & Shih, S. J. (2019). The interactivity of video and collaboration for learning achievement, intrinsic motivation, cognitive load, and behavior patterns in a digital game-based learning environment. Computers & Education, 133, 43–55. https://doi.org/10.1016/j.compedu.2019.01.013
Liu, Y. C., Wang, W. T., & Lee, T. L. (2021). An integrated view of information feedback, game quality, and autonomous motivation for evaluating game-based learning effectiveness. Journal of Educational Computing Research, 59(1), 3–40. https://doi.org/10.1177/0735633120952044
Mao, W., Cui, Y., Chiu, M. M., & Lei, H. (2022). Effects of Game-Based Learning on Students’ Critical Thinking: A Meta-Analysis. Journal of Educational Computing Research, 59(8), 1682–1708. https://doi.org/10.1177/07356331211007098
Moizer, J., Lean, J., Dell’Aquila, E., Walsh, P., Keary, A. A., O’Byrne, D., & Sica, L. S. (2019). An approach to evaluating the user experience of serious games. Computers & Education, 136, 141–151. https://doi.org/10.1016/j.compedu.2019.04.006
O’Neil, H. F., Wainess, R., & Baker, E. L. (2005). Classification of learning outcomes: Evidence from the computer games literature. The Curriculum Journal, 16(4), 455–474. https://doi.org/10.1080/09585170500384529
Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38(1), 1–4. https://doi.org/10.1207/S15326985EP3801_1
Pando Cerra, P., FernándezÁlvarez, H., Busto Parra, B., & Iglesias Cordera, P. (2022). Effects of using game-based learning to improve the academic performance and motivation in engineering studies. Journal of Educational Computing Research, 60(7), 1663–1687. https://doi.org/10.1177/07356331221074022
Park, Y., & Jo, I. H. (2019). Factors that affect the success of learning analytics dashboards. Educational Technology Research and Development, 67, 1547–1571. https://doi.org/10.1007/s11423-019-09693-0
Prensky, M. (2003). Digital game-based learning. Computers in Entertainment, 1(1), 21–25. https://doi.org/10.1145/950566.950596
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879
Rodrigues, H., Almeida, F., Figueiredo, V., & Lopes, S. L. (2019). Tracking e-learning through published papers: A systematic review. Computers & Education, 136(1), 87–98. https://doi.org/10.1016/j.compedu.2019.03.007
Sreejesh, S., Anusree, M. R., & Ponnam, A. (2018). Does game rules work as a game changer? Analyzing the effect of rule orientation on brand attention and memory in advergames. Computers in Human Behavior, 81, 325–339. https://doi.org/10.1016/j.chb.2017.12.034
Sung, Y. T., Chang, K. E., & Liu, T. C. (2016). The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Computers and Education, 94, 252–275. https://doi.org/10.1016/j.compedu.2015.11.008
Sweller, J., van Merriënboer, J. J., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5
Sweller, J., van Merriënboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–296. https://doi.org/10.1023/A:1022193728205
Troussas, C., Krouska, A., & Sgouropoulou, C. (2020). Collaboration and fuzzy-modeled personalization for mobile game-based learning in higher education. Computers & Education, 144, 103698. https://doi.org/10.1016/j.compedu.2019.103698
Tsai, Y. L., & Tsai, C. C. (2020). A meta-analysis of research on digital game-based science learning. Journal of Computer Assisted Learning, 36(3), 280–294. https://publons.com/publon/10.1111/jcal.12430
Unal, A., & Topu, F. B. (2021). Effects of teaching a computer programming language via hybrid interface on anxiety, cognitive load level and achievement of high school students. Education and Information Technologies, 26(5), 5291–5309. https://doi.org/10.1007/s10639-021-10536-w
Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., & Conkey, C. (2009). Relationships between game attributes and learning outcomes: Review and research proposals. Simulation & Gaming, 40(2), 217–266. https://doi.org/10.1177/1046878108321866
Woo, J. C. (2014). Digital game-based learning supports student motivation, cognitive success, and performance outcomes. Educational Technology & Society, 17(3), 291- 307. https://www.jstor.org/stable/jeductechsoci.17.3.291. Accessed 5 May 2023
Zainuddin, Z., Shujahat, M., Haruna, H., & Chu, S. K. W. (2020). The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers & Education, 145, 103729. https://doi.org/10.1016/j.compedu.2019.103729
Acknowledgements
The authors thank the survey respondents for providing valuable data. Additionally, the authors thank the Editor and anonymous reviewers for their valuable feedback on this paper. This study was funded by the Ministry of Science and Technology, Taiwan [grant number: MOST 109-2511-H-006-006-MY3].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors report no conflict of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, YC., Wang, WT. & Huang, WH. The effects of game quality and cognitive loads on students’ learning performance in mobile game-based learning contexts: The case of system analysis education. Educ Inf Technol 28, 16285–16310 (2023). https://doi.org/10.1007/s10639-023-11856-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11856-9