Abstract
Narrative-centered learning environments comprise a class of game-based learning environments that embed problem solving in interactive stories. A key challenge posed by narrative-centered learning is dynamically tailoring story events to enhance student learning. In this paper, we investigate the impact of a data-driven tutorial planner on students’ learning processes in a narrative-centered learning environment, Crystal Island. We induce the tutorial planner by employing modular reinforcement learning, a multi-goal extension of classical reinforcement learning. To train the planner, we collected a corpus from 453 middle school students who used Crystal Island in their classrooms. Afterward, we investigated the induced planner’s impact in a follow-up experiment with another 75 students. The study revealed that the induced planner improved students’ problem-solving processes—including hypothesis testing and information gathering behaviors—compared to a control condition, suggesting that modular reinforcement learning is an effective approach for tutorial planning in narrative-centered learning environments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Johnson, W.L.: Serious Use of a Serious Game for Language Learning. International Journal of Artificial Intelligence in Education 20(2), 175–195 (2010)
Vannini, N., Enz, S., Sapouna, M., Wolke, D., Watson, S., Woods, S., Dautenhahn, K., Hall, L., Paiva, A., Andre, E., Aylett, R., Schneider, W.: “FearNot!”: A Computer-Based Anti-Bullying-Programme Designed to Foster Peer Intervention. European Journal of Psychology of Education 26(1), 21–44 (2011)
Alvarez, N., Sanchez-Ruiz, A., Cavazza, M., Shigematsu, M., Prendinger, H.: Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance. Intl Journal of Artificial Intelligence in Education 25(1), 35–59 (2015)
Nelson, B.C., Kim, Y., Foshee, C., Slack, K.: Visual Signaling in Virtual World-Based Assessments: The SAVE Science Project. Information Sciences 264, 32–40 (2014)
Graesser, A., Halpern, D., Hakel, M.: 25 Principles of Learning. Task Force on Lifelong Learning at Work and at Home, Washington, DC (2008)
Adams, D.M., Mayer, R.E., MacNamara, A., Koenig, A., Wainess, R.: Narrative Games for Learning: Testing the Discovery and Narrative Hypotheses. Journal of Educational Psychology 104(1), 235–249 (2012)
Chi, M., Vanlehn, K., Litman, D., Jordan, P.: Empirically Evaluating the Application of Reinforcement Learning to the Induction of Effective and Adaptive Pedagogical Strategies. User Modeling and User-Adapted Interaction 21, 137–180 (2011)
Bhat, S., Isbell, C. L., Mateas, M.: On the difficulty of modular reinforcement learning for real-world partial programming. In: Proceedings of the 21st National Conference on Artificial Intelligence, pp. 318–323. AAAI Press, Menlo Park (2006)
Karlsson, J.: Learning to Solve Multiple Goals. Ph.D. diss., Dept. of Comp. Sci., University of Rochester (1997)
Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Rowe, J., Mott, B., Lester, J.: Optimizing player experience in interactive narrative planning: a modular reinforcement learning approach. In: Proceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, pp. 160–166. AAAI Press, Menlo Park (2014)
Lester, J., Ha, E., Lee, S., Mott, B., Rowe, J., Sabourin, J.: Serious Games Get Smart: Intelligent Game-Based Learning Environments. AI Magazine 34(4), 31–45 (2013)
Rowe, J.: Narrative-Centered Tutorial Planning with Concurrent Markov Decision Processes. Ph.D. diss., Dept. of Comp. Sci., North Carolina State University (2013)
Spires, H., Rowe, J., Mott, B., Lester, J.: Problem Solving and Game-Based Learning: Effects of Middle Grade Students’ Hypothesis Testing Strategies on Science Learning Outcomes. Journal of Educational Computing Research 44(4), 453–472 (2011)
Sabourin, J., Rowe, J., Mott, B.W., Lester, J.C.: Exploring inquiry-based problem-solving strategies in game-based learning environments. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 470–475. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Rowe, J.P., Lester, J.C. (2015). Improving Student Problem Solving in Narrative-Centered Learning Environments: a Modular Reinforcement Learning Framework. In: Conati, C., Heffernan, N., Mitrovic, A., Verdejo, M. (eds) Artificial Intelligence in Education. AIED 2015. Lecture Notes in Computer Science(), vol 9112. Springer, Cham. https://doi.org/10.1007/978-3-319-19773-9_42
Download citation
DOI: https://doi.org/10.1007/978-3-319-19773-9_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19772-2
Online ISBN: 978-3-319-19773-9
eBook Packages: Computer ScienceComputer Science (R0)