Abstract
We present a randomized field trial delivered in Carnegie Learning’s MATHia’s intelligent tutoring system to 12,374 learners intended to test whether rewriting content in “word problems” improves student mathematics performance within this content, especially among students who are emerging as English language readers. In addition to describing facets of word problems targeted for rewriting and the design of the experiment, we present an artificial intelligence-driven approach to evaluating the effectiveness of the rewrite intervention for emerging readers. Data about students’ reading ability is generally neither collected nor available to MATHia’s developers. Instead, we rely on a recently developed neural network predictive model that infers whether students will likely be in this target sub-population. We present the results of the intervention on a variety of performance metrics in MATHia and compare performance of the intervention group to the entire user base of MATHia, as well as by comparing likely emerging readers to those who are not inferred to be emerging readers. We conclude with areas for future work using more comprehensive models of learners.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Almoubayyed, H., Fancsali, S.E., Ritter, S.: Instruction-embedded assessment for reading ability in adaptive mathematics software. In: Proceedings of the 13th International Conference on Learning Analytics and Knowledge. LAK ’23, Association for Computing Machinery, New York, NY, USA (2023)
Anderson, J.R., Corbett, A.T.: Knowledge tracing: modeling the acquisition of procedural knowledge. User Model. User-Adap. Inter. 4, 253–278 (1995)
Koedinger, K.R., Corbett, A.T., Perfetti, C.: The knowledge-learning-instruction framework: Bridging the science-practice chasm to enhance robust student learning. Cogn. Sci. 36(5), 757–798. https://doi.org/10.1111/j.1551-6709.2012.01245.x
Koedinger, K.R., Nathan, M.J.: The real story behind story problems: effects of representations on quantitative reasoning. J. Learn. Sci. 13(2), 129–164 (2004). https://doi.org/10.1207/s15327809jls1302_1
Krawitz, J., Chang, Y.P., Yang, K.L., Schukajlow, S.: The role of reading comprehension in mathematical modelling: improving the construction of a real-world model and interest in germany and taiwan. Educ. Stud. Math. 109, 337–359 (2022)
Richey, J.E., Lobczowski, N.G., Carvalho, P.F., Koedinger, K.: Comprehensive views of math learners: A case for modeling and supporting non-math factors in adaptive math software. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) Artificial Intelligence in Education, pp. 460–471. Springer International Publishing, Cham (2020)
Ritter, S., Anderson, J.R., Koedinger, K., Corbett, A.T.: Cognitive tutor: applied research in mathematics education. Psychonom. Bull. Rev. 14, 249–255 (2007)
Ritter, S., Murphy, A., Fancsali, S.E., Fitkariwala, V., Lomas, J.D.: Upgrade: An open source tool to support a/b testing in educational software. In: Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books (2020)
Acknowledgements
Research reported here was supported by Institute of Education Sciences, U.S. Department of Education, grant R324A210289 to CAST. Opinions expressed do not represent views of the IES or U.S. Department of Education.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Almoubayyed, H. et al. (2023). Rewriting Math Word Problems to Improve Learning Outcomes for Emerging Readers: A Randomized Field Trial in Carnegie Learning’s MATHia. In: Wang, N., Rebolledo-Mendez, G., Dimitrova, V., Matsuda, N., Santos, O.C. (eds) Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky. AIED 2023. Communications in Computer and Information Science, vol 1831. Springer, Cham. https://doi.org/10.1007/978-3-031-36336-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-36336-8_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36335-1
Online ISBN: 978-3-031-36336-8
eBook Packages: Computer ScienceComputer Science (R0)