Abstract
We conducted a study to see if using Bayesian Knowledge Tracing (BKT) models would save time and problems in programming tutors. We used legacy data collected by two programming tutors to compute BKT models for every concept covered by each tutor. The novelty of our model was that slip and guess parameters were computed for every problem presented by each tutor. Next, we used cross-validation to evaluate whether the resulting BKT model would have reduced the number of practice problems solved and time spent by the students represented in the legacy data. We found that in 64.23% of the concepts, students would have saved time with the BKT model. The savings varied among concepts. Overall, students would have saved a mean of 1.28 min and 1.23 problems per concept. We also found that BKT models were more effective at saving time and problems on harder concepts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baker, R.S.J., Corbett, A.T., Aleven, V.: More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian Knowledge Tracing. In: Proceedings of the 9th International Conference on Intelligent Tutoring Systems, Berlin, Germany. pp. 406–415 (2008)
Beck, J.: Difficulties in inferring student knowledge from observations (and why you should care). In: Educational Data Mining: Supplementary Proceedings of the 13th International Conference of Artificial Intelligence in Education, pp. 21–30 (2007)
Beck, J.E., Chang, K.-M.: Identifiability: a fundamental problem of student modeling. In: Proceedings of the 11th International Conference on User Modeling (UM 2007), pp. 137–146 (2007)
Bhatt, S., Zhao, J., Thille, C., Zimmaro, D., Gattani, N.: Evaluating Bayesian knowledge tracing for estimating learner proficiency and guiding learner behavior. In: L@S’20: Proceedings of the Seventh ACM Conference on Learning @ Scale, pp. 357–260. Association for Computing Machinery, New York (2020)
Corbett, A.T., Anderson, J.R.: Knowledge tracing: modeling the acquisition of procedural knowledge. User Model. User-Adap. Inter. 4, 253–278 (1992)
Hawkins, W.J., Heffernan, N.T., Baker, R.S.J.D.: Learning Bayesian knowledge tracing parameters with a knowledge heuristic and empirical probabilities. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds.) ITS 2014. LNCS, vol. 8474, pp. 150–155. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07221-0_18
Kumar, A.N.: A model for deploying software tutors. In: IEEE 6th International Conference on Technology for Education (T4E), Amritapuri, India, pp. 3–9 (2014)
Acknowledgements
Partial support for this work was provided by the National Science Foundation under grant DUE-1432190.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Getseva, V., Kumar, A.N. (2021). Comparing Bayesian Knowledge Tracing Model Against Naïve Mastery Model. In: Cristea, A.I., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2021. Lecture Notes in Computer Science(), vol 12677. Springer, Cham. https://doi.org/10.1007/978-3-030-80421-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-80421-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-80420-6
Online ISBN: 978-3-030-80421-3
eBook Packages: Computer ScienceComputer Science (R0)