Abstract
Building a generalizable detector of student behavior within intelligent tutoring systems presents two challenges: transferring between different cohorts of students (who may develop idiosyncratic strategies of use), and transferring between different tutor lessons (which may have considerable variation in their interfaces, making cognitively equivalent behaviors appear quite different within log files). In this paper, we present a machine-learned detector which identifies students who are “gaming the system”, attempting to complete problems with minimal cognitive effort, and determine that the detector transfers successfully across student cohorts but less successfully across tutor lessons.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baker, R.S., Corbett, A.T., Koedinger, K.R.: Detecting Student Misuse of Intelligent Tutoring Systems. In: Proceedings of the 7th International Conference on Intelligent Tutoring Systems, pp. 531–540 (2004)
Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z.: Off-Task Behavior in the Cognitive Tutor Classroom: When Students Game the System. In: Proceedings of ACM CHI 2004: Computer-Human Interaction, pp. 383–390 (2004)
Donaldson, W.: Accuracy of d’ and A’ as Estimates of Sensitivity. Bulletin of the Psychonomic Society 31(4), 271–274 (1993)
Maris, E.: Psychometric Latent Response Models. Psychometrika 60(4), 523–547 (1995)
Stevens, R., Soller, A., Cooper, M., Sprang, M.: Modeling the Development of Problem-Solving Skills in Chemistry with a Web-Based Tutor. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 580–591. Springer, Heidelberg (2004)
Yu, L., Liu, H.: Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution. In: Proc. of the Intl. Conference on Machine Learning (ICML 2003), pp. 856–863 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baker, R.S., Corbett, A.T., Koedinger, K.R., Roll, I. (2005). Detecting When Students Game the System, Across Tutor Subjects and Classroom Cohorts. In: Ardissono, L., Brna, P., Mitrovic, A. (eds) User Modeling 2005. UM 2005. Lecture Notes in Computer Science(), vol 3538. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527886_28
Download citation
DOI: https://doi.org/10.1007/11527886_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27885-6
Online ISBN: 978-3-540-31878-1
eBook Packages: Computer ScienceComputer Science (R0)