Eric Van Inwegen
Seth Adjei
Yan Wang
Neil Heffernan
ABSTRACT
To better model students' learning, user modelling should be able to use the detailed sequence of student actions to model student knowledge, not just their right/wrong scores. Our goal is to analyze the question: "Does it matter when a hint is used?". We look at students who use identical attempt counts to get the right answer and look for the impact of help use and action order on future performance. We conclude that students who use hints too early do worse than students who use hints later. However, students who use hints, at times, may perform as well as students who do not use hints. This paper makes a novel contribution showing for the first time that paying attention to the precise sequence of hints and attempts allows better prediction of students' performance, as well as to definitively show that, when we control for the number of attempts and hints, students that attempt problems before asking for hints show higher performance on the next question. This analysis shows that the pattern of hints and attempts, not just their numbers, is important.
- Attali, Y., & Powers, D. (2010). Immediate feedback and opportunity to revise answers to open-ended questions. Educational and Psychological Measurement, 70(1), 22--35.Google Scholar
Cross Ref
- Beck, J. E., Chang, K., Mostow, J., & Corbett, A. (2008). Does help help? Introducing the Bayesian Evaluation and Assessment methodology. Intelligent Tutoring Systems. Springer Berlin Heidelberg. Google ScholarDigital Library
- Corbett, A. T., & Anderson, J. R. (1994). Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction, 4(4), 253--278.Google Scholar
- Duong, H. D., Zhu, L., Wang, Y., & Heffernan, N. T. (2013). A Prediction Model Uses the Sequence of Attempts and Hints to Better Predict Knowledge: Better to Attempt the Problem First, Rather Than Ask for a Hint. Paper Submitted to EDM.Google Scholar
- Feng, M., Heffernan, N. T., & Koedinger, K. R. (2006). Predicting state test scores better with intelligent tutoring systems: developing metrics to measure assistance required. Intelligent Tutoring Systems. Springer Berlin Heidelberg. Google ScholarDigital Library
- Hawkins, W., Heffernan, N., Wang, Y., & Baker, R. S. Extending the Assistance Model: Analyzing the Use of Assistance over Time.Google Scholar
- Murphy, K.: Bayes Net Toolbox for Matlab. < https://code.google.com/p/bnt/ > Accessed 4 September, 2014Google Scholar
- Pardos, Z. A., & Heffernan, N. T. (2010). Modeling individualization in a bayesian networks implementation of knowledge tracing. User Modeling, Adaptation, and Personalization, 255--266. Google ScholarDigital Library
- Pavlik Jr, P. I., Cen, H., & Koedinger, K. R. (2009). Performance Factors Analysis--A New Alternative to Knowledge Tracing. Online Submission.Google Scholar
- Qiu, Y., Pardos, Z. A., & Heffernan, N. T. (2012). Towards Data Driven Model Improvement. FLAIRS Conference.Google Scholar
- Qiu, Y., Qi, Y., Lu, H., Pardos, Z. A., & Heffernan, N. T. (2011). Does Time Matter? Modeling the Effect of Time with Bayesian Knowledge Tracing. EDM.Google Scholar
- Wang, Y., & Heffernan, N. T. (2012). Leveraging First Response Time into the Knowledge Tracing Model. International Educational Data Mining Society.Google Scholar
- Wang, Y., & Heffernan, N. T. (2011). The "Assistance" Model: Leveraging How Many Hints and Attempts a Student Needs. FLAIRS Conference.Google Scholar
- Zhu, L., Wang, Y., & Heffernan, N. T. The Sequence of Action Model: Leveraging the Sequence of Attempts and Hints.Google Scholar
Index Terms
- An analysis of the impact of action order on future performance: the fine-grain action model
Recommendations
Future directions in desktop video
SIGGRAPH '89: ACM SIGGRAPH 89 Panel ProceedingsGood morning. My name is Tim Heidmann and I'd like to welcome you all to this panel, which is entitled Future Directions in Desktop Video, and I'd especially like to thank all you people who stayed up a little late on Thursday night to come to this panel. ...
Future directions in desktop video
Good morning. My name is Tim Heidmann and I'd like to welcome you all to this panel, which is entitled Future Directions in Desktop Video, and I'd especially like to thank all you people who stayed up a little late on Thursday night to come to this panel. ...
Virtual environments and interactivity: windows to the future
I really apologize. I promised everyone I would come out wearing the data suit, but it just slipped my mind and I never got around to it. Actually Marvin Minsky was saying that the thing to do would be to come out with nothing on because that would be ...
Comments