Abstract
Knowledge tracing (KT) lies at the core of intelligent education, which aims to diagnose students’ changing knowledge level over time based on their historical performance. Most of the existing KT models either ignore the significance of Q-matrix associated exercises with knowledge concepts (KCs) or fail to eliminate the subjective tendency of experts within the Q-matrix, thus it is insufficient for capturing complex interaction between students and exercises. In this paper, we propose a novel Relevance-Aware Q-matrix Calibration method for knowledge tracing (RAQC), which incorporates the calibrated Q-matrix into Long Short-Term Memory (LSTM) network to model the complex students’ learning process, for getting both accurate and interpretable diagnosis results. Specifically, we first leverage the message passing mechanism in Graph Convolution Network (GCN) to fully exploit the high-order connectivity between exercises and KCs for obtaining a potential KC list. Then, we propose a Q-matrix calibration method by using relevance scores between exercises and KCs to mitigate the problem of subjective bias existed in human-labeled Q-matrix. After that, the embedding of each exercise aggregated the calibrated Q-matrix with the corresponding response log is fed into the LSTM to tracing students’ knowledge states (KS). Extensive experimental results on two real-world datasets show the effectiveness of the proposed method.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y.D., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639–648 (2020)
Huo, Y., Wong, D., Ni, L., Chao, L., Zhang, J.: HeTROPY: explainable learning diagnostics via heterogeneous maximum-entropy and multi-spatial knowledge representation. Knowl.-Based Syst. 207, 106389 (2020)
Huo, Y., Wong, D., Ni, L., Chao, L., Zhang, J.: Knowledge modeling via contextualized representations for LSTM-based personalized exercise recommendation. Inf. Sci. 523, 266–278 (2020)
Jimmy, D.L.T., Chiu, C.Y.: A general method of empirical Q-matrix validation. Psychometrika 81(2), 253–273 (2016)
Jimmy, D.L.T.: DINA model and parameter estimation: a didactic. J. Nutr. Educ. Behav. Stat. 523, 266–278 (2009)
Liu, Q., et al.: EKT: exercise-aware knowledge tracing for student performance prediction. IEEE Trans. Knowl. Data Eng. 33(1), 100–115 (2021)
Liu, Y., Yang, Y., Chen, X., Shen, J., Zhang, H., Yu, Y.: Improving knowledge tracing via pre-training question embeddings. In: Proceedings of the 29th International Joint Conference on Artificial Intelligence, pp. 1577–1583. Morgan Kaufmann (2020)
Ma, W., Jimmy, D.L.T.: GDINA: an R package for cognitive diagnosis modeling. J. Stat. Softw. 93(14), 1–26 (2020)
Piech, C., et al.: Deep knowledge tracing. In: Proceedings of the 28th International Conference on Neural Information Processing Systems, pp. 505–513 (2015)
Wang, C., et al.: Temporal cross-effects in knowledge tracing. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 517–525. ACM (2021)
Wang, D., Cai, Y., Tu, D.: Q-matrix estimation methods for cognitive diagnosis models: based on partial known Q-matrix. Multivar. Behav. Res. 2020, 1–13 (2020)
Wang, F., et al.: Neural cognitive diagnosis for intelligent education systems. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence, pp. 6153–6161. AAAI (2020)
Zhang, J., Shi, X., King, I., Yeung, D.Y.: Dynamic key-value memory networks for knowledge tracing. In: Proceedings of the 26th International Conference on World Wide Web, pp. 765–774 (2017)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (61762078, 61363058, 61966004, 62167007), Research Fund of Guangxi Key Lab of Multi-source Information Mining and Security (MIMS18-08), Northwest Normal University Young Teachers Research Capacity Promotion Plan (NWNU-LKQN2019-2), Northwest Normal University Postgraduate Research Funding Project (2020-KYZZ001151), and Research Fund of Guangxi Key Laboratory of Trusted Software (kx202003).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, W., Ma, H., Zhao, Y., Li, Z., He, X. (2021). Relevance-Aware Q-matrix Calibration for Knowledge Tracing. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12893. Springer, Cham. https://doi.org/10.1007/978-3-030-86365-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-86365-4_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86364-7
Online ISBN: 978-3-030-86365-4
eBook Packages: Computer ScienceComputer Science (R0)