skip to main content
10.1145/3652583.3658030acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
research-article

Discovering Multi-Relational Integration for Knowledge Tracing with Retentive Networks

Published: 07 June 2024 Publication History

Abstract

Knowledge Tracing (KT) focuses on estimating students' knowledge states and predicting their future performances, which is a crucial task for online education platforms. In light of the advancements in educational big data and deep neural networks, numerous KT models have been proposed and promising outcomes have been achieved. Nevertheless, we have noted that current methods possess certain evident constraints. Thus, we propose a Knowledge Tracing model with Multi-Relational Integration (MRIKT): (1) we consider the more sophisticated relations between questions and skills, which can reveal deeper patterns of students' learning; (2) we emphasize the forgetfulness nature of students and the value of inter-exercises relations by incorporating a retentive module. Specifically, we choose graph convolutional networks to construct the advanced-relation between questions and skills, named graph representation module. Additionally, by linking different exercises, our novel retentive module, inspired by RetNet, can acquire valuable insights. We extensively evaluate the performance of MRIKT on three real-world datasets. The results demonstrate that MRIKT achieves outstanding performance, which improves at least 8.44% compared to baseline models.

References

[1]
Ghodai Abdelrahman and Qing Wang. 2019. Knowledge tracing with sequential key-value memory networks. In Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval. 175--184.
[2]
Ghodai Abdelrahman, Qing Wang, and Bernardo Nunes. 2023. Knowledge tracing: A survey. Comput. Surveys, Vol. 55, 11 (2023), 1--37.
[3]
Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2014. Engaging with massive online courses. In Proceedings of the 23rd International Conference on World Wide Web (Seoul, Korea) (WWW '14). Association for Computing Machinery, New York, NY, USA, 687--698. https://doi.org/10.1145/2566486.2568042
[4]
Hao Cen, Kenneth Koedinger, and Brian Junker. 2006. Learning factors analysis--a general method for cognitive model evaluation and improvement. In International conference on intelligent tutoring systems. Springer, 164--175.
[5]
Hao Cen, Kenneth Koedinger, and Brian Junker. 2008. Comparing two IRT models for conjunctive skills. In Intelligent Tutoring Systems: 9th International Conference, ITS 2008, Montreal, Canada, June 23--27, 2008 Proceedings 9. Springer, 796--798.
[6]
Zhu Changsheng, Po Shichao, and Ma Fanglan. 2023. A Temporal Convolutional Knowledge Tracing Model Integrating Forgetting Factors and Item Response Theory. In 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT). IEEE, 200--204.
[7]
Chih-Ming Chen, Hahn-Ming Lee, and Ya-Hui Chen. 2005. Personalized e-learning system using Item Response Theory. Computers & Education, Vol. 44, 3 (2005), 237--255. https://doi.org/10.1016/j.compedu.2004.01.006
[8]
Youngduck Choi, Youngnam Lee, Dongmin Shin, Junghyun Cho, Seoyon Park, Seewoo Lee, Jineon Baek, Chan Bae, Byungsoo Kim, and Jaewe Heo. 2020. EdNet: A Large-Scale Hierarchical Dataset in Education. In Artificial Intelligence in Education, Ig Ibert Bittencourt, Mutlu Cukurova, Kasia Muldner, Rose Luckin, and Eva Millán (Eds.). Springer International Publishing, Cham, 69--73.
[9]
Albert T Corbett and John R Anderson. 1994. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction, Vol. 4 (1994), 253--278.
[10]
Jiajun Cui, Zeyuan Chen, Aimin Zhou, Jianyong Wang, and Wei Zhang. 2023. Fine-Grained Interaction Modeling with Multi-Relational Transformer for Knowledge Tracing. ACM Transactions on Information Systems, Vol. 41, 4 (2023), 1--26.
[11]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[12]
Sean R Eddy. 2004. What is a hidden Markov model? Nature biotechnology, Vol. 22, 10 (2004), 1315--1316.
[13]
Susan E Embretson and Steven P Reise. 2013. Item response theory. Psychology Press.
[14]
Danial Hooshyar, Yueh-Min Huang, and Yeongwook Yang. 2022. GameDKT: Deep knowledge tracing in educational games. Expert Systems with Applications, Vol. 196 (2022), 116670. https://doi.org/10.1016/j.eswa.2022.116670
[15]
Yujia Huo, Derek F. Wong, Lionel M. Ni, Lidia S. Chao, and Jing Zhang. 2020. Knowledge modeling via contextualized representations for LSTM-based personalized exercise recommendation. Information Sciences, Vol. 523 (2020), 266--278. https://doi.org/10.1016/j.ins.2020.03.014
[16]
Hua Jiang, Bing Xiao, Yintao Luo, and Junliang Ma. 2023. A self-attentive model for tracing knowledge and engagement in parallel. Pattern Recognition Letters, Vol. 165 (2023), 25--32.
[17]
Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).
[18]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. nature, Vol. 521, 7553 (2015), 436--444.
[19]
Zhaoxing Li, Mark Jacobsen, Lei Shi, Yunzhan Zhou, and Jindi Wang. 2023. Broader and Deeper: A Multi-Features with Latent Relations BERT Knowledge Tracing Model. In European Conference on Technology Enhanced Learning. Springer, 183--197.
[20]
Ting Long, Jiarui Qin, Jian Shen, Weinan Zhang, Wei Xia, Ruiming Tang, Xiuqiang He, and Yong Yu. 2022. Improving knowledge tracing with collaborative information. In Proceedings of the fifteenth ACM international conference on web search and data mining. 599--607.
[21]
Larry R Medsker and LC Jain. 2001. Recurrent neural networks. Design and Applications, Vol. 5, 64--67 (2001), 2.
[22]
Hiromi Nakagawa, Yusuke Iwasawa, and Yutaka Matsuo. 2019. Graph-based knowledge tracing: modeling student proficiency using graph neural network. In IEEE/WIC/ACM International Conference on Web Intelligence. 156--163.
[23]
Shalini Pandey and George Karypis. 2019. A self-attentive model for knowledge tracing. arXiv preprint arXiv:1907.06837 (2019).
[24]
Shalini Pandey and Jaideep Srivastava. 2020. RKT: relation-aware self-attention for knowledge tracing. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1205--1214.
[25]
Philip I Pavlik Jr and John R Anderson. 2005. Practice and forgetting effects on vocabulary memory: An activation-based model of the spacing effect. Cognitive science, Vol. 29, 4 (2005), 559--586.
[26]
Philip I Pavlik Jr, Hao Cen, and Kenneth R Koedinger. 2009. Performance Factors Analysis--A New Alternative to Knowledge Tracing. Online Submission (2009).
[27]
Radek Pelánek. 2015. Modeling Students' Memory for Application in Adaptive Educational Systems. International Educational Data Mining Society (2015).
[28]
Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. Advances in neural information processing systems, Vol. 28 (2015).
[29]
Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE transactions on neural networks, Vol. 20, 1 (2008), 61--80.
[30]
Xiangyu Song, Jianxin Li, Qi Lei, Wei Zhao, Yunliang Chen, and Ajmal Mian. 2022. Bi-CLKT: Bi-graph contrastive learning based knowledge tracing. Knowledge-Based Systems, Vol. 241 (2022), 108274.
[31]
Xiangyu Song, Jianxin Li, Yifu Tang, Taige Zhao, Yunliang Chen, and Ziyu Guan. 2021. Jkt: A joint graph convolutional network based deep knowledge tracing. Information Sciences, Vol. 580 (2021), 510--523.
[32]
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, and Furu Wei. 2023. Retentive Network: A Successor to Transformer for Large Language Models. arxiv: 2307.08621 [cs.CL]
[33]
Weicong Tan, Yuan Jin, Ming Liu, and He Zhang. 2021. BiDKT: Deep knowledge tracing with BERT. In International Conference on Ad Hoc Networks. Springer, 260--278.
[34]
Xuetao Tian and Feng Liu. 2021. Capacity Tracing-Enhanced Course Recommendation in MOOCs. IEEE Transactions on Learning Technologies, Vol. 14, 3 (2021), 313--321. https://doi.org/10.1109/TLT.2021.3083180
[35]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017).
[36]
Petar Velivc ković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017).
[37]
Yuxin Wu and Kaiming He. 2018. Group normalization. In Proceedings of the European conference on computer vision (ECCV). 3--19.
[38]
Yang Yang, Jian Shen, Yanru Qu, Yunfei Liu, Kerong Wang, Yaoming Zhu, Weinan Zhang, and Yong Yu. 2021. GIKT: A Graph-Based Interaction Model for Knowledge Tracing. In Machine Learning and Knowledge Discovery in Databases, Frank Hutter, Kristian Kersting, Jefrey Lijffijt, and Isabel Valera (Eds.). Springer International Publishing, Cham, 299--315.
[39]
Michael V Yudelson, Kenneth R Koedinger, and Geoffrey J Gordon. 2013. Individualized bayesian knowledge tracing models. In Artificial Intelligence in Education: 16th International Conference, AIED 2013, Memphis, TN, USA, July 9--13, 2013. Proceedings 16. Springer, 171--180.
[40]
Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic key-value memory networks for knowledge tracing. In Proceedings of the 26th international conference on World Wide Web. 765--774.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMR '24: Proceedings of the 2024 International Conference on Multimedia Retrieval
May 2024
1379 pages
ISBN:9798400706196
DOI:10.1145/3652583
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. graph convolutional network
  2. knowledge tracing
  3. online education platforms
  4. retentive network

Qualifiers

  • Research-article

Funding Sources

  • Natural Science Foundation of Guangdong Province
  • Open Fund of National Engineering Laboratory for Big Data System Computing Technology
  • Open Research Fund from Guangdong Laboratory of Artificial Intelligence and Digital Economy(SZ)
  • table Support Project of Shenzhen under Grant

Conference

ICMR '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 115
    Total Downloads
  • Downloads (Last 12 months)115
  • Downloads (Last 6 weeks)13
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media