Abstract
Prediction tasks about students have practical real-world significance at both student level and university level. For example, predicting if a student will fail to graduate can alert the university student affairs office to take predictive measures to help the student improve academic performance. In this paper, we focus on making multiple predictions together, since leaning the model for a specific task may have the data-sparsity problem. With the rapid development of smart campus, the university is accumulating a large amount of heterogeneous data of student behaviors, such as entering libraries behavior, entering dormitory behavior. In this paper, we propose to learn from heterogeneous student behaviors for making multiple predictions about students. However, leveraging heterogeneous behaviors have two main challenges. First, student profiles have a large impact on their behaviors and have not been well modeled in previous studies. Second, behaviors of different days will have different degrees of impact and should be treated unequally. To address these challenges, we propose a novel variant of LSTM and a novel attention mechanism. The proposed LSTM is able to learn student profile-aware representation from the heterogeneous behavior sequences. The proposed attention mechanism can dynamically learn the different importance degrees of different days for every student. With multi-task learning, we can deal with multiple perdition tasks at the same time to alleviate the data-sparsity problem. Qualitative and quantitative experiments on a real-world dataset collected at Shanghai Jiao Tong University (SJTU) have demonstrated the effectiveness of our model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: ICLR (2015)
Brinton, C.G., Chiang, M.: MOOC performance prediction via clickstream data and social learning networks. In: INFOCOM, pp. 2299–2307 (2015)
Calvo-Flores, M.D., Galindo, E.G., Jiménez, M.P., Pineiro, O.P.: Predicting students’ marks from Moodle logs using neural network models. Curr. Dev. Technol.-Assist. Educ. 1(2), 586–590 (2006)
Caruana, R.: Multitask learning. Mach. Learn. 28(1), 41–75 (1997). https://doi.org/10.1023/A:1007379606734
Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)
Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: ICML, pp. 160–167 (2008)
Dai, J., He, K., Sun, J.: Instance-aware semantic segmentation via multi-task network cascades. In: CVPR, pp. 3150–3158 (2016)
Fei, M., Yeung, D.Y.: Temporal models for predicting student dropout in massive open online courses. In: International Conference on Data Mining Workshop (ICDMW), pp. 256–263 (2015)
Feng, M., Heffernan, N., Koedinger, K.: Addressing the assessment challenge with an online system that tutors as it assesses. UMUAI 19(3), 243–266 (2009). https://doi.org/10.1007/s11257-009-9063-7
Guan, C., Lu, X., Li, X., Chen, E., Zhou, W., Xiong, H.: Discovery of college students in financial hardship. In: ICDM, pp. 141–150 (2015)
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: ICCV, pp. 1026–1034 (2015)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)
Lopez, M.I., Luna, J., Romero, C., Ventura, S.: Classification via clustering for predicting final marks based on student participation in forums. International Educational Data Mining Society (2012)
van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. JMLR 9, 2579–2605 (2008)
Minaei-Bidgoli, B., Kashy, D.A., Kortemeyer, G., Punch, W.F.: Predicting student performance: an application of data mining methods with an educational web-based system. In: FIE 2003 33rd Annual Frontiers in Education, vol. 1, p. T2A-13 (2003)
Nghe, N.T., Janecek, P., Haddawy, P.: A comparative analysis of techniques for predicting academic performance. In: 2007 37th Annual Frontiers in Education Conference-Global Engineering: Knowledge Without Borders, Opportunities Without Passports, FIE 2007, p. T2G-7 (2007)
Ranjan, R., Patel, V.M., Chellappa, R.: HyperFace: a deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. PAMI 41(1), 121–135 (2017)
Romero, C., López, M.I., Luna, J.M., Ventura, S.: Predicting students’ final performance from participation in on-line discussion forums. Comput. Educ. 68, 458–472 (2013)
Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. 45(11), 2673–2681 (1997)
Shahiri, A.M., Husain, W., et al.: A review on predicting student’s performance using data mining techniques. Procedia Comput. Sci. 72, 414–422 (2015)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. JMLR 15(1), 1929–1958 (2014)
Sukhbaatar, O., Usagawa, T., Choimaa, L.: An artificial neural network based early prediction of failure-prone students in blended learning course. Int. J. Emerg. Technol. Learn. 14(19), 77–92 (2019)
Sweeney, M., Lester, J., Rangwala, H.: Next-term student grade prediction. In: International Conference on Big Data (Big Data), pp. 970–975 (2015)
Tanner, T., Toivonen, H., et al.: Predicting and preventing student failure-using the k-nearest neighbour method to predict student performance in an online course environment. Int. J. Learn. Technol. 5(4), 356–377 (2010)
Tian, M.: Application of chaotic time series prediction in forecasting of library borrowing flow. In: International Conference on Internet Computing and Information Services, pp. 557–559 (2011)
Wang, R., Harari, G., Hao, P., Zhou, X., Campbell, A.T.: SmartGPA: how smartphones can assess and predict academic performance of college students. In: UbiComp, pp. 295–306 (2015)
Wang, R., Tang, Y., Li, L.: Application of BP neural network to prediction of library circulation. In: International Conference on Cognitive Informatics and Cognitive Computing, pp. 420–423 (2012)
Wang, Y., Liao, H.C.: Data mining for adaptive learning in a TESL-based e-learning system. Expert Syst. Appl. 38(6), 6480–6485 (2011)
Xu, J., Han, Y., Marcu, D., Van Der Schaar, M.: Progressive prediction of student performance in college programs. In: AAAI, pp. 1604–1610 (2017)
Yao, H., Nie, M., Su, H., Xia, H., Lian, D.: Predicting academic performance via semi-supervised learning with constructed campus social network. In: Candan, S., Chen, L., Pedersen, T.B., Chang, L., Hua, W. (eds.) DASFAA 2017. LNCS, vol. 10178, pp. 597–609. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55699-4_37
Yu, H.F., et al.: Feature engineering and classifier ensemble for KDD cup 2010. In: KDD Cup (2010)
Zhang, D., Guo, B., Li, B., Yu, Z.: Extracting social and community intelligence from digital footprints: an emerging research area. In: Yu, Z., Liscano, R., Chen, G., Zhang, D., Zhou, X. (eds.) UIC 2010. LNCS, vol. 6406, pp. 4–18. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16355-5_4
Acknowledgments
This research is supported in part by the 2030 National Key AI Program of China 2018AAA0100503 (2018AAA0100500), National Science Foundation of China (No. 61772341, No. 61472254), Shanghai Municipal Science and Technology Commission (No. 18511103002, No. 19510760500, and No. 19511101500), the Program for Changjiang Young Scholars in University of China, the Program for China Top Young Talents, the Program for Shanghai Top Young Talents, Shanghai Engineering Research Center of Digital Education Equipment, and SJTU Global Strategic Partnership Fund (2019 SJTU-HKUST).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, H., Zhu, Y., Xu, Y. (2020). Learning from Heterogeneous Student Behaviors for Multiple Prediction Tasks. In: Nah, Y., Cui, B., Lee, SW., Yu, J.X., Moon, YS., Whang, S.E. (eds) Database Systems for Advanced Applications. DASFAA 2020. Lecture Notes in Computer Science(), vol 12113. Springer, Cham. https://doi.org/10.1007/978-3-030-59416-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-59416-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59415-2
Online ISBN: 978-3-030-59416-9
eBook Packages: Computer ScienceComputer Science (R0)