Skip to main content

Learning from Heterogeneous Student Behaviors for Multiple Prediction Tasks

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12113))

Abstract

Prediction tasks about students have practical real-world significance at both student level and university level. For example, predicting if a student will fail to graduate can alert the university student affairs office to take predictive measures to help the student improve academic performance. In this paper, we focus on making multiple predictions together, since leaning the model for a specific task may have the data-sparsity problem. With the rapid development of smart campus, the university is accumulating a large amount of heterogeneous data of student behaviors, such as entering libraries behavior, entering dormitory behavior. In this paper, we propose to learn from heterogeneous student behaviors for making multiple predictions about students. However, leveraging heterogeneous behaviors have two main challenges. First, student profiles have a large impact on their behaviors and have not been well modeled in previous studies. Second, behaviors of different days will have different degrees of impact and should be treated unequally. To address these challenges, we propose a novel variant of LSTM and a novel attention mechanism. The proposed LSTM is able to learn student profile-aware representation from the heterogeneous behavior sequences. The proposed attention mechanism can dynamically learn the different importance degrees of different days for every student. With multi-task learning, we can deal with multiple perdition tasks at the same time to alleviate the data-sparsity problem. Qualitative and quantitative experiments on a real-world dataset collected at Shanghai Jiao Tong University (SJTU) have demonstrated the effectiveness of our model.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: ICLR (2015)

    Google Scholar 

  2. Brinton, C.G., Chiang, M.: MOOC performance prediction via clickstream data and social learning networks. In: INFOCOM, pp. 2299–2307 (2015)

    Google Scholar 

  3. Calvo-Flores, M.D., Galindo, E.G., Jiménez, M.P., Pineiro, O.P.: Predicting students’ marks from Moodle logs using neural network models. Curr. Dev. Technol.-Assist. Educ. 1(2), 586–590 (2006)

    Google Scholar 

  4. Caruana, R.: Multitask learning. Mach. Learn. 28(1), 41–75 (1997). https://doi.org/10.1023/A:1007379606734

    Article  MathSciNet  Google Scholar 

  5. Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)

  6. Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: ICML, pp. 160–167 (2008)

    Google Scholar 

  7. Dai, J., He, K., Sun, J.: Instance-aware semantic segmentation via multi-task network cascades. In: CVPR, pp. 3150–3158 (2016)

    Google Scholar 

  8. Fei, M., Yeung, D.Y.: Temporal models for predicting student dropout in massive open online courses. In: International Conference on Data Mining Workshop (ICDMW), pp. 256–263 (2015)

    Google Scholar 

  9. Feng, M., Heffernan, N., Koedinger, K.: Addressing the assessment challenge with an online system that tutors as it assesses. UMUAI 19(3), 243–266 (2009). https://doi.org/10.1007/s11257-009-9063-7

    Article  Google Scholar 

  10. Guan, C., Lu, X., Li, X., Chen, E., Zhou, W., Xiong, H.: Discovery of college students in financial hardship. In: ICDM, pp. 141–150 (2015)

    Google Scholar 

  11. He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: ICCV, pp. 1026–1034 (2015)

    Google Scholar 

  12. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  13. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)

    Google Scholar 

  14. Lopez, M.I., Luna, J., Romero, C., Ventura, S.: Classification via clustering for predicting final marks based on student participation in forums. International Educational Data Mining Society (2012)

    Google Scholar 

  15. van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. JMLR 9, 2579–2605 (2008)

    MATH  Google Scholar 

  16. Minaei-Bidgoli, B., Kashy, D.A., Kortemeyer, G., Punch, W.F.: Predicting student performance: an application of data mining methods with an educational web-based system. In: FIE 2003 33rd Annual Frontiers in Education, vol. 1, p. T2A-13 (2003)

    Google Scholar 

  17. Nghe, N.T., Janecek, P., Haddawy, P.: A comparative analysis of techniques for predicting academic performance. In: 2007 37th Annual Frontiers in Education Conference-Global Engineering: Knowledge Without Borders, Opportunities Without Passports, FIE 2007, p. T2G-7 (2007)

    Google Scholar 

  18. Ranjan, R., Patel, V.M., Chellappa, R.: HyperFace: a deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. PAMI 41(1), 121–135 (2017)

    Article  Google Scholar 

  19. Romero, C., López, M.I., Luna, J.M., Ventura, S.: Predicting students’ final performance from participation in on-line discussion forums. Comput. Educ. 68, 458–472 (2013)

    Article  Google Scholar 

  20. Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. 45(11), 2673–2681 (1997)

    Article  Google Scholar 

  21. Shahiri, A.M., Husain, W., et al.: A review on predicting student’s performance using data mining techniques. Procedia Comput. Sci. 72, 414–422 (2015)

    Article  Google Scholar 

  22. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. JMLR 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  23. Sukhbaatar, O., Usagawa, T., Choimaa, L.: An artificial neural network based early prediction of failure-prone students in blended learning course. Int. J. Emerg. Technol. Learn. 14(19), 77–92 (2019)

    Article  Google Scholar 

  24. Sweeney, M., Lester, J., Rangwala, H.: Next-term student grade prediction. In: International Conference on Big Data (Big Data), pp. 970–975 (2015)

    Google Scholar 

  25. Tanner, T., Toivonen, H., et al.: Predicting and preventing student failure-using the k-nearest neighbour method to predict student performance in an online course environment. Int. J. Learn. Technol. 5(4), 356–377 (2010)

    Article  Google Scholar 

  26. Tian, M.: Application of chaotic time series prediction in forecasting of library borrowing flow. In: International Conference on Internet Computing and Information Services, pp. 557–559 (2011)

    Google Scholar 

  27. Wang, R., Harari, G., Hao, P., Zhou, X., Campbell, A.T.: SmartGPA: how smartphones can assess and predict academic performance of college students. In: UbiComp, pp. 295–306 (2015)

    Google Scholar 

  28. Wang, R., Tang, Y., Li, L.: Application of BP neural network to prediction of library circulation. In: International Conference on Cognitive Informatics and Cognitive Computing, pp. 420–423 (2012)

    Google Scholar 

  29. Wang, Y., Liao, H.C.: Data mining for adaptive learning in a TESL-based e-learning system. Expert Syst. Appl. 38(6), 6480–6485 (2011)

    Article  Google Scholar 

  30. Xu, J., Han, Y., Marcu, D., Van Der Schaar, M.: Progressive prediction of student performance in college programs. In: AAAI, pp. 1604–1610 (2017)

    Google Scholar 

  31. Yao, H., Nie, M., Su, H., Xia, H., Lian, D.: Predicting academic performance via semi-supervised learning with constructed campus social network. In: Candan, S., Chen, L., Pedersen, T.B., Chang, L., Hua, W. (eds.) DASFAA 2017. LNCS, vol. 10178, pp. 597–609. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55699-4_37

    Chapter  Google Scholar 

  32. Yu, H.F., et al.: Feature engineering and classifier ensemble for KDD cup 2010. In: KDD Cup (2010)

    Google Scholar 

  33. Zhang, D., Guo, B., Li, B., Yu, Z.: Extracting social and community intelligence from digital footprints: an emerging research area. In: Yu, Z., Liscano, R., Chen, G., Zhang, D., Zhou, X. (eds.) UIC 2010. LNCS, vol. 6406, pp. 4–18. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16355-5_4

    Chapter  Google Scholar 

Download references

Acknowledgments

This research is supported in part by the 2030 National Key AI Program of China 2018AAA0100503 (2018AAA0100500), National Science Foundation of China (No. 61772341, No. 61472254), Shanghai Municipal Science and Technology Commission (No. 18511103002, No. 19510760500, and No. 19511101500), the Program for Changjiang Young Scholars in University of China, the Program for China Top Young Talents, the Program for Shanghai Top Young Talents, Shanghai Engineering Research Center of Digital Education Equipment, and SJTU Global Strategic Partnership Fund (2019 SJTU-HKUST).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yanmin Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, H., Zhu, Y., Xu, Y. (2020). Learning from Heterogeneous Student Behaviors for Multiple Prediction Tasks. In: Nah, Y., Cui, B., Lee, SW., Yu, J.X., Moon, YS., Whang, S.E. (eds) Database Systems for Advanced Applications. DASFAA 2020. Lecture Notes in Computer Science(), vol 12113. Springer, Cham. https://doi.org/10.1007/978-3-030-59416-9_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59416-9_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59415-2

  • Online ISBN: 978-3-030-59416-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics