Skip to main content

XGBoost and Deep Neural Network Comparison: The Case of Teams’ Performance

  • Conference paper
  • First Online:
Intelligent Tutoring Systems (ITS 2021)

Abstract

In the educational setting, working in teams is considered an essential collaborative activity where various biases exist that influence the prediction of teams performance. To tackle this issue, machine learning algorithms can be properly explored and utilized. In this context, the main objective of the current paper is to explore the ability of the eXtreme Gradient Boosting (XGBoost) algorithm and a Deep Neural Network (DNN) with 4 hidden layers to make predictions about the teams’ performance. The major finding of the current paper is that shallow machine learning performed better learning and prediction results than the DNN. Specifically, the XGBoost learning accuracy was found to be 100% during teams learning and production phase, while its prediction accuracy was found to be 95.60% and 93.08%, respectively for the same phases. Similarly, the learning accuracy of the DNN was found to be 89.26% and 81.23%, while its prediction accuracy was found to be 80.50% and 77.36%, during the two phases.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alshareet, O., Itradat, A., Doush, I.A., Quttoum, A.: Incorporation of ISO 25010 with machine learning to develop a novel quality in use prediction system (QIUPS). Int. J. Syst. Assur. Eng. Manag. 9(2), 344–353 (2018). https://doi.org/10.1007/s13198-017-0649-x

    Article  Google Scholar 

  2. Aouine, A., Mahdaoui, L., Moccozet, L.: A workflow-based solution to support the assessment of collaborative activities in e-learning. Int. J. Inf. Learn. Technol. 36, 124–156 (2019)

    Article  Google Scholar 

  3. Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system, pp. 785–794 (2016)

    Google Scholar 

  4. Chin, K.Y., Ko-Fong, L., Chen, Y.L.: Effects of a ubiquitous guide-learning system on cultural heritage course students’ performance and motivation. IEEE Trans. Learn. Technol. 13, 52–62 (2019)

    Article  Google Scholar 

  5. Devan, P., Khare, N.: An efficient XGBoost–DNN-based classification model for network intrusion detection system. Neural Comput. Appl. 32(16), 12499–12514 (2020). https://doi.org/10.1007/s00521-020-04708-x

    Article  Google Scholar 

  6. Dunnette, M.D., Fleishman, E.A.: Human Performance and Productivity: Volumes 1, 2, and 3. Psychology Press, Taylor and Francis (2014)

    Google Scholar 

  7. Kingma, D., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of International Conference on Learning Representations (2015)

    Google Scholar 

  8. Mengoni, P., Milani, A., Li, Y.: Clustering students interactions in elearning systems for group elicitation. In: Gervasi, O., et al. (eds.) ICCSA 2018. LNCS, vol. 10962, pp. 398–413. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95168-3_27

    Chapter  Google Scholar 

  9. O’Donnell, A.M., Hmelo-Silver, C.E., Erkens, G.: Collaborative Learning, Reasoning, and Technology. Routledge, Milton Park (2013)

    Google Scholar 

  10. Petkovic, D., et al.: SETAP: software engineering teamwork assessment and prediction using machine learning. In: 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, pp. 1–8. IEEE (2014)

    Google Scholar 

  11. Petkovic, D., et al.: Using the random forest classifier to assess and predict student learning of software engineering teamwork. In: 2016 IEEE Frontiers in Education Conference (FIE), pp. 1–7. IEEE (2016). https://archive.ics.uci.edu/ml/datasets/Data+for+Software+Engineering+Teamwork+Assessment+in+Education+Setting

  12. Troussas, C., Giannakas, F., Sgouropoulou, C., Voyiatzis, I.: Collaborative activities recommendation based on students’ collaborative learning styles using ANN and WSM. Interact. Learning Environ. 1–14. Taylor and Francis

    Google Scholar 

  13. Troussas, C., Krouska, A., Giannakas, F., Sgouropoulou, C., Voyiatzis, I.: Automated reasoning of learners’ cognitive states using classification analysis, pp. 103–106 (2020)

    Google Scholar 

  14. Troussas, C., Krouska, A., Giannakas, F., Sgouropoulou, C., Voyiatzis, I.: Redesigning teaching strategies through an information filtering system, pp. 111–114 (2020)

    Google Scholar 

  15. Wang, C., Fang, T., Gu, Y.: Learning performance and behavioral patterns of online collaborative learning: impact of cognitive load and affordances of different multimedia. Comput. Educ. 143, 103683 (2020)

    Article  Google Scholar 

  16. Zacharis, N.Z.: Predicting student academic performance in blended learning using artificial neural networks. Int. J. Artif. Intell. Appl. 7(5), 17–29 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Filippos Giannakas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Giannakas, F., Troussas, C., Krouska, A., Sgouropoulou, C., Voyiatzis, I. (2021). XGBoost and Deep Neural Network Comparison: The Case of Teams’ Performance. In: Cristea, A.I., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2021. Lecture Notes in Computer Science(), vol 12677. Springer, Cham. https://doi.org/10.1007/978-3-030-80421-3_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80421-3_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80420-6

  • Online ISBN: 978-3-030-80421-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics