Abstract
It is a challenging task to evaluate the performance of individual team members of a project, more so when there is unequal contributions by the team members. The project supervisor often provide formative feedback through assessment of weekly work logs against the agreed project plan. Automating this evaluation mechanism has the obvious advantage of providing timely feedback in an efficient manner otherwise not possible due to the workload on supervisors especially in the academic settings. We explore the design space of an automated formative assessment solution based on text data mining. We evaluate the performance of various machine learning techniques (both classification and regression versions), by tweaking their control parameters, based on the achieved accuracy of prediction. We showed that the KNN regression models, despite their simplicity, produce the most accurate result across different similarity methods. We verify these research findings by employing various data visualisation techniques such as learning curves, residual plots and goodness of fit.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Almasoud, A.M., Al-Khalifa, H.S., Al-Salman, A.: Recent developments in data mining applications and techniques. In: 2015 Tenth International Conference on Digital Information Management (ICDIM), pp. 36–42, October 2015
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Deo, S.: R tutorial: residual analysis for regression, March 2016
Hsu, C.W., Chang, C.C., Lin, C.J., et al.: A practical guide to support vector classification (2003)
Huebner, R.A.: A survey of educational data-mining research. Res. High. Educ. J. 19, 1–13 (2013)
Jin, H., Liu, H.: Research on visualization techniques in data mining. In: 2009 International Conference on Computational Intelligence and Software Engineering, pp. 1–3, December 2009
Le, K., Chua, C., Wang, R.: Mining software engineering team project work logs to generate formative assessment. In: International Workshop on Software Driven Big Data Analytics (SoftBDA 2017) (2017)
Munzner, T.: Visualization Analysis and Design. CRC Press, Boca Raton (2014)
Murray, S.: Interactive Data Visualization for the Web. O’Reilly Media, Inc., Sebastopol (2013)
Nguyen, T., Chua, C.: Predictive tool for software team performance. In: 2016 23rd Asia-Pacific Software Engineering Conference, pp. 373–376, December 2016
Obie, H.O.: Data—driven visualisations that make sense. In: 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 313–314, October 2017
Perlich, C.: Learning curves in machine learning, January 2011
Shahiri, A.M., Husain, W., Rashid, N.A.: A review on predicting student’s performance using data mining techniques. Procedia Comput. Sci. 72, 414–422 (2015)
Thai-Nghe, N., Horvth, T., Schmidt-Thieme, L.: Personalized forecasting student performance. In: 2011 IEEE 11th International Conference on Advanced Learning Technologies, pp. 412–414, July 2011
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Crown
About this paper
Cite this paper
Nadeem, R., Wang, X.R., Chua, C. (2019). Applying Data Mining Methods to Generate Formative Feedback in Team Projects. In: Islam, R., et al. Data Mining. AusDM 2018. Communications in Computer and Information Science, vol 996. Springer, Singapore. https://doi.org/10.1007/978-981-13-6661-1_10
Download citation
DOI: https://doi.org/10.1007/978-981-13-6661-1_10
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-6660-4
Online ISBN: 978-981-13-6661-1
eBook Packages: Computer ScienceComputer Science (R0)