skip to main content
10.1145/3454127.3457634acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnissConference Proceedingsconference-collections
research-article

A framework towards more accurate and explanatory student performance model

Published: 26 November 2021 Publication History

Abstract

The ability to predict students academic performance in a timely manner is very important in learning institutions [18]. Student performance prediction is an important area as it can help teachers identify students who need additional academic support [14]. Predicting student academic performance helps teachers develop a good understanding of how well or how badly students are doing in their classes so that teachers can take proactive steps to improve student learning. Accurately predicting students future performance based on their ongoing academic records is critical to effectively conducting the educational interventions required to ensure students complete the course on time and in a satisfactory manner [4]. To achieve these goals, however, a large amount of student data must be analyzed and predicted using various machine learning models. Having a wealth of options is good, but deciding which model to implement in production is critical. While we have a number of performance metrics to evaluate a model, it is not advisable to implement every algorithm for every problem. This takes a lot of time and effort. Additionally, machine learning (ML) models are amazingly good at making predictions, but often cannot provide explanations for their predictions that humans can easily understand. Most machine learning-based projects focused primarily on results, on updating the accuracy of student grade models without considering mechanisms for their interpretability. Therefore it is important to know how to choose the right algorithm for a given task and how to choose the ”right” interpretability tool. To that end, we provide a guide for machine learning practitioners and researchers that shows the thought process that they might find useful in improving the performance and interpretability of their models, and they can even get great results on their prediction problems. The study concludes that machine learning practitioners can improve the performance of predictive models with data tactics such as getting more data, cleaning data, resampling data and rescaling data. And with algorithms optimization tactics by searching for the best hyper-parameters by using random search of algorithm hyper parameters to expose configurations that never thought of. And learning to combine by using a new model to learn how to best combine the predictions from multiple well-performing models. And can also improve the interpretability of the model by choosing the “right” interpretability tool. As machine learning becomes more ubiquitous, understanding how these models find answers is critical to improve their performance and reliability. When deciding to implement a machine learning model, choosing the right model mean analyzing your needs and expected results. Finally, developing the right solution to a problem in real life is rarely just an applied math problem. It requires awareness of business needs, rules and regulations, and stakeholder concerns, as well as considerable expertise. When solving a machine problem, it is crucial to be able to combine and balance them out. Those who can do this can create the greatest value.

References

[1]
Animikh Aich. 2019. Machine Learning Algorithms: [With Essentials, Principles, Types & Examples covered]. (2019).
[2]
Ammar Almasri, Erbug Celebi, and Rami S Alkhawaldeh. 2019. EMT: Ensemble meta-based tree model for predicting student performance. Scientific Programming 2019 (2019).
[3]
Michael Mogessie Ashenafi. 2017. AComparative ANALYSIS OF SELECTED STUDIES IN STUDENT PERFORMANCE PREDICTION. International Journal of Data Mining & Knowledge Management Process 7, 4(2017), 17–32.
[4]
Ermiyas Birihanu Belachew and Feidu Akmel Gobena. 2017. Student Performance Prediction Model using Machine Learning Approach: The Case of Wolkite University. International Journal if Advanced Research in Computer Science and Software Engineering 7, 2 (2017), 46–50.
[5]
Leo Breiman. 1996. Bagging predictors. Machine learning 24, 2 (1996), 123–140.
[6]
L Breiman. 2001. Random Forests Machine Learning, vol. 45. (2001).
[7]
Leo Breiman and others. 1998. Arcing classifier (with discussion and a rejoinder by the author). The annals of statistics 26, 3 (1998), 801–849.
[8]
Jason Brownlee. November 23, 2016. Machine Learning Performance Improvement Cheat Sheet. (November 23, 2016).
[9]
Diego Buenaño-Fernández, David Gil, and Sergio Luján-Mora. 2019. Application of machine learning in predicting performance for computer engineering students: A case study. Sustainability 11, 10 (2019), 2833.
[10]
Ahmed El Deeb. May 28, 2015. 7 Ways to Improve your Predictive Models. (May 28, 2015).
[11]
Yoav Freund and Robert E Schapire. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences 55, 1 (1997), 119–139.
[12]
Raúl Garreta. August 27th, 2015. A Gentle Guide to Machine Learning. (August 27th, 2015).
[13]
Rajat Harlalka. June 16th 2018. Choosing the Right Machine Learning Algorithm. (June 16th 2018).
[14]
Sadiq Hussain, Zahraa Fadhil Muhsion, Yass Khudheir Salal, Paraskevi Theodoru, Fikriye KurtoÄŸlu, and GC Hazarika. 2019. Prediction model on student performance based on internal assessment using deep learning. International Journal of Emerging Technologies in Learning (iJET) 14, 08(2019), 4–22.
[15]
Sujith Jayaprakash, E Balamurugan, and Vibin Chandar. 2015. Predicting Students’ Academic Performance Using Naïve Bayes Algorithm. In 8th Annual International Applied Research Conference.
[16]
Luca Massaron John Paul Mueller. 2016. 10 Ways to Improve Your Machine Learning Models. (2016).
[17]
Jeremy Jordan. 21 Jul 2017. Evaluating a machine learning model.(21 Jul 2017).
[18]
Maria Koutina and Katia Lida Kermanidis. 2011. Predicting postgraduate students’ performance using machine learning techniques. In Artificial intelligence applications and innovations. Springer, 159–168.
[19]
Efrem Yohannes Obsie and Seid Ahmed Adem. 2018. Prediction of Student Academic Performance using Neural Network, Linear Regression and Support Vector Regression: A Case Study. International Journal of Computer Applications 180, 40(2018), 39–47.
[20]
Two Sigma. 2019. Interpretability Methods in Machine Learning: A Brief Survey. (2019).
[21]
SmritiS. JULY 13, 2019. What is Mean Squared Error, Mean Absolute Error, Root Mean Squared Error and R Squared?(JULY 13, 2019).
[22]
Tavish Srivastava. August 2, 2015. Basics of Ensemble Learning Explained in Simple English. (August 2, 2015).
[23]
Gilbert Tanner. May 13, 2019. Introduction to Machine Learning Model Interpretation. (May 13, 2019).
[24]
Ramya Vidiyala. September 01, 2020. How to Select the Right Machine Learning Algorithm. (September 01, 2020).
[25]
David H Wolpert. 1992. Stacked generalization. Neural networks 5, 2 (1992), 241–259.
[26]
Surjeet Kumar Yadav and Saurabh Pal. 2012. Data mining: A prediction for performance improvement of engineering students using classification. arXiv preprint arXiv:1203.3832(2012).

Cited By

View all
  • (2024)Fuzzy Logic-Based Preliminary Risk Assessment for a Supervised Federated Learning Solution in Predicting Student Results2024 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI)10.1109/CCCI61916.2024.10736453(1-8)Online publication date: 16-Oct-2024
  • (2022)Predicting E-learning Course Final Average-Grade using Machine Learning Techniques : A Case Study in Shaqra University2022 4th International Conference on Artificial Intelligence and Speech Technology (AIST)10.1109/AIST55798.2022.10065263(1-6)Online publication date: 9-Dec-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
NISS '21: Proceedings of the 4th International Conference on Networking, Information Systems & Security
April 2021
410 pages
ISBN:9781450388719
DOI:10.1145/3454127
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Interpretability.
  2. Machine learning algorithms
  3. Model performance
  4. Students’ performance

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

NISS2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Fuzzy Logic-Based Preliminary Risk Assessment for a Supervised Federated Learning Solution in Predicting Student Results2024 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI)10.1109/CCCI61916.2024.10736453(1-8)Online publication date: 16-Oct-2024
  • (2022)Predicting E-learning Course Final Average-Grade using Machine Learning Techniques : A Case Study in Shaqra University2022 4th International Conference on Artificial Intelligence and Speech Technology (AIST)10.1109/AIST55798.2022.10065263(1-6)Online publication date: 9-Dec-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media