Skip to main content

Advertisement

Springer Nature Link
Log in

Explainable AI and machine learning: performance evaluation and explainability of classifiers on educational data mining inspired career counseling

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Machine Learning concept learns from experiences, inferences and conceives complex queries. Machine learning techniques can be used to develop the educational framework which understands the inputs from students, parents and with intelligence generates the result. The framework integrates the features of Machine Learning (ML), Explainable AI (XAI) to analyze the educational factors which are helpful to students in achieving career placements and help students to opt for the right decision for their career growth. It is supposed to work like an expert system with decision support to figure out the problems, the way humans solve the problems by understanding, analyzing, and remembering. In this paper, the authors have proposed a framework for career counseling of students using ML and AI techniques. ML-based White and Black Box models analyze the educational dataset comprising of academic and employability attributes that are important for the job placements and skilling of the students. In the proposed framework, White Box and Black Box models get trained over an educational dataset taken in the study. The Recall and F-Measure score achieved by the Naive Bayes for performing predictions is 91.2% and 90.7% that is best compared to the score of Logistic Regression, Decision Tree, SVM, KNN, and Ensemble models taken in the study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  • Aamodt, A., & Plaza, E. (1994). Case-based reasoning: Foundational issues, methodological variations, and system approaches. AI Communications, 7(1), 39–59.

    Article  Google Scholar 

  • Abidi, S. M. R., Hussain, M., Xu, Y., & Zhang, W. (2019). Prediction of confusion attempting algebra homework in an intelligent tutoring system through machine learning techniques for educational sustainable development. Sustainability, 11(1), 105.

    Article  Google Scholar 

  • Al-Sudani, S., & Palaniappan, R. (2019). Predicting students’ final degree classification using an extended profile. Education and Information Technologies, 24(4), 2357–2369.

    Article  Google Scholar 

  • AlaoKazeem, A., & IbamOnwuka, E. (2017). Development of a web-based intelligent career guidance system for pre-tertiary science students in Nigeria.

  • Alexitch, L. R., & Page, S. (1997). Evaluation of academic and career counseling information and its relation to students’ educational orientation. Canadian Journal of Counseling, 31(3), 205–218.

    Google Scholar 

  • Alonso, J. M., & Casalino, G. (2019). Explainable artificial intelligence for human-centric data analysis in virtual learning environments. International workshop on higher education learning methodologies and technologies online (pp. 125–138). Springer.

    Chapter  Google Scholar 

  • Apley, D. W., & Zhu, J. (2020). Visualizing the effects of predictor variables in black box supervised learning models. Journal of the Royal Statistical Society: Series B (statistical Methodology), 82(4), 1059–1086.

    Article  MATH  Google Scholar 

  • Bardick, A. D., Bernes, K. B., Magnusson, K. C., & Witko, K. D. (2004). Junior high career planning: What students want. Canadian Journal of Counseling and Psychotherapy, 38(2).

  • Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (methodological), 57(1), 289–300.

    MATH  Google Scholar 

  • Bilon, A. (2013). Career Counseling: Current Trends in Research and Theory.

  • Bimrose, J., Brown, J., & Barnes, S. A. (2005). A systematic literature review of research into career-related interventions for higher education.

  • Bunt, A., Lount, M., & Lauzon, C. (2012). Are explanations always important? A study of deployed, low-cost intelligent interactive systems. In Proceedings of the 2012 ACM international conference on Intelligent User Interfaces, (pp. 169–178).

  • Bratko, I. (2001). Prolog programming for artificial intelligence. Pearson education.

  • Breiman, L., Cox, D., & Breiman, L. (2001). Comment-statistical modeling: The two cultures. Statistical Science, 16(3), 199–231.

    Article  MATH  Google Scholar 

  • Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123–140.

    Article  MATH  Google Scholar 

  • Cai, J., Luo, J., Wang, S., & Yang, S. (2018). Feature selection in machine learning: A new perspective. Neurocomputing, 300, 70–79. https://doi.org/10.1016/j.neucom.2017.11.077

    Article  Google Scholar 

  • Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608.

  • Erhan, D., Courville, A., & Bengio, Y. (2010). Understanding representations learned in deep architectures. Department dInformatique et Recherche Operationnelle, University of Montreal, QC, Canada, Tech. Rep, 1355(1).

  • Fee, S. B., & Holland-Minkley, A. M. (2010). Teaching computer science through problems, not solutions. Computer Science Education, 20(2), 129–144.

    Article  Google Scholar 

  • Friedman, J. H. (2001). Greedy function approximation: a gradient boosting machine. Annals of statistics, 1189–1232.

  • Fritz, W. (1997). Intelligent systems and their societies. A free e-book in http://www.intelligent-systems.com. ar/intsyst/index.htm.

  • Gade, K., Geyik, S., Kenthapadi, K., Mithal, V., & Taly, A. (2020). Explainable AI in Industry: Practical Challenges and Lessons Learned. In Companion Proceedings of the Web Conference 2020, (pp. 303–304).

  • Goga, M., Kuyoro, S., & Goga, N. (2015). A recommender for improving the student academic performance. Procedia-Social and Behavioral Sciences, 180, 1481–1488.

    Article  Google Scholar 

  • Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015). Peeking inside the black box: Visualizing statistical learning with plots of individual conditional expectation. Journal of Computational and Graphical Statistics, 24(1), 44–65.

    Article  Google Scholar 

  • Gorad, N., Zalte, I., Nandi, A., & Nayak, D. (2017). Career counseling using data mining. International Journal of Innovative Research in Computer and Communication Engineering.

  • Guidotti, R., Monreale, A., Ruggieri, S., Pedreschi, D., Turini, F., & Giannotti, F. (2018). Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820.

  • Hall, P., & Gill, N. (2019). An introduction to machine learning interpretability. O’Reilly Media, Incorporated.

    Google Scholar 

  • Hastie, T., Tibshirani, R., & Friedman, J. (2008). The Elements of Statistical Learning. Springer. ISBN 0-387-95284-5.

    MATH  Google Scholar 

  • Hendahewa, C., Dissanayake, M., Samaraweera, S., Wijayawickrama, N., Ruwanpathirana, A., & Karunananda, A. S. (2006). Artificial intelligence approach to effective career guidance. Sri Lanka Association for Artificial Intelligence.

  • Ho, I. M. K., Cheong, K. Y., & Weldon, A. (2021). Predicting student satisfaction of emergency remote learning in higher education during COVID-19 using machine learning techniques. PLoS ONE, 16(4), e0249423.

    Article  Google Scholar 

  • Ho, T. K. (1995). Random decision forests. In Proceedings of 3rd international conference on document analysis and recognition, vol. 1, pp. 278–282, IEEE.

  • Ho, T. K. (1998). The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8), 832–844.

    Article  Google Scholar 

  • Hoffait, A.S, Schyns, M. (2017). Early detection of university students with potential difficulties. Decision Support Systems, vol 101, (pp. 1–11), ISSN 0167–9236. https://doi.org/10.1016/j.dss.2017.05.003.

  • Holzinger, A. (2018). From machine learning to explainable AI. In 2018 world symposium on digital intelligence for systems and machines (DISA), (pp. 55–66). IEEE.

  • How, M. L. (2019). Future-ready strategic oversight of multiple artificial superintelligence-enabled adaptive learning systems via human-centric explainable AI-empowered predictive optimizations of educational outcomes. Big Data and Cognitive Computing, 3(3), 46.

    Article  Google Scholar 

  • Hoyt, K. B. (1987). The impact of technology on occupational change: Implications for career guidance. The career development quarterly.

  • Huang, Z., Liu, Q., Zhai, C., Yin, Y., Chen, E., Gao, W., & Hu, G. (2019). Exploring multi-objective exercise recommendations in online education systems. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, (pp. 1261–1270).

  • Hussain, M., Zhu, W., Zhang, W., & Abidi, S. M. R. (2018). Student engagement predictions in an e-learning system and their impact on student course assessment scores. Computational intelligence and neuroscience.

  • Iatrellis, O., Savvas, I. Κ, Fitsilis, P., & Gerogiannis, V. C. (2021). A two-phase machine learning approach for predicting student outcomes. Education and Information Technologies, 26(1), 69–88.

    Article  Google Scholar 

  • Iatrellis, O., Savvas, I. K., Kameas, A., & Fitsilis, P. (2020). Integrated learning pathways in higher education: A framework enhanced with machine learning and semantics. Education and Information Technologies, 25(4), 3109–3129.

    Article  Google Scholar 

  • Jishan, S. T., Rashu, R. I., Haque, N., & Rahman, R. M. (2015). Improving accuracy of students’ final grade prediction model using optimal equal width binning and synthetic minority over-sampling technique. Decision Analytics, 2(1), 1–25.

    Article  Google Scholar 

  • Jackson, P. (1998). Introduction to expert systems. Addison-Wesley Longman Publishing Co., Inc.

    MATH  Google Scholar 

  • Kausar, S., Oyelere, S., Salal, Y., Hussain, S., Cifci, M., Hilcenko, S., & Huahu, X. (2020). Mining smart learning analytics data using ensemble classifiers. International Journal of Emerging Technologies in Learning (iJET), 15(12), 81–102.

    Article  Google Scholar 

  • Khan, I., Ahmad, A. R., Jabeur, N., & Mahdi, M. N. (2021). A conceptual framework to aid attribute selection in machine learning student performance prediction models. International Journal of Interactive Mobile Technologies, 15(15).

  • Kjellin, H., & Boman, M. (1994). Fielded machine learning system for vocational counseling. Applied Artificial Intelligence an International Journal, 8(4), 543–563.

    Article  Google Scholar 

  • Kongsakun, K., Fung, C. C., & Chanakul, T. (2010a). Developing an intelligent recommendation system for a private university in Thailand. Issues in Information Systems, 11(1), 467–472.

    Google Scholar 

  • Kongsakun, K., Fung, C. C., Borirug, S., & Philuek, W. (2010b). An intelligent recommendation system framework for student relationship management.

  • Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., & Wasserman, L. (2018). Distribution-free predictive inference for regression. Journal of the American Statistical Association, 113(523), 1094–1111.

    Article  MATH  Google Scholar 

  • Linsley, D., Scheibler, D., Eberhardt, S., & Serre, T. (2018). Global-and-local attention networks for visual recognition. arXiv preprint arXiv:1805.08819.

  • Loan, D. T., & Van, N. (2015). Career guidance in secondary schools–a literature review and strategic solutions for Vietnamese rural areas. American International Journal of Social Science, 4(5), 135–142.

    Google Scholar 

  • Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in neural information processing systems, 30.

  • Mao, J., Gan, C., Kohli, P., Tenenbaum, J. B., & Wu, J. (2019). The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584.

  • McCarthy, J. (2019). What is artificial intelligence (2007). URL http://www-formal.stanford.Edu/jmc/whatisai/whatisai.html. Accessed 01.11.2021.

  • Mihaela, N. A., & Cristina, I. G. (2014). A research on the educational counseling and career guidance in Romania. In 2nd International Scientific Forum, ISF 2014, vol. 130, 170, (pp. 28).

  • Morgan, T., & Ness, D. (2003). Career decision-making difficulties of first-year students. The Canadian Journal of Career Development, 2(1), 33–39.

    Google Scholar 

  • Miao, J., & Niu, L. (2016). A survey on feature selection. Procedia Computer Science, 91, 919–926.

    Article  Google Scholar 

  • Mimis, M., El Hajji, M., Es-Saady, Y., Guejdi, A. O., Douzi, H., & Mammass, D. (2019). A framework for smart academic guidance using educational data mining. Education and Information Technologies, 24(2), 1379–1393.

    Article  Google Scholar 

  • Molnar, C. (2021). Interpretable machine learning. A Guide for Making Black Box Models Explainable, 2019.

  • Musso, M. F., Rodríguez Hernández, C. F., & Cascallar, E. C. (2020). Predicting key educational outcomes in academic trajectories: a machine-learning approach.

  • Norasiah, M. A., & Norhayati, A. (2003, January). Intelligent student information system. In 4th National Conference of Telecommunication Technology, 2003. NCTT 2003 Proceedings, (pp. 212–215). IEEE.

  • Piatetsky-Shapiro, G. (1991). Discovery, analysis, and presentation of strong rules. Knowledge discovery in databases, 229–238.

  • Pintelas, E., Livieris, I. E., & Pintelas, P. (2020). A grey-box ensemble model exploiting black-box accuracy and white-box intrinsic interpretability. Algorithms, 13(1), 17.

    Article  Google Scholar 

  • Poole, M. E., & Juchnowski, M. V. (1974). Career Guidance in Schools.

  • Pujari, A. M., Dalvi, R. M., Gawde, K. S., & Tatwadarshi, P. N. (2019). SCCAI-A Student Career Counseling Artificial Intelligence. VIVA-Tech International Journal for Research and Innovation, 1(2), 1–6.

    Google Scholar 

  • Qazdar, A., Er-Raha, B., Cherkaoui, C., & Mammass, D. (2019). A machine learning algorithm framework for predicting students’ performance: A case study of baccalaureate students in Morocco. Education and Information Technologies, 24(6), 3577–3589.

    Article  Google Scholar 

  • Quinlan, R. C. (1993). 4.5: Programs for machine learning morgan kaufmann publishers inc. San Francisco, USA.

  • Rai, A. (2020). Explainable AI: From black box to glass box. Journal of the Academy of Marketing Science, 48(1), 137–141.

    Article  Google Scholar 

  • Ribeiro, M. T., Singh, S., & Guestrin, C. (2016, August). "Why should i trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, (pp. 1135–1144).

  • Russell, S. J., & Norvig, P. (2010). Artificial Intelligence: A Modern.

  • Saraswathi, S., Reddy, M. H. K., Kumar, S. U., Suraj, M., & Shafi, S. K. (2014). Design of an online expert system for career guidance. The International Journal of Research in Engineering and Technology, 3.

  • Sample, I. (2017). Computer says no: Why making AIs fair, accountable and transparent is crucial. The Guardian, 5, 1–15.

    Google Scholar 

  • Seo, S., Huang, J., Yang, H., & Liu, Y. (2017). Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In Proceedings of the eleventh ACM conference on recommender systems, (pp. 297–305).

  • Shapley, L. S. (1953). A value for n-person games. Contributions to the Theory of Games, 2, 307–317.

    MATH  Google Scholar 

  • Sodhi, J. S., Dutta, M., & Aggarwal, N. (2016). Efficacy of Artificial neural network based decision support system for career counseling. Indian Journal of Science and Technology, 9, 32.

    Article  Google Scholar 

  • Sun, V. J., & Yuen, M. (2012). Career guidance and counseling for university students in China. International Journal for the Advancement of Counseling, 34(3), 202–210.

    Article  Google Scholar 

  • The Importance of Motivation in an Educational Environment (2012). Retrieved from https://study.com/academy/lesson/the-importance-of-motivation-in-an-educational-environment.html. Accessed 01.11.2021.

  • Valenzuela-Escárcega, M. A., Nagesh, A., & Surdeanu, M. (2018). Lightly-supervised representation learning with global interpretability. arXiv preprint arXiv:1805.11545.

  • Villegas-Ch, W., Román-Cañizares, M., & Palacios-Pacheco, X. (2020). Improvement of an online education model with the integration of machine learning and data analysis in an LMS. Applied Sciences, 10(15), 5371.

    Article  Google Scholar 

  • Viheräkoski, J. (2020). Strengths in career development: Modeling strength-based career counseling through reflecting customer experience.

  • Watkins, K. A. N. O. K. W. A. N. An improved recommendation models on grade point average prediction and postgraduate identification using data mining. Advances in Neural Networks, Fuzzy Systems and Artificial Intelligence, 186–194.

  • Watts, A. G. (1986). The role of the computer in careers guidance. International Journal for the Advancement of Counseling, 9(2), 145–158.

    Article  Google Scholar 

  • Witko, K., Bernes, K. B., Magnusson, K., & Bardick, A. D. (2005). Senior high school career planning: What students want. The Journal of Educational Enquiry, 6(1).

  • Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2015). A survey on evolutionary computation approaches to feature selection. IEEE Transactions on Evolutionary Computation, 20(4), 606–626.

    Article  Google Scholar 

  • Yang, C., Rangarajan, A., & Ranka, S. (2018, June). Global model interpretation via recursive partitioning. In 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), (pp. 1563–1570). IEEE.

  • Yang, C., Huan, S., & Yang, Y. (2020). A practical teaching mode for colleges supported by artificial intelligence. International Journal of Emerging Technologies in Learning (IJET), 15(17), 195–206.

    Article  Google Scholar 

  • Yarkoni, T., & Westfall, J. (2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science, 12(6), 1100–1122.

    Article  Google Scholar 

  • Zhai, X., Krajcik, J., & Pellegrino, J. W. (2021). On the validity of machine learning-based Next Generation Science Assessments: A validity inferential network. Journal of Science Education and Technology, 30(2), 298–312.

    Article  Google Scholar 

Download references

Funding

This research has no funding by any organization or individual.

Author information

Authors and Affiliations

  1. National Institute of Electronics and Information Technology (NIELIT), Shimla, Himachal Pradesh, India

    Pratiyush Guleria

  2. Department of Computer Science, Himachal Pradesh University, Shimla, Himachal Pradesh, India

    Manu Sood

Authors
  1. Pratiyush Guleria
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Manu Sood
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Pratiyush Guleria.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Ethical approval

This article does not contain any studies with human subjects and/or animals performed by any of the author.

Informed consent

This article does not contain any studies with human participants.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guleria, P., Sood, M. Explainable AI and machine learning: performance evaluation and explainability of classifiers on educational data mining inspired career counseling. Educ Inf Technol 28, 1081–1116 (2023). https://doi.org/10.1007/s10639-022-11221-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-022-11221-2

Keywords