skip to main content
10.1145/3576050.3576104acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
short-paper

Predicting Students’ Algebra I Performance using Reinforcement Learning with Multi-Group Fairness

Published:13 March 2023Publication History

ABSTRACT

Numerous studies have successfully adopted learning analytics techniques such as machine learning (ML) to address educational issues. However, limited research has addressed the problem of algorithmic bias in ML. In the few attempts to develop strategies to concretely mitigate algorithmic bias in education, the focus has been on debiasing ML models with single group membership. This study aimed to propose an algorithmic strategy to mitigate bias in a multi-group context. The results showed that our proposed model could effectively reduce algorithmic bias in a multi-group setting while retaining competitive accuracy. The findings implied that there could be a paradigm shift from focusing on debiasing a single group to multiple groups in educational attempts on ML.

References

  1. Henry Anderson, Afshan Boodhwani, and Ryan S Baker. 2019. Assessing the Fairness of Graduation Predictions.. In EDM.Google ScholarGoogle Scholar
  2. Ryan S Baker and Aaron Hawn. 2021. Algorithmic bias in education. International Journal of Artificial Intelligence in Education (2021), 1–41.Google ScholarGoogle ScholarCross RefCross Ref
  3. Dean Caplan and Rodger Graham. 2004. The development of online courses. Theory and practice of online learning 175 (2004).Google ScholarGoogle Scholar
  4. Josh Gardner, Christopher Brooks, and Ryan Baker. 2019. Evaluating the fairness of predictive student models through slicing analysis. In Proceedings of the 9th international conference on learning analytics & knowledge. 225–234.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Qian Hu and Huzefa Rangwala. 2020. Towards Fair Educational Data Mining: A Case Study on Detecting At-Risk Students.International Educational Data Mining Society (2020).Google ScholarGoogle Scholar
  6. Stephen Hutt, Margo Gardner, Angela L Duckworth, and Sidney K D’Mello. 2019. Evaluating Fairness and Generalizability in Models Predicting On-Time Graduation from College Applications.International Educational Data Mining Society (2019).Google ScholarGoogle Scholar
  7. Weijie Jiang and Zachary A Pardos. 2021. Towards equity and algorithmic fairness in student grade prediction. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. 608–617.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Leslie Pack Kaelbling, Michael L Littman, and Andrew W Moore. 1996. Reinforcement learning: A survey. Journal of artificial intelligence research 4 (1996), 237–285.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jian Kang, Tiankai Xie, Xintao Wu, Ross Maciejewski, and Hanghang Tong. 2021. MultiFair: Multi-Group Fairness in Machine Learning. arXiv preprint arXiv:2105.11069(2021).Google ScholarGoogle Scholar
  10. René F Kizilcec and Hansol Lee. 2020. Algorithmic fairness in education. arXiv preprint arXiv:2007.05443(2020).Google ScholarGoogle Scholar
  11. Oliver Kramer. 2013. K-nearest neighbors. In Dimensionality reduction with unsupervised nearest neighbors. Springer, 13–23.Google ScholarGoogle Scholar
  12. Oliver Kramer. 2016. Scikit-learn. In Machine learning for evolution strategies. Springer, 45–53.Google ScholarGoogle Scholar
  13. Chenglu Li, Wanli Xing, and Walter Leite. 2022. Building socially responsible conversational agents using big data to support online learning: A case with Algebra Nation. British Journal of Educational Technology(2022).Google ScholarGoogle Scholar
  14. Chenglu Li, Wanli Xing, and Walter Leite. 2022. Using fair AI to predict students’ math learning outcomes in an online platform. Interactive Learning Environments(2022), 1–20.Google ScholarGoogle Scholar
  15. Jorge M Lobo, Alberto Jiménez-Valverde, and Raimundo Real. 2008. AUC: a misleading measure of the performance of predictive distribution models. Global ecology and Biogeography 17, 2 (2008), 145–151.Google ScholarGoogle Scholar
  16. Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A survey on bias and fairness in machine learning. ACM Computing Surveys (CSUR) 54, 6 (2021), 1–35.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Ambjörn Naeve. 2001. The Knowledge Manifold-an educational architecture that Supports Inquiry-Based Customizable Forms of E-learning. In Proceedings of the 2nd European Web-based Learning Environments Conference (WBLE 2001), Lund, Sweden. 200–212.Google ScholarGoogle Scholar
  18. Marlis Ontivero-Ortega, Agustin Lage-Castellanos, Giancarlo Valente, Rainer Goebel, and Mitchell Valdes-Sosa. 2017. Fast Gaussian Naïve Bayes for searchlight classification analysis. Neuroimage 163(2017), 471–479.Google ScholarGoogle ScholarCross RefCross Ref
  19. Venkata Sai Sukesh Settipalli and Naga Manendra Kumar Dasireddy. 2021. Reducing Unintended bias in Text Classification using Multitask learning.Google ScholarGoogle Scholar
  20. David Silver, Guy Lever, Nicolas Heess, Thomas Degris, Daan Wierstra, and Martin Riedmiller. 2014. Deterministic policy gradient algorithms. In International conference on machine learning. PMLR, 387–395.Google ScholarGoogle Scholar
  21. Wouter R van Joolingen, Ton de Jong, Ard W Lazonder, Elwin R Savelsbergh, and Sarah Manlove. 2005. Co-Lab: research and development of an online learning environment for collaborative scientific discovery learning. Computers in human behavior 21, 4 (2005), 671–688.Google ScholarGoogle Scholar
  22. Zeying Wan, Deborah Compeau, and Nicole Haggerty. 2012. The effects of self-regulated learning processes on e-learning outcomes in organizational settings. Journal of Management Information Systems 29, 1 (2012), 307–340.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Wanli Xing and Hanxiang Du. 2022. Mining Large Open Online Learning Networks: Exploring Community Dynamics and Communities of Performance. Journal of Educational Computing Research(2022), 07356331221113613.Google ScholarGoogle Scholar
  24. Wanli Xing, Rui Guo, Eva Petakovic, and Sean Goggins. 2015. Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory. Computers in Human Behavior 47 (2015), 168–181.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Adrienne Yapo and Joseph Weiss. 2018. Ethical implications of bias in machine learning. (2018).Google ScholarGoogle Scholar
  26. Jingjing Zhang, Maxim Skryabin, and Xiongwei Song. 2016. Understanding the dynamics of MOOC discussion forums with simulation investigation for empirical network analysis (SIENA). Distance education 37, 3 (2016), 270–286.Google ScholarGoogle Scholar

Index Terms

  1. Predicting Students’ Algebra I Performance using Reinforcement Learning with Multi-Group Fairness

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference
        March 2023
        692 pages
        ISBN:9781450398657
        DOI:10.1145/3576050

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 March 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate236of782submissions,30%
      • Article Metrics

        • Downloads (Last 12 months)147
        • Downloads (Last 6 weeks)3

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format