ABSTRACT
Numerous studies have successfully adopted learning analytics techniques such as machine learning (ML) to address educational issues. However, limited research has addressed the problem of algorithmic bias in ML. In the few attempts to develop strategies to concretely mitigate algorithmic bias in education, the focus has been on debiasing ML models with single group membership. This study aimed to propose an algorithmic strategy to mitigate bias in a multi-group context. The results showed that our proposed model could effectively reduce algorithmic bias in a multi-group setting while retaining competitive accuracy. The findings implied that there could be a paradigm shift from focusing on debiasing a single group to multiple groups in educational attempts on ML.
- Henry Anderson, Afshan Boodhwani, and Ryan S Baker. 2019. Assessing the Fairness of Graduation Predictions.. In EDM.Google Scholar
- Ryan S Baker and Aaron Hawn. 2021. Algorithmic bias in education. International Journal of Artificial Intelligence in Education (2021), 1–41.Google ScholarCross Ref
- Dean Caplan and Rodger Graham. 2004. The development of online courses. Theory and practice of online learning 175 (2004).Google Scholar
- Josh Gardner, Christopher Brooks, and Ryan Baker. 2019. Evaluating the fairness of predictive student models through slicing analysis. In Proceedings of the 9th international conference on learning analytics & knowledge. 225–234.Google ScholarDigital Library
- Qian Hu and Huzefa Rangwala. 2020. Towards Fair Educational Data Mining: A Case Study on Detecting At-Risk Students.International Educational Data Mining Society (2020).Google Scholar
- Stephen Hutt, Margo Gardner, Angela L Duckworth, and Sidney K D’Mello. 2019. Evaluating Fairness and Generalizability in Models Predicting On-Time Graduation from College Applications.International Educational Data Mining Society (2019).Google Scholar
- Weijie Jiang and Zachary A Pardos. 2021. Towards equity and algorithmic fairness in student grade prediction. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. 608–617.Google ScholarDigital Library
- Leslie Pack Kaelbling, Michael L Littman, and Andrew W Moore. 1996. Reinforcement learning: A survey. Journal of artificial intelligence research 4 (1996), 237–285.Google ScholarDigital Library
- Jian Kang, Tiankai Xie, Xintao Wu, Ross Maciejewski, and Hanghang Tong. 2021. MultiFair: Multi-Group Fairness in Machine Learning. arXiv preprint arXiv:2105.11069(2021).Google Scholar
- René F Kizilcec and Hansol Lee. 2020. Algorithmic fairness in education. arXiv preprint arXiv:2007.05443(2020).Google Scholar
- Oliver Kramer. 2013. K-nearest neighbors. In Dimensionality reduction with unsupervised nearest neighbors. Springer, 13–23.Google Scholar
- Oliver Kramer. 2016. Scikit-learn. In Machine learning for evolution strategies. Springer, 45–53.Google Scholar
- Chenglu Li, Wanli Xing, and Walter Leite. 2022. Building socially responsible conversational agents using big data to support online learning: A case with Algebra Nation. British Journal of Educational Technology(2022).Google Scholar
- Chenglu Li, Wanli Xing, and Walter Leite. 2022. Using fair AI to predict students’ math learning outcomes in an online platform. Interactive Learning Environments(2022), 1–20.Google Scholar
- Jorge M Lobo, Alberto Jiménez-Valverde, and Raimundo Real. 2008. AUC: a misleading measure of the performance of predictive distribution models. Global ecology and Biogeography 17, 2 (2008), 145–151.Google Scholar
- Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A survey on bias and fairness in machine learning. ACM Computing Surveys (CSUR) 54, 6 (2021), 1–35.Google ScholarDigital Library
- Ambjörn Naeve. 2001. The Knowledge Manifold-an educational architecture that Supports Inquiry-Based Customizable Forms of E-learning. In Proceedings of the 2nd European Web-based Learning Environments Conference (WBLE 2001), Lund, Sweden. 200–212.Google Scholar
- Marlis Ontivero-Ortega, Agustin Lage-Castellanos, Giancarlo Valente, Rainer Goebel, and Mitchell Valdes-Sosa. 2017. Fast Gaussian Naïve Bayes for searchlight classification analysis. Neuroimage 163(2017), 471–479.Google ScholarCross Ref
- Venkata Sai Sukesh Settipalli and Naga Manendra Kumar Dasireddy. 2021. Reducing Unintended bias in Text Classification using Multitask learning.Google Scholar
- David Silver, Guy Lever, Nicolas Heess, Thomas Degris, Daan Wierstra, and Martin Riedmiller. 2014. Deterministic policy gradient algorithms. In International conference on machine learning. PMLR, 387–395.Google Scholar
- Wouter R van Joolingen, Ton de Jong, Ard W Lazonder, Elwin R Savelsbergh, and Sarah Manlove. 2005. Co-Lab: research and development of an online learning environment for collaborative scientific discovery learning. Computers in human behavior 21, 4 (2005), 671–688.Google Scholar
- Zeying Wan, Deborah Compeau, and Nicole Haggerty. 2012. The effects of self-regulated learning processes on e-learning outcomes in organizational settings. Journal of Management Information Systems 29, 1 (2012), 307–340.Google ScholarDigital Library
- Wanli Xing and Hanxiang Du. 2022. Mining Large Open Online Learning Networks: Exploring Community Dynamics and Communities of Performance. Journal of Educational Computing Research(2022), 07356331221113613.Google Scholar
- Wanli Xing, Rui Guo, Eva Petakovic, and Sean Goggins. 2015. Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory. Computers in Human Behavior 47 (2015), 168–181.Google ScholarDigital Library
- Adrienne Yapo and Joseph Weiss. 2018. Ethical implications of bias in machine learning. (2018).Google Scholar
- Jingjing Zhang, Maxim Skryabin, and Xiongwei Song. 2016. Understanding the dynamics of MOOC discussion forums with simulation investigation for empirical network analysis (SIENA). Distance education 37, 3 (2016), 270–286.Google Scholar
Index Terms
- Predicting Students’ Algebra I Performance using Reinforcement Learning with Multi-Group Fairness
Recommendations
Reward Shaping in Episodic Reinforcement Learning
AAMAS '17: Proceedings of the 16th Conference on Autonomous Agents and MultiAgent SystemsRecent advancements in reinforcement learning confirm that reinforcement learning techniques can solve large scale problems leading to high quality autonomous decision making. It is a matter of time until we will see large scale applications of ...
Using Transfer Learning to Speed-Up Reinforcement Learning: A Cased-Based Approach
LARS '10: Proceedings of the 2010 Latin American Robotics Symposium and Intelligent Robotics MeetingReinforcement Learning (RL) is a well-known technique for the solution of problems where agents need to act with success in an unknown environment, learning through trial and error. However, this technique is not efficient enough to be used in ...
Multi-objective safe reinforcement learning: the relationship between multi-objective reinforcement learning and safe reinforcement learning
AbstractReinforcement learning (RL) is a learning method that learns actions based on trial and error. Recently, multi-objective reinforcement learning (MORL) and safe reinforcement learning (SafeRL) have been studied. The objective of conventional RL is ...
Comments