Abstract
Adaptive Instructional Systems (AIS) have the potential to provide students with a flexible, dynamic learning environment in a manner that might not be possible with the limited resources of human instructors. In addition to technical knowledge learning engineering also requires considering the values and ethics associated with the creation, development, and implementation of instruction and assessment techniques such as fairness, accountability, transparency, and ethics (FATE). Following a review of the ethical dimensions of psychometrics, I will consider specific ethical dimensions associated with AIS (e.g., cybersecurity and privacy issues, invidious selection processes) and techniques that can be adopted to address these concerns (e.g., differential item function, l-diversity). By selectively introducing quantitative methods that align with principles of ethical design, I argue that AIS can be afforded a minimal ethical agency.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
To avoid terminological issues and overlap between the acronym for adaptive instructional systems and autonomous/intelligence systems, I will simply refer to the latter as autonomous systems in that all of these systems have some level of autonomy, i.e., a subset of operations are carried on without user control or supervision.
- 2.
For the purpose of brevity, I will refer to both of these systems as adaptive instruction systems as the technical distinction is not relevant to the present discussion.
- 3.
Namely, his approach to welfare economics assumes that the goal should be to maximize expected utility.
- 4.
Current work in autonomous systems that demonstrate ‘empathy’ are promising. However, at present these systems are generally focused on cognitive empathy rather than affective empathy. It remains an open question though whether affect cannot simply be modelled by differentially weighting variables or outcomes.
- 5.
Messick’s use of ideologies might reflect a comparable concept to Foucault’s episteme.
- 6.
Due to the potential for attacks resulting from homogeneity of a dataset or associations between multiple variables for k-anonymization, l-diversity promises to be a more effective means to preserve anonymity for low-diversity datasets wherein there is little diversity.
References
Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46, 50–80 (2004)
Parasuraman, R., Riley, V.: Humans and automation: Use, misuse, disuse, abuse. Hum. Factors 39, 230–253 (1997)
Parasuraman, R., Mouloua, M., Hilburn, B.: Adaptive aiding and adaptive task allocation enhance human-machine interaction. In: Automation Technology and Human Performance: Current Research and Trend, pp. 119–123 (1999)
Moor, J.H.: What is computer ethics? Metaphilosophy 16, 266–275 (1985)
Gray, C.M., Kou, Y., Battles, B., Hoggatt, J.T.A.L.: The dark (patterns) side of UX design. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2018)
Friedman, B., Kahn, P.H., Borning, A.: Value sensitive design and information systems. In: The Handbook of Information and Computer Ethics, pp. 69–101
Sengers, P., Boehner, K., David, S., Kaye, J.J.: Reflective design. In: Proceedings of the 4th Decennial Conference on Critical Computing: between Sense and Sensibility, pp. 49–58 (2005)
Cummings, M.L.: Integrating ethics in design through the value-sensitive design approach. Sci. Eng. Ethics 12, 701–715 (2006)
Sottilare, R.A.: A comprehensive review of design goals and emerging solutions for adaptive instructional systems. Technol. Instr. Cogn. Learn. 11, 5–38 (2018)
Messick, S.: Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am. Psychol. 50, 741–749 (1995)
Messick, S.: Validity. In: Linn, R. L. (ed.) Educational Measurement, 3rd edn., pp. 13–103. American Council on Education/Macmillan Publishing Company, New York
Feather, N.T.: Values in Education and Society. Free Press, New York (1975)
Halstead, J.M., Taylor, M.J.: Values in Education and Education in Values. Psychology Press, Hove (1996)
Dill, J.S.: Durkheim and Dewey and the challenge of contemporary moral education. J. Moral Educ. 36, 221–237 (2007)
Kohlberg, L.: Moral education in the schools: a developmental view. School Rev. 74, 1–30 (1966)
Maosen, L., Taylor, M.J., Shaogang, Y.: Moral education in Chinese societies: changes and challenges. J. Moral Educ. 33, 405–428 (2004)
Yu, E., Cysneiros, L.: Designing for privacy and other competing requirements. In: 2nd Symposium on Requirements Engineering for Information Security (SREIS 2002), Raleigh, 2002, pp. 15–16 (2002)
Blackman, R.: A practical guide to building ethical AI. Harvard Bus. Rev. 15 October 2020. https://hbr.org/2020/10/a-practical-guide-to-building-ethical-ai
Arkin, R.C., Ulam, P., Duncan, B.: An ethical governor for constraining lethal action in an autonomous system. Technical report GIT-GVU-09-02 (2009)
Moor, J.: Four kinds of ethical robots. Philos. Now 72, 12–4 (2009)
Schoenherr, J.R.: Ethics Sensemaking and Autonomous and Intelligent Systems: Ethical Features of A/IS Affordances. In: Frontiers of AI Ethics (DeFalco, J. & Hampton, A.). Routledge Publishing, forthcoming
Kohlberg, L.: Moral stages and moralization. In: Lickona, T. (ed.), Moral Development and Behavior: Theory, Research and Social Issues, pp. 31–53. Rinehart and Winston, New York (1976)
Snarey, J.R.: The cross-cultural universality of social-moral development: a critical review of Kohlbergian research. Psychol. Bull. 97, 202–232 (1985)
Al-Shehab, A.J.: A cross-sectional examination of levels of moral reasoning in a sample of Kuwait University faculty members. Soc. Behav. Pers. 30, 813–820 (2002)
Kohlberg, L.: A current statement on some theoretical issues. In: Modgil, S., Modgil, C. (eds.) Lawrence Kohlberg Consensus and Controversy, pp. 485–546. Falmer Press, Philadelphia (1986). https://doi.org/10.1007/978-94-6300-079-6_11
Gibbs, J.C., Basinger, K.S., Grime, R.L., Snarey, J.R.: Moral judgment development across cultures: revisiting Kohlberg’s universality claims. Dev. Rev. 27, 443–500 (2007)
Thoma, S.J., Rest, J.R.: The relationship between moral decision making and patterns of consolidation and transition in moral judgment development. Dev. Psychol. 35, 323–334 (1999)
Fiske, A.P.: The four elementary forms of sociality: framework for a unified theory of social relations. Psychol. Rev. 99, 689–723 (1992)
Haidt, J.: “The moral emotions,” in. In: Davidson, R.J., Scherer, K.R., Goldsmith, H.H. (eds.) Handbook of Affective Sciences, pp. 852–870. Oxford University Press, Oxford (2003)
Baek, H.: A comparative study of moral development of Korean and British children. J. Moral Educ. 31, 373–391 (2002)
Hughes, J.M., McCabe, D.L.: Understanding academic misconduct. Can. J. High. Educ. 36, 49–63 (2006)
Kisamore, J.L., Stone, T.H., Jawahar, I.M.: Academic integrity: the relationship between individual and situational factors on misconduct contemplations. Academic integrity: the relationship between individual and situational factors on misconduct contemplations. J. Bus. Ethics 75, 381–394 (2007)
Darley, J.M., Batson, C.D.: From Jerusalem to Jericho: a study of situational and dispositional variables in helping behavior. J. Pers. Soc. Psychol. 27, 100–108 (1973)
Mazar, N., Amir, O., Ariely, D.: The dishonesty of honest people: a theory of self-concept maintenance. J. Mark. Res. 45, 633–644 (2008)
Moor, J.H.: Is ethics computable? Metaphilosophy 26, 1–21 (1995)
Wallach, W., Allen, C.: Moral Machines: Teaching Robots Right from Wrong. Oxford University Press, Oxford (2008)
Pereira, L.M., Saptawijaya, A.: Programming Machine Ethics. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29354-7
Vanderelst, D., Winfield, A.: An architecture for ethical robots inspired by the simulation theory of cognition. Cogn. Syst. Res. 48, 56–66 (2018)
Floridi, L., Sanders, J.W.: On the morality of artificial agents. Mind. Mach. 14, 349–379 (2004)
Schoenherr, J.R.: Metacognitive assessments of performance: the psychometric properties of confidence scales and confidence models. In: Proceedings of Fechner Day, Antalya, p. 71 (2019)
Schoenherr, J.R.: Trust in the Age of Entanglement. Routledge Publishing, London (2022)
Kearns, M., Roth, A.: The Ethical Algorithm: The Science of Socially Aware Algorithm Design. Oxford University Press, Oxford (2019)
Miller, A.: Contemporary Metaethics: an Introduction. Wiley, Hoboken (2014)
Hill, T.E.: The kingdom of ends. In: Proceedings of the Third International Kant Congress: Held at the University of Rochester, March 30–April 4, 1970. Springer, Dordrecht (1972). https://doi.org/10.1007/978-94-010-3099-1_26
O’Neill, O.: Acting on Principle. Columbia University Press, New York (1975)
Ross, D.: The Right and the Good. Oxford University Press, Oxford (1930)
Bringsjord, S., Arkoudas, K., Bello, P.: Toward a general logicist methodology for engineering ethically correct robots. IEEE Intell. Syst. 21, 38–44 (2006)
Roscoe, R.D., Chiou, E.K., Wooldridge, A.R.: Advancing Diversity, Inclusion, and Social Justice Through Human Systems Engineering. CRC Press, Boca Raton (2019)
Korman, H.T.N., O’Keefe, B., Repka, M.: Missing in the Margins: Estimating the Scale of the COVID-19 Attendance Crisis. Bellwether Education Partners, 21 October 2020. https://bellwethereducation.org/publication/missing-margins-estimating-scale-covid-19-attendance-crisis#How%20did%20you%20estimate%201-3%20million%20missing%20students? Accessed 17 Dec 2020
Harsanyi, J.C.: Morality and the theory of rational behavior. Soc. Res. 44, 623–656 (1977)
Hill, J.C.: Bayesian decision theory and utilitarian ethics. Am. Econ. Rev. 68, 223–228 (1978)
Vallor, S.: Technology and the Virtues: A Philosophical Guide to a Future Worth Wanting. Oxford University Press, Oxford (2016)
Winfield, A.F., Jirotka, M.: Ethical governance is essential to building trust in robotics and artificial intelligence systems. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 376 (2018). https://doi.org/10.1098/rsta.2018.0085
Dennis, L., Fisher, M., Slavkovik, M., Webster, M.: Formal verification of ethical choices in autonomous systems. Robot. Auton. Syst. 1, 1–4 (2016)
He, H.: Social Ethics in a Changing China: Moral Decay Or Ethical Awakening? Brookings Institution Press, Washington (2015)
Došilović, F., Brčić, M., Hlupić, N.: Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (2018)
Gunning, D.: DARPA XAI BAA, DARPA (2016). https://www.darpa.mil/attachments/DARPA-BAA-16-53.pdf. Accessed 20 Feb 2020
Thomson, R., Schoenherr, J.R.: Knowledge-to-information translation training (KITT): an adaptive approach to explainable artificial intelligence. In: International Conference on Human-Computer Interaction, pp. 187–204. Springer (2020). https://doi.org/10.1007/978-3-030-50788-6_14
IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems, Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems. IEEE (2019)
Schoenherr, J.R.: Ethics of psychometrics: value implications of validity and integrated learner records in AIS. In: Learning Technology - Where we are Today (2021)
Kane, T.: An argument-based approach to validity. Psychol. Bull. 112, 527–535 (1992)
Taylor, H.C., Russell, J.T.: The relationship of validity coefficients to the practical effectiveness of tests in selection: discussion and tables. J. Appl. Psychol. 23, 565–578 (1939)
Cohen, A.S., Bolt, D.M.: A mixture model analysis of differential item functioning. J. Educ. Meas. 42, 133–148 (2005)
Holland, P.W., Thayer, D.T.: Differential item functioning and the Mantel‐Haenszel procedure. ETS Research Report Series, pp. i-24 (1986)
Osterlind, S.J., Everson, H.T.: Differential Item Functioning, vol. 161. Sage Publications, London (2009)
Nunnally, J.C., Bernstein, I.H.: Psychometric Theory. McGraw-Hill, New York (1994)
Rasch, G.: Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. Nielsen & Lydiche (1960)
News, B.: University of York students targeted in data hack. BBC News, 1 July 2019. https://www.bbc.com/news/uk-england-york-north-yorkshire-49182179. Accessed 1 Aug 2020
Association, P.: Lancaster University Students Data Stolen in Cyber Attack. The Guardian, 23 July 2019. https://www.theguardian.com/technology/2019/jul/23/lancaster-university-students-data-stolen-cyber-attack. Accessed 1 Aug 2020
Doran, L.: Ransomware Attacks Force School Districts to Shore Up—or Pay Up. Education Week, 10 January 2017. https://www.edweek.org/ew/articles/2017/01/11/ransomware-attacks-force-school-districts-to.html. Accessed 3 July 2020
Erazo, F.: University of Utah Pays Ransomware Gang to Prevent Student Data Leak, Cointelegraph, 22 August 2020. https://cointelegraph.com/news/university-of-utah-pays-ransomware-gang-to-prevent-student-data-leak. Accessed 4 Sept 2020
Sweeney, L., Samarati, P.: Protecting privacy when disclosing information: k-anonymity and its enforcement through generalization and suppression. Technical report SRI-CSL-98-04. SRI Computer Science Laboratory, Pal Alto (1998)
Machanavajjhala, A., Kifer, D., Gehrke, J., Venkitasubramaniam, M.: l-diversity: Privacy beyond k-anonymity. ACM Trans. Knowl. Discov. Data (TKDD) 1, 3-es (2007)
Schoenherr, J.R., Thomson, R.: Insider threat detection: a solution in search of a problem. In: 2020 International Conference on Cyber Security and Protection of Digital Services (Cyber Security), pp. 1–7. IEEE (2020)
Pasquale, F.: The Black Box Society, Harvard University Press (2015)
Schoenherr, J.R.: Black boxes of the mind: from psychophysics to explainable artificial intelligence. Proc. Fechner Day 2020, 46–51 (2020)
Anderson, M., Anderson, S., Armen, C.: Towards machine ethics: implementing two action-based ethical theories, pp. 1–7. In: Proceedings of the AAAI 2005 Fall Symposium on Machine Ethics (2005)
Schoenherr, J.R.: Learning engineering is ethical. In: Goodell, J. (ed.) Learning Engineering Toolkit, pp. 193–221 (2022)
Ashby, F.G., Valentin, V.V.: Multiple systems of perceptual category learning: theory and cognitive tests. In: Handbook of Categorization in Cognitive Science, pp. 157–188. Elsevier (2017)
Schoenherr, J.R.: Adapting the zone of proximal development to the wicked environments of professional practice. In: International Conference on Human-Computer Interaction, pp. 394–410. Springer, Cham (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Schoenherr, J.R. (2021). Designing Ethical Agency for Adaptive Instructional Systems: The FATE of Learning and Assessment. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Design and Evaluation. HCII 2021. Lecture Notes in Computer Science(), vol 12792. Springer, Cham. https://doi.org/10.1007/978-3-030-77857-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-77857-6_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77856-9
Online ISBN: 978-3-030-77857-6
eBook Packages: Computer ScienceComputer Science (R0)