Skip to main content
SpringerLink
Log in

Promoting Ethical Uses in Artificial Intelligence Applied to Education

  • Conference paper
  • First Online:
Augmented Intelligence and Intelligent Tutoring Systems (ITS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13891))

Included in the following conference series:

  • 1111 Accesses

Abstract

During the last decades, technology has created many opportunities to develop the world in diverse ways. Specifically, the growth of Artificial Intelligence (AI) can potentially change every aspect of human social interactions. In the educational field, numerous AI systems have been created using intelligent methods in order to develop novel teaching and learning solutions for the educational context. Most of these applications are powered by Machine Learning (ML) systems and algorithms, which use substantial amounts of data to work. Data reflects social reality and its existing power structures and biases, which is why, in order to guarantee ethical applications, it seems important to analyse issues such as the ones that are being considered in FATE. The development of ethical AI systems have been analysed by many researchers. However, especially in the context of education, biased systems can threaten the learning experience, perpetuating and supporting existing discriminatory practices. If we want to use AI for social good, algorithms must be fair and transmit positive and respectful values to students, while they develop their curricular capacities and psychological aspects. There is a chance to develop social-sensitive and ‘activist’ educational applications to mitigate social existent biases and empower the creation of a fairer and more respectful social world. This work will focus on how AI algorithms influence the learning experience of students as well as the threats the algorithms may provoke to that learning experience, specifically in the context of the discriminative data, which can perpetuate actual biased representations of social groups present in the data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aiken, R.M., Epstein, R.G.: Ethical guidelines for AI in education: starting a conversation. Int. J. Artif. Intell. Educ. 11, 163–176 (2000)

    Google Scholar 

  2. Baker, R.S., Hawn, A.: Algorithmic bias in education. Int. J. Artif. Intell. Educ. 32, 1052–1092 (2021)

    Google Scholar 

  3. Bayer, V., Hlosta, M., Fernandez, M.: Learning analytics and fairness: do existing algorithms serve everyone equally? In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) AIED 2021. LNCS (LNAI), vol. 12749, pp. 71–75. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78270-2_12

    Google Scholar 

  4. Benner, A.D., Graham, S.: The antecedents and consequences of racial/ethnic discrimination during adolescence: does the source of discrimination matter? Dev. Psychol. 49(8), 1602–1613 (2013)

    Google Scholar 

  5. Bhimdiwala, A., Neri, R.C., GOmez, L.M.: The FATE of AIED, chap. Advancing the Design and Implementation of Artifcial Intelligence in Education through Continuous Improvement. IJAIED Special Issue. Springer, Cham (2021)

    Google Scholar 

  6. Bogina, V., Hartman, A., Kuflik, T., Shulner-Tal, A.: The FATE of AIED, chap. Educating Software and AI Stakeholders About Algorithmic Fairness, Accountability, Transparency and Ethics. IJAIED Special Issue. Springer, Cham (2021)

    Google Scholar 

  7. Borges, A.F.S., Laurindo, F.J.B., Spinola, M.M., Gonzalves, R.F., Mattos, C.A.: The strategic use of artificial intelligence in the digital era: systematic literature review and future research directions. Int. J. Inf. Manag. 57, 102225 (2021)

    Google Scholar 

  8. Bridgeman, B., Trapani, C., Attali, Y.: Considering fairness and validity in evaluating automated scoring. Technical report, National Council on Measurement in Education (NCME), Educational Testing Service (ETS), San Diego, USA (2009)

    Google Scholar 

  9. Bridgeman, B., Trapani, C., Attali, Y.: Comparison of human and machine scoring of essays: differences by gender, ethnicity, and country. Appl. Meas. Educ. 25, 27–40 (2012)

    Google Scholar 

  10. Brown, C.S., Bigler, R.S.: Children’s perceptions of discrimination: a developmental model. Child Dev. 76, 533–553 (2005)

    Google Scholar 

  11. Busuioc, M.: Accountable artificial intelligence: holding algorithms to account. Public Adm. Rev. 81(5), 825–836 (2020)

    Google Scholar 

  12. Byrd, C.M., Carter-Andrews, D.J.: Variations in students’ perceived reasons for, sources of, and forms of in-school discrimination: a latent class analysis. J. Sch. Psychol. 57, 1–14 (2016)

    Google Scholar 

  13. Chen, X., Xie, H., Hwang, G.J.: A multi-perspective study on artificial intelligence in education: grants, conferences, journals, software tools, institutions, and researchers. Comput. Educ. Artif. Intell. 1, 100005 (2020)

    Google Scholar 

  14. Cowls, J.: AI for social good: whose good and who’s good? Introduction to the special issue on artificial intelligence for social good. Philos. Technol. 34(1), 1–5 (2021)

    Google Scholar 

  15. Curzon, J., Kosa, T.A., Akalu, R., El-Khatib, K.: Privacy and artificial intelligence. IEEE Trans. Artif. Intell. 2(2), 96–108 (2021)

    Google Scholar 

  16. Datu, J.A.D.: Everyday discrimination, negative emotions, and academic achievement in filipino secondary school students: cross-sectional and cross-lagged panel investigations. J. Sch. Psychol. 68, 195–205 (2018)

    Google Scholar 

  17. Delisle, L., Kalaitzis, A., Majewski, K., de Berker, A., Marin, M., Cornebise, J.: A large-scale crowd-sourced analysis of abuse against women journalists and politicians on twitter. In: AI for Social Good NeurIPS 2018 Workshop 32nd Conference on Neural Information Processing Systems (NIPS 2018), Montreal (2018)

    Google Scholar 

  18. Donner, J., et al.: Stages of design in technology for global development. Computer 41, 34–41 (2008)

    Google Scholar 

  19. Dotterer, A.M., McHale, S.M., Crouter, A.C.: Sociocultural factors and school engagement among African American youth: the roles of racial discrimination, racial socialization, and ethnic identity. Appl. Dev. Sci. 13(2), 61–73 (2009)

    Google Scholar 

  20. El Ghouch, N., El Mokhtar, E.N., Seghroucheni, Y.Z.: Analysing the outcome of a learning process conducted within the system. Int. J. Emerg. Technol. Learn. 12(3), 43–56 (2017)

    Google Scholar 

  21. Floridi, L., et al.: Ai4people, an ethical framework for a good AI society: opportunities, risks, principles, and recommendations. Minds Mach. 28, 689–707 (2018)

    Google Scholar 

  22. Greene, M.L., Way, N., Pahl, K.: Trajectories of perceived adult and peer discrimination among black, Latino, and Asian American adolescents: patterns and psychological correlates. Dev. Psychol. 42(2), 218–238 (2006)

    Google Scholar 

  23. Hakami, E., Hernandez-Leo, D.: How are learning analytics considering the societal values of fairness, accountability, transparency and human well-being?: a literature review. In: Martinez-Mones, A., Alvarez, A., Caeiro-Rodriguez, M., Dimitriadis, Y. (eds.) LASI-SPAIN 2020: Learning Analytics Summer Institute Spain 2020: Learning Analytics. Time for Adoption?, pp. 121–141. Aachen: CEUR, Valladolid, Spain (2020)

    Google Scholar 

  24. Hallamaa, J., Kalliokoski, T.: Ai ethics as applied ethics. Front. Comput. Sci. 4, 776837 (2022)

    Google Scholar 

  25. Hamal, O., El Faddouli, N.E., Alaoui Harouni, M.H., Lu, J.: Sustainability. Artif. Intell. Educ. 5, 1–11 (2022)

    Google Scholar 

  26. Hashim, H.: Application of technology in the digital era education. Int. J. Res. Couns. Educ. 1(2), 1–5 (2018)

    Google Scholar 

  27. He, Y., Burghardt, K., Lerman, K.: A geometric solution to fair representations. In: 2020 AAAI/ACM Conference, pp. 279–285. ACM, New York (2020)

    Google Scholar 

  28. Heaven, P.C.L., Leeson, P., Ciarrochi, J.: Personality development at school: assessing a reciprocal influence model of teachers’ evaluations and students’ personality. J. Res. Pers. 43(5), 815–821 (2009)

    Google Scholar 

  29. Holmes, W., et al.: The FATE of AIED, chap. Ethics of AI in Education: Towards a Community-Wide Framework, pp. 1–23. IJAIED Special Issue. Springer, Cham (2021)

    Google Scholar 

  30. Holsinger, D.B., Jacob, W.J.: Inequality in education: a critical analysis. In: Holsinger, D.B., Jacob, W.J. (eds.) Inequality in Education. CERC Studies in Comparative Education, vol. 24, pp. 1–33. Springer, Dordrecht (2008). https://doi.org/10.1007/978-90-481-2652-1_1

    Google Scholar 

  31. Hutt, S., Duckworth, A.L., Gardner, M., D’Mello, S.K.: Evaluating fairness and generalizability in models predicting on-time graduation from college applications. In: The 12th International Conference on Educational Data Mining (EDM 2019), pp. 79–88. EDM, Montreal, Canada (2019)

    Google Scholar 

  32. Hwang, G.-J.: Definition, framework and research issues of smart learning environments - a context-aware ubiquitous learning perspective. Smart Learn. Environ. 1(1), 1–14 (2014). https://doi.org/10.1186/s40561-014-0004-5

    Google Scholar 

  33. Kessler, R.C., Mickelson, K.D., Williams, D.R.: The prevalence, distribution, and mental health correlates of perceived discrimination in the United States. J. Health Soc. Behav. 40(3), 208–230 (1999)

    Google Scholar 

  34. Kizilcec, R.F., Lee, H.: Algorithmic fairness in education. In: Holmes, W., Porayska-Pomsta, K. (eds.) The Ethics of Artificial Intelligence in Education, pp. 1–30. Taylor and Francis (2022)

    Google Scholar 

  35. Liao, V., Gruen, D.M., Miller, S.: Questioning the AI: informing design practices for explainable AI user experiences. In: 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–15. Association for Computing Machinery, New York (2020)

    Google Scholar 

  36. Marras, M., Boratto, L., Ramos, G., Fenu, G.: The FATE of AIED, chap. Equality of Learning Opportunity via Individual Fairness in Personalized Recommendations. IJAIED Special Issue. Springer, Cham (2021)

    Google Scholar 

  37. Mehrabi, N., Morstatter, F., Saxena, N., Galstyan, A., Lerman, K.: A survey on bias and fairness in machine learning. ACM Comput. Surv. 54(6), 115 (2021)

    Google Scholar 

  38. Mitchell, S., Potash, E., Barocas, S., D’Amour, A., Lum, K.: Algorithmic fairness: choices, assumptions, and definitions. Annu. Rev. Stat. Appl. 8, 141–163 (2021)

    MathSciNet  Google Scholar 

  39. Monteleoni, C.S., McQuade, S., Schmidt, G.A.: Climate informatics: accelerating discovering in climate science with machine learning. Comput. Sci. Eng. 15, 32–40 (2013)

    Google Scholar 

  40. de Montreal, U.: Montreal declaration for a responsible development of artificial intelligence. Technical report, Universite de Montreal (2018)

    Google Scholar 

  41. Paquette, L., Ocumpaugh, J., Li, Z., Andres, A., Baker, R.: Who’s learning? Using demographics in EDM research. J. Educ. Data Mining 12(3), 1–30 (2020)

    Google Scholar 

  42. Pinkwart, N.: Another 25 years of AIED? Challenges and opportunities for intelligent educational technologies of the future. Int. J. Artif. Intell. Educ. 26(2), 771–783 (2016)

    Google Scholar 

  43. Qian, H., Rangwala, H.: Towards fair educational data mining: a case study on detecting at-risk students. In: Rafferty, A.N., Whitehill, J., Cavalli-Sforza, V., Romero, C. (eds.) The 13th International Conference on Educational Data Mining (EDM 2020), pp. 431–437. EDM (2020)

    Google Scholar 

  44. Raji, I.D., et al.: Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In: FAT* 2020: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, pp. 33–44. ACM (2020)

    Google Scholar 

  45. Riazy, S., Simbeck, K.: Predictive algorithms in learning analytics and their fairness. In: Pinkwart, N., Konert, J. (eds.) DELFI 2019, pp. 223–228. Gesellschaft fur Informatik e.v, Boon, Germany (2019)

    Google Scholar 

  46. Roll, I., Wylie, R.: Evolution and revolution in artificial intelligence in education. Int. J. Artif. Intell. Educ. 26(2), 582–599 (2016)

    Google Scholar 

  47. Rudin, C.: Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1(5), 206–215 (2019)

    Google Scholar 

  48. Schiff, D.: Out of the laboratory and into the classroom: the future of artificial intelligence in education. AI Soc. 36(1), 331–348 (2021)

    Google Scholar 

  49. Serna, I., Morales, A., Fierrez, J., Obradovich, N.: Sensitive loss: improving accuracy and fairness of face representations with discrimination-aware deep learning. Artif. Intell. (AIJ) 305, 103682 (2022)

    Google Scholar 

  50. Singh, H., Miah, S.J.: Smart education literature: a theoretical analysis. Educ. Inf. Technol. 25(4), 3299–3328 (2020). https://doi.org/10.1007/s10639-020-10116-4

    Google Scholar 

  51. Skaug Saetra, H.: A framework for evaluating and disclosing the ESG related impacts of AI with the SDGS. Sustainability 13(15), 8503 (2021)

    Google Scholar 

  52. Spector, J.M., Merrill, M.D.: Section i foundations. In: Spector, J.M., Merrill, M.D., Elen, J., Bishop, M. (eds.) Handbook of Research on Educational Communications and Technology, pp. 3–113. Springer, New York (2014)

    Google Scholar 

  53. Srinivasan, V.: AI and learning: a preferred future. Comput. Educ. Artif. Intell. 3, 100062 (2022)

    Google Scholar 

  54. Stone, S., Han, M.: Perceived school environments, perceived discrimination, and school performance among children of Mexican immigrants. Child. Youth Serv. Rev. 27, 51–66 (2005)

    Google Scholar 

  55. Suresh, H., Guttag, J.V.: A framework for understanding unintended consequences of machine learning. In: Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) (2019)

    Google Scholar 

  56. Tahiru, F.: Ai in education: a systematic literature review. J. Cases Inf. Technol. 23(1), 1–20 (2021)

    Google Scholar 

  57. Tang, K.Y., Chang, C.Y., Hwang, G.J.: Trends in artificial intelligence-supported e-learning: a systematic review and co-citation network analysis (1998–2019). Interact. Learn. Environ. (2021)

    Google Scholar 

  58. Tomasev, N., et al.: Otake-matsuura: Ai for social good: unlocking the opportunity for positive impact. Nat. Commun. 11, 2468 (2020)

    Google Scholar 

  59. Tzanakis, M.: Bourdieu’s social reproduction thesis and the role of cultural capital in educational attainment: a critical review of key empirical studies. Educate J. 11(1), 76–90 (2011)

    Google Scholar 

  60. Vinuesa, R., et al.: The role of artificial intelligence in achieving the sustainable development goals. Nat. Commun. 11, 233 (2020)

    Google Scholar 

  61. Way, N., Rosenbloom, S.R.: Experiences of discrimination among African American, Asian American, and Latino adolescents in an urban high school. Youth Soc. 35(4), 420–451 (2004)

    Google Scholar 

  62. Wong, C.A., Eccles, J.S., Sameroff, A.: The influence of ethnic discrimination and ethnic identification on African American adolescents’ school and socioemotional adjustment. J. Pers. 71(6), 1197–1232 (2003)

    Google Scholar 

  63. Xie, M., Jean, N., Burke, M., Lobell, D., Ermon, S.: Transfer learning from deep features for remote sensing and poverty mapping. In: Thirtieth AAAI Conference on Artificial Intelligence (AAAI 2016), pp. 3929–3935. Association for the Advancement of Artificial Intelligence, Standford, USA (2016)

    Google Scholar 

  64. Zhu, Z.-T., Yu, M.-H., Riezebos, P.: A research framework of smart education. Smart Learn. Environ. 3(1), 1–17 (2016). https://doi.org/10.1186/s40561-016-0026-2

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The University of the Basque Country (UPV/EHU), San Sebastian-Donostia, Spain

    Ana Matias & Iraide Zipitria

Authors
  1. Ana Matias
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iraide Zipitria
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ana Matias .

Editor information

Editors and Affiliations

  1. University of Montreal, Montreal, Canada

    Claude Frasson

  2. University of West Attica, Athens, Greece

    Phivos Mylonas

  3. University of West Attica, Athens, Greece

    Christos Troussas

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Matias, A., Zipitria, I. (2023). Promoting Ethical Uses in Artificial Intelligence Applied to Education. In: Frasson, C., Mylonas, P., Troussas, C. (eds) Augmented Intelligence and Intelligent Tutoring Systems. ITS 2023. Lecture Notes in Computer Science, vol 13891. Springer, Cham. https://doi.org/10.1007/978-3-031-32883-1_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-32883-1_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-32882-4

  • Online ISBN: 978-3-031-32883-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation