Skip to main content
SpringerLink
Log in

Culturally Aware Intelligent Learning Environments for Resource-Poor Countries

  • Conference paper
  • First Online:
Culture and Computing. Design Thinking and Cultural Computing (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12795))

Included in the following conference series:

  • 1140 Accesses

Abstract

This paper presents current work being done on the development of a speech and language technology (SLT) based intelligent tutoring system for coaching young learners from a Caribbean context in developing literacy skills. The system uses speech recognition, socio-cultural modelling and educational technology techniques that aim to enable two-way, dynamic communication between a young reader and the synthetic SLT tutor. Two goals of the research are to firstly model a reader computationally from instructional and socio-cultural perspectives, and secondly to create speech models that capture the unique linguistic variations and pronunciations expressed by young readers in Trinidad and Jamaica in particular.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adams, M.J.: The promise of automatic speech recognition for fostering literacy growth in children and adults. Handb. Lit. Technol. 2, 109–12 (2005)

    Google Scholar 

  2. Aleven, V.: Rule-based cognitive modeling for intelligent tutoring systems. In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems, vol. 308, pp. 33–62. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14363-2_3

    Chapter  Google Scholar 

  3. Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: lessons learned. J. Learn. Sci. 4(2), 167–207 (1995)

    Article  Google Scholar 

  4. Aylett, R., Paiva, A., Vannini, N., et al.: But that was in another country: agents and intercultural empathy. In: Decker, K.S., Sichman, J.S., Sierra, C., et al. (eds.) Proceedings of 8th International Conference on Autonomous Agents and Multi Agent Systems, pp. 329–336. Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems, Budapest, Hungary (2009)

    Google Scholar 

  5. Banerjee, S., Beck, J.E., Mostow, J.: Evaluating the effect of predicting oral reading miscues. In: Eighth European Conference on Speech Communication and Technology, pp.3165–3168. Eurospeech, Geneva (2003)

    Google Scholar 

  6. Blanchard, E.G., Allard, D.: The Handbook of Research on Culturally-Aware Information Technology: Perspectives and Models. Information Science Publishing, Hershey (2011). https://doi.org/10.4018/978-1-61520-883-8

    Book  Google Scholar 

  7. Blanchard, E.G., Ogan, A.: Infusing cultural awareness into intelligent tutoring systems for a globalized world. In: Nkambou, R., Mizoguchi, R., Bourdeau, J. (eds.) Advances in Intelligent Tutoring Systems. Studies in Computer Sciences, vol. 308, pp. 485–505. Springer, Berlin Heidelberg (2010). https://doi.org/10.1007/978-3-642-14363-2_24

    Chapter  Google Scholar 

  8. Blanchard, E.: Socio-cultural imbalances in AIED research: investigations, implications and opportunities. Int. J. Artif. Intell. Educ. 25(2), 204–228 (2014). https://doi.org/10.1007/s40593-014-0027-7

    Article  Google Scholar 

  9. Brusilovsky, P.: Methods and techniques of adaptive hypermedia. User Model. User-Adapt. Interact. 6(2), 87–129 (1996). https://doi.org/10.1007/BF00143964

    Article  MATH  Google Scholar 

  10. Bull, S., Kay, J.: Open learner models. In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems. Studies in Computational Intelligence, vol. 308, pp. 301–322. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14363-2_15

    Chapter  Google Scholar 

  11. Chambers, B., et al.: Computer-assisted tutoring in success for all: reading outcomes for first graders. J. Res. Educ. Effect. 1(2), 120–137 (2008)

    Google Scholar 

  12. De Jong, M., Warmelink, H.: OASISTAN: an intercultural role-playing simulation game to recognize cultural dimensions. Simul. Gaming 48(2), 178–198 (2017)

    Article  Google Scholar 

  13. De Lisle, J.: Insights on the marginalization of poor children in the education system of Trinidad and Tobago. In: Blackman, Stacey N J., Conrad, Dennis A., Brown, Launcelot I. (eds.) Achieving Inclusive Education in the Caribbean and Beyond, pp. 89–119. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15769-2_6

    Chapter  Google Scholar 

  14. Desmarais, M.C., Baker, R.S.J.D.: A Review of recent advances in learner and skill modeling in intelligent learning environments. User Model. User-Adapt. Interact. 22(1), 9–38 (2012). https://doi.org/10.1007/s11257-011-9106-8

    Article  Google Scholar 

  15. Donnelly, P.J., Blanchard, N., Samei, B., et al.: Automatic teacher modeling from live classroom audio. In: Proceedings of 24th ACM International Conference on User modeling, Adaptation, and Personalization (UMAP), pp. 45–53. ACM, New York (2016). https://doi.org/10.1145/2930238.2930250

  16. Education Endowment Foundation. Impact of school closures on the attainment gap. Rapid Evidence Assessment, London: Education Endowment Foundation (2020)

    Google Scholar 

  17. Endrass, B., André, E., Rehm, M., Nakano, Y.: Investigating culture-related aspects of behavior for virtual characters. Autonom. Agents Multi-Agent Syst. 27(2), 77–304 (2013)

    Article  Google Scholar 

  18. Fensel, D., et al.: Knowledge Graphs: Methodology, Tools and Selected Use Cases, 1st edn. Springer, Heidelberg (2020). https://doi.org/10.1007/978-3-030-37439-6

    Book  Google Scholar 

  19. Finkelstein, S., Yarzebinski, E., Vaughn, C., Ogan, A., Cassell, J.: The effects of culturally congruent educational technologies on student achievement. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 493–502. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_50

    Chapter  Google Scholar 

  20. Fowler, M., Beck, K.: Refactoring: Improving the Design of Existing Code. 2nd edn. Addison-Wesley Signature Series (2018)

    Google Scholar 

  21. Franzke, M., Kintsch, E., Caccamise, D., Johnson, N., Dooley, S.: Summary Street®: computer support for comprehension and writing. J. Educ. Comput. Res. 33(1), 53–80 (2005)

    Article  Google Scholar 

  22. Fu, R., Tao, J., Wen, Z., Yi, J., Wang, T.: Focusing on attention: prosody transfer and adaptative optimization strategy for multi-speaker end-to-end speech synthesis. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, pp. 6709–6713 (2020). https://doi.org/10.1109/ICASSP40776.2020.9054319

  23. Gasparini, I., Pimenta, M.S., Moreira de Oliveira, J.P.: How to apply context awareness in an adaptive e-learning environment to improve personalization capabilities? In: Acuña, G., Baier, J.A. (eds.) Proceedings of 30th International Conference of the Chilean Computer Society, SCCC, Curico, Chile, 9–11 November 2011, pp. 161–170. IEEE Computer Society, Washington, DC (2011)

    Google Scholar 

  24. Gilbert, J.E., et al.: Teaching algebra using culturally relevant virtual instructors. Int. J. Virtual Reality 7(1), 21–30 (2008)

    Google Scholar 

  25. Giollo, M., Gunceler, D., Liu, Y., Willett, D.: Bootstrap an end-to-end ASR system by multilingual training, transfer learning, text-to-text mapping and synthetic audio. arXiv preprint (2020). arXiv-2011.12696

    Google Scholar 

  26. Hagen, A., Pellom, B., Cole, R.: Children’s speech recognition with application to interactive books and tutors. In: IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721), St Thomas, VI, USA, pp. 186–191 (2003). https://doi.org/10.1109/ASRU.2003.1318426

  27. Heckman, J.J.: Skill formation and the economics of investing in disadvantaged children. Science 312, 1900–1902 (2006). https://doi.org/10.1126/science.1128898

    Article  Google Scholar 

  28. Huhns, M.N., Stephen, L.M.: Multiagent systems and societies of agents. Multiagent Syst.: Mod. Approach Distrib. Artif. Intell. 1, 79–114 (1999)

    Google Scholar 

  29. Johnson, W., Lester, J.: Face-to-face interaction with pedagogical agents, twenty years later. Int. J. Artif. Intell. Educ. 26(1), 25–36 (2015). https://doi.org/10.1007/s40593-015-0065-9

    Article  Google Scholar 

  30. Johnson, W.L., et al.: Tactical language training system: an interim report. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 336–345. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30139-4_32

    Chapter  Google Scholar 

  31. Kendall, E.F., McGuiness D.: Ontology Engineering. Morgan & Claypool Publishers (2019)

    Google Scholar 

  32. Kim, J., et al.: BiLAT: a game-based environment for practicing negotiation in a cultural context. Int. J. Artif. Intell. Educ. 19, 289–308 (2009)

    Google Scholar 

  33. Kumar, K., et al.: Generative adversarial networks for conditional waveform synthesis. Adv. Neural Inf. Process. Syst. 32, 14910–14921 (2019)

    Google Scholar 

  34. Lenhard, W., Baier, H., Endlich, D., Schneider, W., Hoffmann, J.: Rethinking strategy instruction: direct reading strategy instruction versus computer-based guided practice. J. Res. Read. 36(2), 223–240 (2013)

    Article  Google Scholar 

  35. Lin, H.: Syntactic and lexical approaches to reading comprehension. In: Proceedings of 5th Workshop on Natural Language Processing Techniques for Educational Applications, Melbourne, Australia, pp. 11–19 (2018)

    Google Scholar 

  36. Lugren, B., Frommel, J., Andre, E.: Combining a data-driven and theory-based approach to generate culture-dependent behaviours for virtual characters. In: Faucher, C. (ed.) Advances in Culturally-Aware Intelligent Systems and in Cross-Cultural Psychological Studies. Intelligent Systems Reference Library, vol. 134, pp. 111–14. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-67024-9_6

  37. Martin, R.: Clean Architecture: A Craftsman’s Guide to Software Structure and Design. 1st edn. Pearson (2017)

    Google Scholar 

  38. McCarthy, K.S., Soto, C.M., de Blume, A.P., Palma, D., González, J.I., McNamara, D.S.: Improving reading comprehension in Spanish using iSTART-E: a pilot study. Int. J. Comput.-Assist. Lang. Learn. Teach. 10(4), 66–82 (2020)

    Article  Google Scholar 

  39. McCracken, M., Murray, S.: The economic benefits of literacy: evidence and implications for public policy. Canadian Language and Literacy Research Network, London, Ontario, Canada (2009)

    Google Scholar 

  40. Melis, E., Goguadze, G., Libbrecht, P., et al.: Culturally-aware mathematics education technology. In: Blanchard, E.G., Allard, D. (eds.) The Handbook of Research on Culturally-Aware Information Technology: Perspectives and Models, pp. 543–557. IGI Global, Hershey (2011)

    Google Scholar 

  41. Meyer, B.J., Wijekumar, K.: A web-based tutoring system for the structure strategy: theoretical background, design, and findings. In: Reading Comprehension Strategies: Theories, Interventions, and Technologies, pp. 347–375 (2007)

    Google Scholar 

  42. Mohammed, P., Mohan, P.: Contextualising learning objects using ontologies. Comput. Intell. 23(3), 339–355 (2007)

    Article  Google Scholar 

  43. Mohammed, P., Mohan, P.: Dynamic cultural contextualisation of educational content in intelligent learning environments using ICON. Int. J. Artif. Intell. Educ. 25(2), 249–270 (2015)

    Article  Google Scholar 

  44. Mohammed, P., Mohan, P.: Integrating culture into digital learning environments: studies using cultural educational games. Caribbean Teach. Scholar 1(1), 21–335 (2011)

    Google Scholar 

  45. Mohammed, P., Mohan, P.: The design and implementation of an enculturated web-based intelligent tutoring system for computer science education. In: Proceedings of 11th IEEE International Conference on Advanced Learning Technologies (ICALT), pp. 501–505 (2011)

    Google Scholar 

  46. Mohammed, P.S., Watson, E.N.: Towards inclusive education in the age of artificial intelligence: perspectives, challenges, and opportunities. In: Knox, J., Wang, Y., Gallagher, M. (eds.) Artificial Intelligence and Inclusive Education. Perspectives on Rethinking and Reforming Education, pp. 17–37. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-8161-4_2

    Chapter  Google Scholar 

  47. Mohammed, P.S.: Ontological support for the cultural contextualisation of intelligent learning environments for inclusive education. In: Proceedings of International Workshop on Context and Culture in Intelligent Tutoring Systems at Intelligent Tutoring Systems 2018, 12 June 2018, Montreal, Canada (2018)

    Google Scholar 

  48. Mostow, J., Aist, G., Burkhead, P., Corbett, A., Cuneo, S., et al.: Evaluation of an automated reading tutor that listens: comparison to human tutoring and classroom instruction. J. Educ. Comput. Res. 29, 61–117 (2003)

    Article  Google Scholar 

  49. Mostow, J., Roth, S.P., Hauptmann, A.G., Kane, M.: A prototype reading coach that listens. In: Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI-94), Seattle, WA (1994)

    Google Scholar 

  50. Nye, B.D.: Intelligent tutoring systems by and for the developing world: a review of trends and approaches for educational technology in a global context. Int. J. Artif. Intell. Educ. 25(2), 177–203 (2015)

    Article  Google Scholar 

  51. Ogan, A., Yarzebinski, E., Fernández, P., Casas, I.: Cognitive tutor use in chile: understanding classroom and lab culture. In: Conati, C., Heffernan, N., Mitrovic, A., Verdejo, MFelisa (eds.) AIED 2015. LNCS (LNAI), vol. 9112, pp. 318–327. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19773-9_32

    Chapter  Google Scholar 

  52. Panagiotopoulos, I., Kalou, A., Pierrakeas, C., Kameas, A.: An ontology-based model for student representation in intelligent tutoring systems for distance learning. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H. (eds.) AIAI 2012. IAICT, vol. 381, pp. 296–305. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33409-2_31

    Chapter  Google Scholar 

  53. Rehm, M., Andre, E., Nakano, Y., et al: The CUBE-G approach - coaching culture-specific nonverbal behavior by virtual agents. In: Mayer, I., Mastik, H. (eds.) ISAGA 2007: organizing and learning through gaming and simulation (2007)

    Google Scholar 

  54. Reinecke, K., Bernstein, A.: Knowing what a user likes: a design science approach to interfaces that automatically adapt to culture. MIS Q. 37(2), 427–453 (2013)

    Article  Google Scholar 

  55. Rudovic, O., Utsumi, Y., Lee, J., et al.: CultureNet: a deep learning approach for engagement intensity estimation from face images of children with autism. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain, 1–5 October 2018. IEEE Xplore (2018)

    Google Scholar 

  56. Russel, M., Series, R.W., Wallace, J.L., Brown, C., Skilling, A.: The STAR system: an interactive pronunciation tutor for young children. Comput. Speech Lang. 14, 161–175 (2000)

    Article  Google Scholar 

  57. Sergis, S., Sampson, D.: An analysis of open learner models for supporting learning analytics. In: Sampson, D., Spector, J.M., Ifenthaler, D., Isaías, P., Sergis, S. (eds.) Learning Technologies for Transforming Large-Scale Teaching, Learning, and Assessment, pp. 155–190. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15130-0_9

    Chapter  Google Scholar 

  58. Sexton, C.W.: Effectiveness of the DISTAR reading i program in developing first graders’ language skills. J. Educ. Res. 82(5), 289–293 (1989). www.jstor.org/stable/27540356

  59. Uchidiuno, J, Yarzebinski, E., Madaio, M., et al.: Designing appropriate learning technologies for school vs home settings in Tanzanian rural villages. In: Proceedings of 1st ACM SIGCAS Conference on Computing and Sustainable Societies, Menlo Park and San Jose, CA, USA, 20–22 June 2018. ACM, New York (2018)

    Google Scholar 

  60. VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)

    Article  Google Scholar 

  61. Watson, S., Coy, A.: JAMLIT: a corpus of Jamaican standard English for automatic speech recognition of children’s speech. In: SLTU, pp. 243–247 (2018)

    Google Scholar 

  62. Williams, S.M., Nix, D., Fairweather, P.: Using speech recognition technology to enhance literacy instruction for emerging readers. In: Fishman, B., O’Connor-Divelbiss, S. (eds.) 4th International Conference of the Learning Sciences, New Jersey, Mahwah, N.J., pp. 115–120 (2000)

    Google Scholar 

  63. Xu, Z., Wijekumar, K., Ramirez, G., Hu, X., Irey, R.: The effectiveness of intelligent tutoring systems on K-12 students’ reading comprehension: a meta-analysis. Br. J. Educ. Technol. 50(6), 3119–3137 (2019)

    Article  Google Scholar 

  64. Zhang, H., Lin, Y.: Unsupervised learning for sequence-to-sequence text-to-speech for low-resource languages. In: Proceedings of Interspeech 2020 (2020). https://arxiv.org/abs/2008.04549

  65. Zhang, Z.Q., Song, Y., Zhang, J.S., McLoughlin, I., Dai, L.R.: Semi-supervised end-to-end ASR via teacher-student learning with conditional posterior distribution. In: Proceedings of Interspeech 2020, pp 3580–3584 (2020)

    Google Scholar 

  66. Zualkernan, I.A., Karim, A.: Using a traveling van to deliver blended learning in a developing country. In: Proceedings of 13th IEEE International Conference on Advanced Learning Technologies (ICALT), July 2013, Beijing (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing and Information Technology, The University of the West Indies, St. Augustine Campus, St. Augustine, Trinidad and Tobago

    Phaedra S. Mohammed

  2. Department of Physics, The University of the West Indies, Mona Campus, Kingston, Jamaica

    André Coy

Authors
  1. Phaedra S. Mohammed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. André Coy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Phaedra S. Mohammed .

Editor information

Editors and Affiliations

  1. Eindhoven University of Technology, Eindhoven, The Netherlands

    Matthias Rauterberg

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mohammed, P.S., Coy, A. (2021). Culturally Aware Intelligent Learning Environments for Resource-Poor Countries. In: Rauterberg, M. (eds) Culture and Computing. Design Thinking and Cultural Computing. HCII 2021. Lecture Notes in Computer Science(), vol 12795. Springer, Cham. https://doi.org/10.1007/978-3-030-77431-8_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77431-8_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77430-1

  • Online ISBN: 978-3-030-77431-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation