Abstract
In this paper, we propose that the artificial intelligence in education (AIED) community lead the charge in leveraging multimodal interfaces, in conjunction with artificial intelligence, to advance learning interfaces and experiences that are more inclusive. Recent years has seen the development of various multimodal technologies for capturing voice, gesture and gaze-based input modalities, as well as various forms of auditory and haptic feedback. These modalities could be powerful tools for developing inclusive learning interfaces. To ground this idea, we present a set of examples for how this work can be transformative in democratizing access to technology, while also democratizing designing and building technology. Additionally, our examples reinforce how designing for inclusive learning can result in improved learning interfaces for the general population.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akhras, F.N., Brna, P.: First workshop on artificial intelligence in education to support the social inclusion of communities (AIEDSIC). In: AIED, p. 632 (2011)
Alcorn, A.M.: Discrepancy-Detection in virtual learning environments for young children with ASC. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 884–887. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_137
Buechley, L., Eisenberg, M., Catchen, J., Crockett, A.: The LilyPad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 423–432 (2008)
Horn, M.S.: Top Code: Tangible Object Placement Codes. Accessed. http://users.eecs.northwestern.edu/~mhorn/topcodes/
Ladner, R.: Design for user empowerment. In: Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI EA 2014, pp. 5–6. (2014). https://doi.org/10.1145/2559206.2580090
Papert, S.: Mindstorms: Children, computers, and powerful ideas. Basic Books, Inc., New York (1980)
Ramey, K.E., Uttal, D.: Making sense of space: distributed spatial sensemaking in a middle school summer engineering camp. J. Learn. Sci. 26(2), 277–319 (2017). https://doi.org/10.1080/10508406.2016.1277226
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., Kafai, Y.: Scratch: programming for all. Commun. ACM 52(11), 60–67 (2009). https://doi.org/10.1145/1592761.1592779
Resnick, M., Myers, B., Nakakoji, K., Shneiderman, B., Pausch, R., Selker, T., Eisenberg, M.: Design principles for tools to support creative thinking. Science 20(2), 25–35 (2005)
Salles, P., Pereira, Mônica M.R., Feltrini, Gisele M., Pires, L., Lima-Salles, H.: Evaluating the use of qualitative reasoning models in scientific education of deaf students. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 537–540. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_94
Toprani, D., Yan, S., Borge, M.: A comparative analysis of the collaboration process across different technologies. In: Proceedings of the 6th annual conference on creativity and fabrication in education - FabLearn 2016, pp. 66–69 (2016). https://doi.org/10.1145/3003397.3003407
Walker, W., Lamere, P., Kwok, P., Raj, B., Singh, R., Gouvea, E., Wolf, P., Woelfel, J.: Sphinx-4 : a flexible open source framework for speech recognition. Smli, TR-2004-139: pp. 1–9 (2004). https://doi.org/10.1.1.91.4704
Worsley, M.: Multimodal learning analytics - enabling the future of learning through multimodal data analysis and interfaces. In: ICMI 2012 - Proceedings of the ACM International Conference on Multimodal Interaction (2012). https://doi.org/10.1145/2388676.2388755
Worsley, M., Blikstein, P.: A multimodal analysis of making. Int. J. Artif. Intell. Educ, 1–35 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Worsley, M., Barel, D., Davison, L., Large, T., Mwiti, T. (2018). Multimodal Interfaces for Inclusive Learning. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10948. Springer, Cham. https://doi.org/10.1007/978-3-319-93846-2_73
Download citation
DOI: https://doi.org/10.1007/978-3-319-93846-2_73
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93845-5
Online ISBN: 978-3-319-93846-2
eBook Packages: Computer ScienceComputer Science (R0)