Abstract
Teaching children with intellectual disabilities is a challenging task. Instructors use different methodologies and techniques to introduce the concepts of lessons to the children, motivate them and keep them engaged. These methodologies include reading texts, showing pictures and images, touching items, taking children to sites to see and understand, and even using the taste and smell senses (i.e., hot, cold). The objective of this work is to develop a system that can assist the children with special needs to improve their understanding of simple stories related to the animals and foods domain through multimedia technology. We use formal concepts analysis and a simple ontology to extract the keywords representing characters, actions, and objects from the story text and link them with the corresponding multimedia elements (i.e., images, sounds and clips). These elements are retrieved by querying Google database using Google APIs features. The instructors would have to validate the obtained results and select what is appropriate for the children in the classroom. The system allows the instructor to input the story text and get as output the multimedia story.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alja’am, J.M., Jaoua, A.M., Hasnah, A.M., Hassan, F., Mohamed, H., Mosaid, T., Saleh, H., Abdullah, F., Hassan, C.: Text Summarization based on Conceptual Data Classification. In: Alkhatib, G., Rine, D.D. (eds.) Agent Technologies and Web Engineering: Applications and Systems, pp. 195–209. IGI Global (2008)
Elsaddik, A.: Interactive Multimedia Learning. Springer (2001)
Evans, D.G., Bowick, L., Johnson, M., Blenkhorn, P.: Using Iconicity to Evaluate Symbol Use. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2006. LNCS, vol. 4061, pp. 874–881. Springer, Heidelberg (2006)
Ganter, B., Wille, R.: Formal Concept Analysis. Springer (1999)
Google Ajax Language APIs, http://code.google.com/apis/ajaxlanguage/
Gunther, S., Ströhlein, T.: Relations and Graphs. Springer (1989)
Jaoua, A.: Pseudo-Conceptual Text and Web Structuring. In: The Third Conceptual Structures Tool Interoperability Workshop, CS-TIW 2008, pp. 22–32 (2008)
Miguel, A.G.R., El-Seoud, S.A., Edwards, A., Alja’am, J.M., Raul, A.S.: Integrating the Sense of Smell in an Educational Human-Computer Interface. In: International Conference on Interactive Collaborative Learning, ICL 2008, pp. 1–7 (2008)
Nickull, D., Reitman, L., Ward, J., Wilber, J.: Service Oriented Architecture (SOA) and Specialized Messaging Patterns. Technical White Paper, pp. 1–15, (2007), http://www.adobe.com/enterprise/pdfs/Services_Oriented_Architecture_from_Adobe.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mwinyi, M.U., Ismail, S.A., Alja’am, J.M., Jaoua, A.M. (2012). Understanding Simple Stories through Concepts Extraction and Multimedia Elements. In: Benlamri, R. (eds) Networked Digital Technologies. NDT 2012. Communications in Computer and Information Science, vol 293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30507-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-30507-8_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30506-1
Online ISBN: 978-3-642-30507-8
eBook Packages: Computer ScienceComputer Science (R0)