Abstract
It is well-known that people with autism or mental retardation experience crucial problems in thinking and communicating using linguistic structures. Thus, we foresee the emergence of text-to-image conversion systems to let such people establish a bridge between linguistic expressions and the concepts these expressions refer to via relevant images. S2S is such a system for converting Turkish sentences into representative 3D scenes via the mediation of an HPSG-based NLP module. A precursor to S2S, a non-3D version, has been tested with a group of students with autism and mental retardation in a special education center and has provided promising results motivating the work presented in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adorni, G., Di Manzo, M., Giunchiglia, F.: Natural Language Driven Image Generation. In: COLING 1984, pp. 495–500 (1984)
Carpenter, B., Penn, G.: The Attribute Logic Engine User’s Guide, Version 3.2.1. University of Toronto (2001), http://www.cs.toronto.edu/~gpenn/ale.html
Clay, S.R., Wilhelms, J.: Put: Language-Based Interactive Manipulation of Objects. IEEE Computer Graphics and Applications, 31–39 (1996)
Coyne, B., Sproat, R.: WordsEye: An Automatic Text-to-Scene Conversion System. In: Siggraph Proceedings (2001)
Dröes, R.M., Mulvenna, M., Nugent, C., Finlay, D., Donnelly, M., Mikalsen, M., Walderhaug, S., van Kasteren, T., Kröse, B., Puglia, S., Scanu, F., Migliori, M.O., Uçar, E., Atlig, C., Kılıçaslan, Y., Uçar, Ö., Hou, J.: Healthcare Systems and Other Applications. IEEE Pervasive Computing 6(1), 59–63 (2007)
Durupınar, F., Kahramankaptan, U., Cicekli, I.: Intelligent indexing, retrieval and construction of crime scene photographs. In: Proceedings of the 13th Turkish Symposium on Artificial Intelligence and Neural Networks, pp. 297–306 (2004)
Griswold, D.E., Barnhill, G.P., Myles, B.S., Hagiwara, T., Simpson, R.L.: Asperger syndrome and academic achievement. Focus on Autism and Other Developmental Disabilities 17(2), 94–102 (2002)
Jacklin, A., Farr, W.: The computer in the classroom: how useful is the computer as a medium for enhancing social interaction with young people with autistic spectrum disorders? British Journal of Special Education (research section) 32(4), 209–217 (2005)
Kay, M.: Functional Grammar. In: Proceedings of the Fifth Annual Meeting of the Berkeley Linguistic Society, pp. 142–158 (1979)
Kılıçaslan, Y.: A Form-Meaning Interface for Turkish. Ph.D. Dissertation. University of Edinburgh (1998)
Kılıçaslan, Y., Uçar, Ö., Güner, E.S., Bal, K.: An NLP-Based Assistive Tool for Autistic and Mentally Retarded Children: an Initial Attempt. Trakya University Journal of Science 7(2), 101–108 (2006)
Pollard, C., Sag, I.A.: Head-Driven Phrase Structure Grammar. University of Chicago Press and CSLI Publications, Chicago, London (1994)
Poole, J.B., Skymcilvain, E., Jackson, L., Singer, Y.: Education for an Information Age: Teaching in the Computerized Classroom, 5th edn. (2005)
Turkish Foundation of Support and Education for Autistics Periodical (TODEV), vol. 2 (2002)
Uçar, Ö.: Development of Artificial Intelligence-Based Assistive Tools for the Education of Disabled Children. Unpublished PhD Thesis, University of Trakya (In Turkish) (2007)
Winograd, T.: Understanding Natural Language. PhD thesis, Massachusetts Institute of Technology (1972)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kılıçaslan, Y., Uçar, Ö., Güner, E.S. (2008). An NLP-Based 3D Scene Generation System for Children with Autism or Mental Retardation. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing – ICAISC 2008. ICAISC 2008. Lecture Notes in Computer Science(), vol 5097. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69731-2_88
Download citation
DOI: https://doi.org/10.1007/978-3-540-69731-2_88
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69572-1
Online ISBN: 978-3-540-69731-2
eBook Packages: Computer ScienceComputer Science (R0)