Abstract
The use of information and communication technologies in educating children with autism spectrum disorders (ASD) is a dynamic field linking both special education and learning technologies research areas. This paper reports on the development of pre-vocational skills laboratory (PVS-Lab), a Web-based learning environment aiming to support students with ASD towards developing pre-vocational and employment skills. The first section addresses theoretical foundations and the design framework of PVS-Lab, as well as the structure and the functionality of the system. Following a particular intervention is presented including the analysis of the engagement of an autistic student with PVS-Lab and his tutors’ monitoring, based on a psychophysiological signal recording system. The paper concludes with the need to advance future research towards new learning environments that can help (a) students with autism to acquire pre-vocational skills, and (b) tutors to harness the potential of multiple forms of information (PVS-Lab system log files, psychophysiological data, video records and observation notes) towards designing effective individualized interventions.
Similar content being viewed by others
References
Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., Foster, M., Avramides, K., Frauenberger, C., Bernardini, S.: Social communication between virtual characters and children with autism. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) Artificial Intelligence in Education, Lecture Notes in Computer Science, vol. 6738, pp. 7–14. Springer, Berlin (2011)
Alexander, J., Ayres, K., Smith, K., Shepley, S., Mataras, T.: Using video modeling on an ipad to teach generalized matching on a sorting mail task to adolescents with autism. Res. Autism Spectr. Disord. 7(11), 1346–1357 (2013). doi:10.1016/j.rasd.2013.07.021
Allen, K., Wallace, D., Greene, D., Bowen, S., Burke, R.: Community-based vocational instruction using videotaped modeling for young adults with autism spectrum disorders performing in air-inflated mascots. Focus Autism Other Dev. Disabil. 25(3), 186–192 (2010). doi:10.1177/1088357610377318
Amirabdollahian, F., Robins, B., Dautenhahn, K., Ji, Z.: Investigating tactile event recognition in child-robot interaction for use in autism therapy. In: 33rd Annual International Conference of the IEEE EMBS, pp. 5347–5351. IEEE, Boston (2011). doi:10.1109/IEMBS.2011.6091323
Anzalone, S., Tilmont, E., Boucenna, S., Xavier, J., Jouen, A., Bodeau, N., Maharatna, K., Chetouani, M., Cohen, D.: How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3d and time) environment during a joint attention induction task with a robot. Res. Autism Spectr. Disord. 8(7), 814–826 (2014). doi:10.1016/j.rasd.2014.03.002
Association, A.P., et al.: Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub, Washington, DC (2013)
Baron, G.: Stress and Coping in Autism. Oxford University Press, New York (2006)
Baron-Cohen, S.: Mindblindness: An Essay on Autism and Theory of Mind. A Bradford Book. Bradford Books, Boston (1997)
Baron-Cohen, S., Leslie, A.M., Frith, U.: Does the autistic child have a theory of mind? Cognition 21(1), 3746 (1985)
Bellani, M., Fornasari, L., Chittaro, L., Brambilla, P.: Virtual reality in autism: state of the art. Epidemiol. Psychiatric Sci. 20(03), 235–238 (2011)
Benyon, D.: Designing Interactive Systems: A Comprehensive Guide to HCI and Interaction Design. Addison Wesley, Boston (2010)
Bereznak, S., Ayres, K., Mechling, L., Alexander, J.: Video self-prompting and mobile technology to increase daily living and vocational independence for students with autism spectrum disorders. J. Dev. Phys. Disabil. 24(3), 269–285 (2012). doi:10.1007/s10882-012-9270-8
Bishop, J.: The internet for educating individuals with social impairments. J. Comput. Assist. Learn. 19(4), 546–556 (2003). doi:10.1046/j.0266-4909.2003.00057.x
Blair, R., Frith, U., Smith, N., Abell, F., Cipolotti, L.: Fractionation of visual memory: agency detection and its impairment in autism. Neuropsychologia 40(1), 108–118 (2002)
Bolte, S., Golan, O., Goodwin, M., Zwaigenbaum, L.: Editorial: what can innovative technologies do for autism spectrum disorders? Autism 14(3), 155–159 (2010)
Bosseler, A., Massaro, D.: Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J. Autism Dev. Disord. 33(6), 653–672 (2003)
Burke, R., Andersen, M., Bowen, S., Howard, M., Allen, K.: Evaluation of two instruction methods to increase employment options for young adults with autism spectrum disorders. Res. Dev. Disabil. 31(6), 1223–1233 (2010). doi:10.1016/j.ridd.2010.07.023
Carlile, K., Reeve, S., Reeve, K., DeBar, R.: Using activity schedules on the ipod touch to teach leisure skills to children with autism. Educ. Treat. Children 36(2), 33–57 (2013)
CDCP: Prevalence of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, United States, 2010. U.S. Department of Health and Human Service Centers for Disease Control and Preventions, Atlanta (2014). Online: http://www.cdc.gov/mmwr/pdf/ss/ss6302.pdf
Chang, C.L., Lung, F.W., Yen, C.F., Yang, P.: Adaptive behaviors in high-functioning taiwanese children with autism spectrum disorders: an investigation of the mediating roles of symptom severity and cognitive ability. J. Autism Dev. Disord. 43(6), 1347–1355 (2013). doi:10.1007/s10803-012-1684-8
Charitos, D., Karadanos, G., Sereti, E., Triantafillou, S., Koukouvinou, S., Martakos, D.: Employing virtual reality for aiding the organization of autistic children behavior in everyday tasks. In: Sharkey, P., Cesarani, A., Pugnetti, L., Rizzo, A. (eds.) Proceedings of the 3rd International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT 2000), pp. 147–152. University of Reading, UK (2000)
Charlop, M., Dennis, B., Carpenter, M., Greenberg, A.: Teaching socially expressive behaviors to children with autism through video modeling. Educ. Treat. Children 33, 371393 (2010)
Cihak, D., Smith, C., Cornett, A., Coleman, M.: The use of video modeling with the picture exchange communication system to increase independent communicative initiations in preschoolers with autism and developmental delays. Focus Autism Other Dev. Disabil. 27(1), 3–11 (2012). doi:10.1177/1088357611428426
Cohen, L., Manion, L., Morrison, K.: Research Methods in Education. Routledge, New York (2007)
Cramer, M., Hirano, S., Tentori, M., Yeganyan, M., Hayes, G.: Classroom-based assistive technology: collective use of interactive visual schedules by students with autism. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), Vancouver, Canada, pp. 1–10. ACM, New York (2011). doi:10.1145/1978942.1978944
Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: background, motivation and challenges. Pragmat. Cogn. 12(1), 1–35 (2004)
Davies, D.K., Stock, S.E., Wehmeyer, M.L.: A palmtop computer-based intelligent aid for individuals with intellectual disabilities to increase independent decision making. Res. Pract. Persons Sev. Disabil. 28, 182193 (2003)
Dawn, S., Michael, C., Richard, D.: A longitudinal study of employment and skill acquisition among individuals with developmental disabilities. Res. Dev. Disabil. 26(5), 469–486 (2005). doi:10.1016/j.ridd.2003.12.003
De Silva, P.R.S., Higashi, M., Lambacher, S.G., Osano, M.: Monitoring of emotion to create adaptive game for children with mild autistic. In: Kropatsch, W.G., Kampel, M., Hanbury, A. (eds.) Computer Analysis of Images and Patterns: Proceedings of 12th International Conference on CAIP 2007, Vienna, Austria, August 27–29. Lecture Notes in Computer Science, vol. 4673, pp. 326–333. Springer, Berlin, Heidelberg (2007). doi:10.1007/978-3-540-74272-2_41
Diehl, J., Schmitt, L., Villano, M., Crowell, C.: The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res. Autism Spectr. Disord. 6(1), 249–262 (2012)
Dotto-Fojut, K., Reeve, K., Townsend, D., Progar, P.: Teaching adolescents with autism to describe a problem and request assistance during simulated vocational tasks. Res. Autism Spectr. Disord. 5(2), 826–833 (2011). doi:10.1016/j.rasd.2010.09.012
Duquette, A., Michaud, F., Mercier, H.: Exploring the use of a mobile robot as an imitation agent with children with lowfunctioning autism. Autonom. Robots Spec. Issue Soc. Assist. Robot. 24(2), 147–157 (2007)
Escobedo, L., Nguyen, D., Boyd, L., Hirano, S., Rangel, A., Garcia, D., Tentori, M., Hayes, G.: MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations. In: SIGCHI Conference on Human Factors in Computing Systems (CHI 2012), pp. 2589–2598. ACM Press, New York (2012). doi:10.1145/2207676.2208649
Fabri, M., Awad Elzouki, S., Moore, D.: Emotionally expressive avatars for chatting, learning and therapeutic intervention. In: Jacko, J. (ed.) Proceedings of the 12th International Conference on Human-Computer Interaction: Intelligent Multimodal Interaction Environments (HCI'07), pp. 275–285. Springer, Berlin, Heidelberg (2007)
Farley, M., McMahon, W., Fombonne, E., Jenson, W., Miller, J., Gardner, M.: Twenty-year outcome for individuals with autism and average or near-average cognitive abilities. Autism Res. 2(2), 109118 (2009)
Ganz, J., Boles, M., Goodwyn, F., Flores, M.: Efficacy of handheld electronic visual supports to enhance vocabulary in children with asd. Focus Autism Other Dev. Disabil. 29(1), 3–12 (2014)
Garcia-Villamisar, D., Hughes, C.: Supported employment improves cognitive performance in adults with autism. J. Intellect. Disabil. Res. 51(2), 142–150 (2007). doi:10.1111/j.1365-2788.2006.00854.x
Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., Baron-Cohen, S.: Enhancing emotion recognition in children with autism spectrum conditions: an intervention using animated vehicles with real emotional faces. J. Autism Dev. Disord. 40(3), 269–279 (2010)
Golan, O., Baron-Cohen, S.: Systemizing empathy:teaching adults with asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Dev. Psychopathol. 18(2), 591–617 (2006)
Gorayska, B., Mey, J.: Cognition and Technology: Co-existence, Convergence, and Co-evolution. J. Benjamins Pub, Amsterdam (2004)
Grynszpan, O., Martin, J.C., Nadel, J.: What influences human computer interaction in autism? In: Proceedings of the 6th IEEE International Conference on Development and Learning, pp. 53–58. IEEE, London (2007). doi:10.1109/DEVLRN.2007.4354047
Grynszpan, O., Martin, J., Nadel, J.: Multimedia interfaces for users with high functioning autism: an empirical investigation. Int. J. Hum. Comput. Stud. 66, 628–639 (2008)
Hayes, G., Hirano, S., Marcu, G., Monibi, M., Nguyen, D., Yeganyan, M.: Interactive visual supports for children with autism. Pers. Ubiquitous Comput. 14(7), 663–680 (2010). doi:10.1007/s00779-010-0294-8
Hillier, A., Campbell, H., Keillor, J., Phillips, N., Beversdorf, D.: Decreased false memory for visually presented shapes and symbols among adults on the autism spectrum. J. Clin. Exp. Neuropsychol. 29(6), 610–616 (2007). doi:10.1080/13803390600878760
Holt, S., Yuill, N.: Facilitating other-awareness in low-functioning children with autism and typically-developing preschoolers using dual-control technology. J. Autism Dev. Disord. 44(1), 236–248 (2014). doi:10.1007/s10803-013-1868-x
Jimoyiannis, A.: Computer simulations and scientific knowledge construction. In: Cartelli, A., Palma, M. (eds.) Encyclopedia of Information Communication Technology, pp. 106–120. IGI Global, Hershey (2008)
Jordan, R., Powell, S.: Understanding and Teaching Children with Autism. Wiley, New York (1995)
Kagohara, D., Meer, Lvd, Ramdoss, S., OReilly, M., Lancioni, G., Davis, T., Rispoli, M., Lang, R., Marschik, P., Sutherland, D., Green, V.: Using ipods and ipads in teaching programs for individuals with developmental disabilities: A systematic review. Res. Dev. Disabil. 34(1), 147–156 (2013). doi:10.1016/j.ridd.2012.07.027
Kandalaft, M., Didehbani, N., Krawczyk, D., Allen, T., Chapman, S.: Virtual reality social cognition training for young adults with high-functioning autism. J. Autism Dev. Disord. 43(1), 34–44 (2013)
Kim, E., Berkovits, L., Bernier, E., Leyzberg, D., Shic, F., Paul, R., Scassellati, B.: Social robots as embedded reinforcers of social behavior in children with autism. J. Autism Dev. Disord. 43(5), 1038–1049 (2013). doi:10.1007/s10803-012-1645-2
Lancioni, G., Singh, N., OReilly, M., Sigafoos, J., Boccasini, A., Alberti, G., Lang, R.: People with multiple disabilities use basic reminding technology to engage in daily activities at the appropriate times. J. Dev. Phys. Disabil. 26(3), 347–355 (2014). doi:10.1007/s10882-014-9373-5
Lányi, C.S., Brown, D.J., Standen, P., Lewis, J., Butkute, V.: Results of user interface evaluation of serious games for students with intellectual disability. Acta Polytechn. Hung. 9(1), 225–245 (2012)
Lee, C., Anderson, A., Moore, D.: Using video modeling to toilet train a child with autism. J. Dev. Phys. Disabil. 26(2), 123–134 (2014). doi:10.1007/s10882-013-9348-y
Lorah, E., Tincani, M., Dodge, J., Gilroy, S., Hickey, A., Hantula, D.: Evaluating picture exchange and the ipad as a speech generating device to teach communication to young children with autism. J. Dev. Phys. Disabil. 25(6), 637–649 (2013). doi:10.1007/s10882-013-9337-1
Makrygianni, M., Reed, P.: A meta-analytic review of the effectiveness of behavioural early intervention programs for children with autistic spectrum disorders. Res. Autism Spectr. Disord. 4(4), 577–593 (2010). doi:10.1016/j.rasd.2010.01.014
Marnik, J., Szela, M.: Multimedia program for teaching autistic children. In: Ewa Pietka, J.K. (ed.) Information Technologies in Biomedicine, vol. 47, pp. 505–512. Springer, Berlin (2008)
Matson, J., Smith, K.: Current status of intensive behavioral interventions for young children with autism and pdd-nos. Res. Autism Spectr. Disord. 2(1), 60–74 (2008). doi:10.1016/j.rasd.2007.03.003
Max, M.L., Burke, J.C.: Virtual reality for autism communication and education, with lessons for medical training simulators. Stud. Health Technol. Inform. 39, 4653 (1997)
Mechling, L.C., Gast, D.L., Seid, N.H.: Using a personal digital assistant to increase independent task completion by students with autism spectrum disorder. J. Autism Dev. Disord. 39(10), 1420–1434 (2009)
Mintz, J.: Additional key factors mediating the use of a mobile technology tool designed to develop social and life skills in children with autism spectrum disorders: evaluation of the 2nd hands prototype. Comput. Educ. 63, 17–27 (2013)
Mitchell, P., Parsons, S., Leonard, A.: Using virtual environments for teaching social understanding to six adolescents with autistic spectrum disorders. J. Autism Dev. Disord. 37(3), 589–600 (2007)
Moore, D., Cheng, Y., McGrath, P., Powell, N.: Collaborative virtual environment technology for people with autism. Focus Autism Other Dev. Disabil. 21, 7–13 (2005)
Moore, D., Taylor, J.: Interactive multimedia systems for students with autism. J. Educ. Media 25, 169–177 (2000)
Murray, D., Lesser, M., Lawson, W.: Attention, monotropism and the diagnostic criteria for autism. Autism 9(2), 139–56 (2005)
Palmen, A., Didden, R., Lang, R.: A systematic review of behavioral intervention research on adaptive skill building in high-functioning young adults with autism spectrum disorder. Res. Autism Spectr. Disord. 6(2), 602–617 (2012). doi:10.1016/j.rasd.2011.10.001
Parsons, S., Cobb, S.: State-of-the-art of virtual reality technologies for children on the autism spectrum. Eur. J. Spec. Needs Educ. 26(3), 355–366 (2011)
Ploog, B., Scharf, A., Nelson, D., Brooks, P.: Use of computer-assisted technologies (cat) to enhance social, communicative, and language development in children with autism spectrum disorders. J. Autism Dev. Disord. 43(2), 301–322 (2013)
Rahman, M., Ferdous, S., Ahmed, S., Anwar, A.: Speech development of autistic children by interactive computer games. Interact. Technol. Smart Educ. 8(4), 208–223 (2011)
Rajendran, G.: Virtual environments and autism: a developmental psychopathological approach. J. Comput. Assist. Learn. 29(4), 334–347 (2013). doi:10.1111/jcal.12006
Ramdoss, S., Lang, R., Fragale, C., Britt, C., OReilly, M., Sigafoos, J., Didden, R., Palmen, A., Lancioni, G.: Use of computer-based interventions to promote daily living skills in individuals with intellectual disabilities: a systematic review. J. Dev. Phys. Disabil. 24(2), 197–215 (2012). doi:10.1007/s10882-011-9259-8
Ramdoss, S., Lang, R., Mulloy, A., Franco, J., OReilly, M., Didden, R., Lancioni, G.: Use of computer-based interventions to teach communication skills to children with autism spectrum disorders: a systematic review. J. Behav. Educ. 20(1), 55–76 (2011)
Richards, J.: Examining the exclusion of employees with asperger syndrome from the workplace. Pers. Rev. 41(5), 630646 (2012)
Ricks, D., Colton, M.: Trends and considerations in robot-assisted autism therapy. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2010), pp. 4354–4359. IEEE, Anchorage (2010). doi:10.1109/ROBOT.2010.5509327
Roux, A., Shattuck, P., Cooper, B., Anderson, K., Wagner, M., Narendorf, S.: Postsecondary employment experiences among young adults with an autism spectrum disorder. J. Am. Acad. Child Adolesc. Psychiatry 52(9), 931–939 (2013). doi:10.1016/j.jaac.2013.05.019
Schmidt, C., Schmidt, M.: Three-dimensional virtual learning environments for mediating social skills acquisition among individuals with autism spectrum disorders. In: Proceedings of the 7th International Conference on Interaction Design and Children (IDC’08), pp. 85–88. ACM, New York (2008). doi:10.1145/1463689.1463725
Schuh, J.M., Eigsti, I.: Working memory, language skills, and autism symptomatology. Behav. Sci. 2(4), 207–218 (2012). doi:10.3390/bs2040207
Shih, C.H., Chiang, M.S., Wang, S.H., Chen, C.N.: Teaching two teenagers with autism spectrum disorders to request the continuation of video playback using a touchscreen computer with the function of automatic response to requests. Res. Autism Spectr. Disord. 8(9), 1055–1061 (2014)
Sik-Lanyi, C., Tilinger, A.: Multimedia and virtual reality in the rehabilitation of autistic children. In: Klaus, J., Miesenberger, K., Zagler, W.L., Burger, D. (eds.) ICCHP, pp. 22–28. Springer, Berlin (2004)
Lucas da Silva, M., Gonalves, D., Guerreiro, T., Silva, H.: A web-based application to address individual interests of children with autism spectrum disorders. In: Hadjileontiadis, L., Martins, P., Todd, R., Paredes, H., Rodrigues, J., Barroso, J. (eds.) Proceedings of the 4th International Conference on Software Development for Enhancing Accessibility and Fighting Infoexclusion (DSAI 2012), Procedia Computer Science 14(0), pp. 20–27 (2012). doi:10.1016/j.procs.2012.10.003
Simpson, A., Langone, J., Ayres, K.: Embedded video and computer based instruction to improve social skills for students with autism. Educ. Train. Dev. Disabil. 39, 240–252 (2004)
Smith, M., Belcher, R., Juhrs, P.: A Guide to Successful Employment for Individuals with Autism. Paul H. Brookes Publishing, Baltimore (1995)
Stasolla, F., Damiani, R., Caff, A.: Promoting constructive engagement by two boys with autism spectrum disorders and high functioning through behavioral interventions. Res. Autism Spectr. Disord. 8(4), 376–380 (2014). doi:10.1016/j.rasd.2013.12.020
Stasolla, F., Perilli, V., Damiani, R.: Self monitoring to promote on-task behavior by two high functioning boys with autism spectrum disorders and symptoms of adhd. Res. Autism Spectr. Disord. 8(5), 472–479 (2014). doi:10.1016/j.rasd.2014.01.007
Strickland, D.: Virtual reality for the treatment of autism. In: Riva, G. (ed.) Virtual Reality in Neuro-Psycho-Physiology: Cognitive, Clinical and Methodological Issues in Assessment and Rehabilitation Studies, pp. 81–86. IOS Press, Amsterdam (1997). doi:10.3233/978-1-60750-888-5-81
Tentori, M., Hayes, G.: Designing for interaction immediacy to enhance social skills of children with autism. In: Bardram, J., Langhenreich, M., Truong, K., Nixon, P. (eds.) Proceedings of the 12th ACM International Conference on Ubiquitous Computing, pp. 51–60. The ACM Press, New York (2010)
Van Laarhoven, T., Johnson, J., Van Laarhoven-Myers, T., Grider, K., Grider, K.: The effectiveness of using a video ipod as a prompting device in employment settings. J. Behav. Educ. 18(2), 119–141 (2009). doi:10.1007/s10864-009-9077-6
VanBergeijk, E., Klin, A., Volkmar, F.: Supporting more able students on the autism spectrum: college and beyond. J. Autism Dev. Disord. 38(7), 13591370 (2008)
Venkatesh, S., Greenhill, S., Phung, D., Adams, B., Duong, T.: Pervasive multimedia for autism intervention. Pervas. Mobile Comput. 8(6), 863–882 (2012)
Wilkins, J., Ratajczak, A.: Developing students’ literacy skills using high-tech speech-generating augmentative and alternative communication devices. Interv. Sch. Clin. 44(3), 167–172 (2009). doi:10.1177/1053451208326050
Williams, D., Goldstein, G., Minshew, N.: The profile of memory function in children with autism. Neuropsychology 20(1), 2129 (2006). doi:10.1037/0894-4105.20.1.21
WHO: International Statistical Classification of Diseases and Related Health Problems, 10th Revision (ICD-10). World Health Organization (2016). Online: http://www.who.int/classifications/icd/en
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
See Table 2.
Rights and permissions
About this article
Cite this article
Tsiopela, D., Jimoyiannis, A. Pre-vocational skills laboratory: designing interventions to improve employment skills for students with autism spectrum disorders. Univ Access Inf Soc 16, 609–627 (2017). https://doi.org/10.1007/s10209-016-0488-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-016-0488-6