Abstract
The continued improvement in the processing power of mobile devices, has enabled the deployment of complex processing and analysis in real time on personal devices. The prevalence of mobile devices, and the primary use as a gaming platform, provide an opportunity to create Serious Games based on complex image processing. This article focuses on the communication skills of children with autism, and develops a game using automated emotion recognition to assist in learning to interact in emotionally rich situations. This paper is an initial technology demonstration, which will lead, in future publications, to a full assessment of effect. The game uses automatic recognition of smiling to provide a scoring mechanism for player who collect facial expressions from people around them.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Measuring emotions. affectiva. Web page (February 6, 2010), http://www.affectiva.com/measuring-emotions/
Noor, M., Shahbodin, F., Pee, C., et al.: Serious game for autism children: Review of literature (2012)
NHI. Autism - oversikt - nhi.no. NHI (February 6, 2013), http://nhi.no/foreldre-og-barn/barn/sykdommer/autisme-oversikt-11725.html
Weigelt, S., Koldewyn, K., Kanwisher, N.: Face identity recognition in autism spectrum disorders: A review of behavioral studies. Neuroscience & Biobehavioral Reviews 36(3), 1060–1084 (2012)
Zeeland, S.-V., Ashley, A., Dapretto, M., Ghahremani, D.G., Poldrack, R.A., Bookheimer, S.Y.: Reward processing in autism. Autism Research 3(2), 53–67 (2010)
Fleming, N., Mills, C.: Vark: A guide to learning styles (2001)
Hodgdon, L.A.: Visual Strategies for Improving Communication. QuirkRobert Publishing (2011)
Teacch autism program. web page. UNC School of medicine (April 2013), http://teacch.com/clinical-services-1/supported-employment-1/philosophy-and-overview
Finkelstein, S.L., Nickel, A., Harrison, L., Suma, E.A., Barnes, T.: cmotion: A new game design to teach emotion recognition and programming logic to children using virtual humans. In: IEEE Virtual Reality Conference, VR 2009, pp. 249–250. IEEE (2009)
Tanaka, J.W., Wolf, J.M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M.D., Schultz, R.T.: Journal of Child Psychology and Psychiatry 51(8), 944–952 (2010)
Cockburn, J., Bartlett, M., Tanaka, J., Movellan, J., Pierce, M., Schultz, R.: Smilemaze: A tutoring system in real-time facial expression perception and production in children with autism spectrum disorder. In: ECAG 2008 Workshop Facial and Bodily Expressions for Control and Adaptation of Games, p. 3 (2008)
Barakova, E., van Wanrooij, G., van Limpt, R., Menting, M.: Using an emergent system concept in designing interactive games for autistic children. In: Proceedings of the 6th International Conference on Interaction Design and Children, pp. 73–76. ACM (2007)
Littlewort, G., Bartlett, M.S., Fasel, I., Susskind, J., Movellan, J.: Dynamics of facial expression extracted automatically from video. Image and Vision Computing 24(6), 615–625 (2006)
Krathwohl, D.R.: A revision of bloom’s taxonomy: An overview. Theory into Practice 41(4), 212–218 (2002)
Opencv. Web page. OpenCV Developer Team (2013), http://opencv.org/
Conner, M., Norman, P.: Predicting health behaviour, 2nd edn. Open university Press (2005)
Squire, K.: From information to experience: Place-based augmented reality games as a model for learning in a globally networked society. Teachers College Record 112(10), 2565–2602 (2010)
Miller, G.: The smartphone psychology manifesto. Perspectives on Psychological Science 7(3), 221–237 (2012)
Chen, P.-M., Chen, C.-H., Liao, W.-H., Li, T.-Y.: A service platform for logging and analyzing mobile user behaviors. In: Chang, M., Hwang, W.-Y., Chen, M.-P., Müller, W. (eds.) Edutainment 2011. LNCS, vol. 6872, pp. 78–85. Springer, Heidelberg (2011)
Tanaka, J.W., Lincoln, S., Hegg, L.: A framework for the study and treatment of face processing deficits in autism. The Development of Face Processing, 101–119 (2003)
(July 2013), http://ceaccp.oxfordjournals.org/content/8/6/221.full
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hansen, O.B., Abdurihim, A., McCallum, S. (2013). Emotion Recognition for Mobile Devices with a Potential Use in Serious Games for Autism Spectrum Disorder. In: Ma, M., Oliveira, M.F., Petersen, S., Hauge, J.B. (eds) Serious Games Development and Applications. SGDA 2013. Lecture Notes in Computer Science, vol 8101. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40790-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-40790-1_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40789-5
Online ISBN: 978-3-642-40790-1
eBook Packages: Computer ScienceComputer Science (R0)