skip to main content
10.1145/2513002.2513005acmotherconferencesArticle/Chapter ViewAbstractPublication PagesieConference Proceedingsconference-collections
research-article

A design template for multisensory and multimodal games to train and test children for sound localisation acuity

Published:30 September 2013Publication History

ABSTRACT

Children with single-sided deafness (SSD) may experience increased rates of behavioural and educational problems since the ability to hear and listen is linked to normal brain development. This paper explores the issue of improving an aspect of hearing ability of children with SSD called sound localisation via an electronic game. We draw on existing literature to identify design principles to guide the creation of a multimodal, multisensory game to improve sound localisation and introduce a game module template to provide a structured framework on how to describe such games. Finally, game evaluation is considered.

References

  1. Adamo-Villani, N. 2006. A Virtual Learning Environment for Deaf Children: Design and Evaluation. World Academy of Science, Engineering and Technology, 16, 19--23.Google ScholarGoogle Scholar
  2. Altunian, G. 2013. phase {online}. Available: http://stereos.about.com/od/glossaryoftermsp/g/phase.htm Accessed 10 August 2013.Google ScholarGoogle Scholar
  3. American Standards Association. 1960. American Standard Acoustical Terminology. New York: American Standards Association.Google ScholarGoogle Scholar
  4. Anderson, D. R., Bryant, J., Wilder, A., Santomero, A., Williams, M. & Crawley, A. M. 2000. Researching Blue's Clues: Viewing Behavior and Impact. Media Psychology, 2, 179--194.Google ScholarGoogle ScholarCross RefCross Ref
  5. Anderson, K. L. 2011. The Developing Child with Unilateral Hearing Loss. Http://Successforkidswithhearingloss.Com/Wp-Content/Uploads/2011/08/The-Developing-Child-with-Unilateral-Hearing-Loss.Pdf Accessed 16 July 2012}Google ScholarGoogle Scholar
  6. Ashmead, D. H., Davis, D. L., Whalen, T. & Odom, R. D. 1991. Sound Localization and Sensitivity to interaural Time Differences in Human infants. Child Development, 62, 1211--1226.Google ScholarGoogle ScholarCross RefCross Ref
  7. Australian Hearing. 2008. Hearing Loss in Australia {online}. Department of Human Services. Available: http://www.Hearing.Com.Au/Upload/Media-Room/Hearing-Loss-in-Australia.Pdf Accessed 02 April 2012.Google ScholarGoogle Scholar
  8. Ayres, A. J. & Robbins, J. 2005. Sensory integration and the Child - Understanding Hidden Sensory Challenges, Western Psychological Services.Google ScholarGoogle Scholar
  9. Beijen, J., Snik, A., Straatman, L., Mylanus, E. & Mens, L. 2010. Sound Localization and Binaural Hearing in Children with a Hearing Aid and a Cochlear Implant. Audiol Neurootol, 15, 36--43.Google ScholarGoogle ScholarCross RefCross Ref
  10. Boyatzis, C. J. & Varghese, R. 1994. Children's Emotional Associations with Colors. Jrnl Genetic Psych., 155, 77--85.Google ScholarGoogle ScholarCross RefCross Ref
  11. Cai, X. 2009. Principles of HCI in Game Design. Second international Symposium on Computational intelligence and Design. Changsha, China.Google ScholarGoogle Scholar
  12. California Ear institute. 2011. Singled Sided Hearing Loss in Children {online}. Available: Http://Www.California Earinstitute.Com/Ear-Disorders-Singled-Sided-Hearing-Loss-Children-Ear-institute.Php Accessed 10 June 2012}.Google ScholarGoogle Scholar
  13. Center for Accessible Technology in Sign. 2010. Copycat {online}. Georgia Tech College of Computing. Available: Http://Cats.Gatech.Edu/Content/Copycat Accessed 27 March 2012.Google ScholarGoogle Scholar
  14. Chudler, E. H. 2007.Hearing(Audition) {online}Http://Faculty. Washington.Edu/Chudler/Chhearing.Html accessed 27-3-12}.Google ScholarGoogle Scholar
  15. Cochlear Americas. 2009. The Baha System http://Products.Cochlearamericas.Com/Diagram/Baha-System accessed9-4-12Google ScholarGoogle Scholar
  16. Cochlear Ltd. 2011a. Benefits of Baha {online}. Http://Www.Cochlear.Com/Au/Baha-Bone-Conduction-Implants/Benefits-of-Baha Accessed 02 April 2012.Google ScholarGoogle Scholar
  17. Cochlear Ltd. 2011b. How Does Baha Work? {online}. Available: Http://Www.Cochlear.Com/Au/Baha-Bone-Conduction-Implants/How-Does-Baha-Work Accessed 02 April 2012.Google ScholarGoogle Scholar
  18. Cochlear Ltd. 2012. Baha® for Children with Hearing Loss {online}. Available: Http://Www.Cochlear.Com/Au/Baha-Bone-Conduction-Implants/Benefits-of-Baha/Baha-for-Children Accessed 02 June 2012}.Google ScholarGoogle Scholar
  19. Dalgarno, B. & Lee, M. J. W. 2010. What Are the Learning Affordances of 3-D Virtual Environments? British Journal of Educational Technology, 41, 10--32.Google ScholarGoogle ScholarCross RefCross Ref
  20. Denis, G. & Jouvelot, P. Motivation Driven Educational Game Design: Applying Best Practices to Music Education. Acm Sigchi international Conference on Advances in Computer Entertainment Technology 2005 Valencia, Spain. Association for Computing Machinery, 462--465. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Desurvire, H., Caplan, M. & toth, J. A. Using Heuristics to Evaluate the Playability of Games. Conference on Human Factors in Computing Systems, 2004 Vienna, Austria. Association for Computing Machinery, 1509--1512. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Encyclopædia Britannica. 2013. sound {online}. Available: http://www.britannica.com/EBchecked/topic/555255/sound Accessed 10 August 2013.Google ScholarGoogle Scholar
  23. Encyclopædia Britannica. 2013. virtual reality (VR) {online}. Available: http://www.britannica.com/EBchecked/topic/630181/virtual-reality-VR Accessed 10 August 2013.Google ScholarGoogle Scholar
  24. Engelbrecht, K. The Impact of Color on Learning. Neocon, 2003 Chicago, Illinois.Google ScholarGoogle Scholar
  25. Galvin, K. L., Mok, M. & Dowell, R. C. 2007. Perceptual Benefit and Functional Outcomes for Children Using Sequential Bilateral Cochlear Implants. Ear & Hearing, 28, 470/482.Google ScholarGoogle Scholar
  26. Gibson, E. J. 1969. Principles of Perceptual Learning and Development, Appleton-Century-Crofts.Google ScholarGoogle Scholar
  27. Gompelmann, D., Eberhardt, R., Heußel, C.-P., Hoffmann, H., Dienemann, H., Schuhmann, M., Böcklerd, D., Schnabele, P. A., Warthe, A., Lopez-Benitez, R. & Herth, F. J. F. 2011. Lung Sequestration: A Rare Cause for Pulmonary Symptoms in Adulthood. Respiration, 2011, 445--450.Google ScholarGoogle Scholar
  28. Grangaard, E. M. 1995. Color and Light Effects on Learning. Association for Childhood Education international Study Conference and Exhibition. Washington, Dc.Google ScholarGoogle Scholar
  29. Honda, A., Shibata, H., Gyoba, J., Saitou, K., Iwaya, Y. & Suzuki, Y. 2007. Transfer Effects on Sound Localization Performances from Playing a Virtual Three-Dimensional Auditory Game. Applied Acoustics, 2007, 885--896.Google ScholarGoogle ScholarCross RefCross Ref
  30. Iversen, O. S., Kortbek, K. J., Nielsen, K. R. & Aagaard, L. 2007 Stepstone - An interactive Floor Application for Hearing Impaired Children with A Cochlear Implant. 6th int.L Conf. on Int Design & Children, Aalborg, Denmark. 117--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jacob, R., Girouard, A., Hirshfield, L. M., Horn, M., Shaer, O., Solovey, E. T. & Zigelbaum, J. 2007. CHI2006: What Is the Next Generation of HCI? ACM Interactions, 53--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. James, W. 1890.The Principles of Psychologyvol.1http://Psychclassics.Yorku.Ca/James/Principles/index.Htm Accessed2-4-12Google ScholarGoogle Scholar
  33. Kellman, P. J. & Garrigan, P. 2009. Perceptual Learning and Human Expertise. Physics of Life Review, 6, 53--84.Google ScholarGoogle ScholarCross RefCross Ref
  34. Kellman, P. J., Massey, C. M. & Son, J. Y. 2010. Perceptual Learning Modules in Mathematics: Enhancing Students' Pattern Recognition, Structure Extraction, and Fluency. Cognitive Science, 2, 285--305.Google ScholarGoogle Scholar
  35. Kephart, N. C. 1971. The Slow Learner in the Classroom, C. E. Merrill Books.Google ScholarGoogle Scholar
  36. Kinect for Windows Team. 2012. Starting February 1, 2012: Use the Power of Kinect for Windows to Change the World {online}. Msdn Blogs. Available: Http://Blogs.Msdn.Com/B/Kinectforwindows/Archive/2012/01/09/Kinect-for-Windows-Commercial-Program-Announced.Aspx Accessed 09 April 2012.Google ScholarGoogle Scholar
  37. Kluger, A. N. & Denisi, A. 1996. The Effects of Feedback interventions on Performance: A Historical Review, A Meta-Analysis, and A Preliminary Feedback intervention theory. Psychological Bulletin, 119, 254--284.Google ScholarGoogle ScholarCross RefCross Ref
  38. Kuhn, H. & Bogar-Sendelbach, E. 2011. Sound Localization: Tips & information for Users of CIS. in: Med-El (Ed.)Google ScholarGoogle Scholar
  39. Kulik, J. A. 1994. Meta-Analytic Studies of Findings on Computer-Based instruction. In: Baker, E. L. & O'neil, H. F. J. (Eds.) Technology Assessment in Education and Training. New York: Lawrence Erlbaum Associates, inc.Google ScholarGoogle Scholar
  40. Lawrence, D. H. 1952. The Transfer of a Discrimination Along a Continuum. Jrnl of Comp.& Physio. Psych., 45, 511--516.Google ScholarGoogle ScholarCross RefCross Ref
  41. Litovsky, R. Y. 1997. Developmental Changes in the Precedence Effect: Estimates of Minimum Audible Angle. Journal of the Acoustical Soc. of America, 1997, 1739--1745.Google ScholarGoogle ScholarCross RefCross Ref
  42. Litovsky, R. Y., Johnstone, P. M., Godar, S., Agrawal, S., Parkinson, A., Peters, R. & Lake, J. 2006. Bilateral Cochlear Implants in Children: Localization Acuity Measured with Minimum Audible Angle. Ear Hear,27,43--59.Google ScholarGoogle ScholarCross RefCross Ref
  43. Lou, Y., Abrami, P. C. & D'apollonia, S. 2001. Small Group and individual Learning with Technology: A Meta-Analysis. Review of Educational Research, 71, 449--521.Google ScholarGoogle ScholarCross RefCross Ref
  44. Malone, T. W. & Lepper, M. R. 1987. Making Learning Fun: A Taxonomy of intrinsic Motivations for Learning. Aptitude Learning and instruction, 3, 223--253.Google ScholarGoogle Scholar
  45. Mayer, R. E. 2006. Ten Research-Based Principles of Multimedia Learning. In: O'neil, H. F. & Perez, R. S. (Eds.) Web-Based Learning: theory, Research, and Practice. Mahwah, New Jersey: Lawrence Erlbaum Associates, Pub.Google ScholarGoogle Scholar
  46. Mills, A. W. 1958. On the Minimum Audible Angle. Journal of the Acoustical Society of America, 30, 237--246.Google ScholarGoogle ScholarCross RefCross Ref
  47. Morrongiello, B. A. 1988. Infants' Localization of Sounds Along the Horizontal Axis: Estimates of Minimum Audible Angle. Developmental Psychology, 24, 8--13.Google ScholarGoogle ScholarCross RefCross Ref
  48. Murphy, J., Summerfield, A. Q., O'donoghue, G. M. & Moore, D. R. 2011. Spatial Hearing of Normally Hearing and Cochlear Implanted Children. International Journal of Pediatric Otorhinolaryngology, 75, 498--494.Google ScholarGoogle ScholarCross RefCross Ref
  49. Newman, C. W., Sandridge, S. A. & Wodzisz, L. M. 2008. Longitudinal Benefit From and Satisfaction with the Baha System for Patients with Acquired Unilateral Sensorineural Hearing Loss. Otology & Neurotology, 29, 1123--1131.Google ScholarGoogle ScholarCross RefCross Ref
  50. Nielsen, J. 1993. Usability Engineering, Cambridge, Ma, Academic Press, inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Noble, A. 2008. Desert Island Disks. Retro Gamer.Google ScholarGoogle Scholar
  52. Plomp, R. & Mimpen, A. M. 1979. Improving the Reliability of Testing the Speech Reception Threshold for Sentences. Audiology, 18, 43--52.Google ScholarGoogle ScholarCross RefCross Ref
  53. Priwin, C., Jonsson, R., Hultcrantz, M. & Granstrom, G. 2007. Baha in Children and Adolescents with Unilateral or Bilateral Conductive Hearing Loss: A Study of Outcome. International Journal of Pediatric Otorhinolaryngology, 2007, 134--145.Google ScholarGoogle Scholar
  54. Rollings, A. & Adams, E. 2006. Fundamentals of Game Design. Prentice Hall. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Rosas, R., Nussbaum, M., Cumsille, P., Marianov, V., Correa, M., Flores, P., Grau, V., Lagosa, F., Lopez, X., Lopez, V., Rodriguez, P. & Salinas, M. 2003. Beyond Nintendo: Design and Assessment of Educational Video Games for First and Second Grade Students. Computers & Education, 40, 71--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Saliba, I., Nader, M.-E., Fata, F. E. & Leroux, T. 2011. Bone Anchored Hearing Aid in Single Sided Deafness: Outcome in Right-Handed Patients. Auris Nasus Larynx, 38, 570--576.Google ScholarGoogle ScholarCross RefCross Ref
  57. Savorski, M. 2011. Listening Experiments for Kids {online}. Ehow. Available: Http://Www.Ehow.Com/info_10034018_Listening-Experiment-Kids.Html Accessed 27 March 2012.Google ScholarGoogle Scholar
  58. Shneiderman, B. & Plaisant, C. 2005. Designing the User interface: Strategies for Effective HCI, University of Maryland, College Park, Pearson Education, inc.Google ScholarGoogle Scholar
  59. Snik, A. F. M., Mylanus, E. A. M. & Cremers, C. W. R. J. 2002. The Bone-Anchored Hearing Aid in Patients with a Unilateral Air-Bone Gap. Otology & Neurotology, 23, 61--66.Google ScholarGoogle ScholarCross RefCross Ref
  60. Sternberg, R. J. & Preiss, D. 2005. Intelligence and Technology, Routledge.Google ScholarGoogle Scholar
  61. Sutcliffe, A. 2003. Multimedia and Virtual Reality: Designing Multisensory User interfaces, Mahwah, New Jersey, Lawrence Erlbaum Associates, Publishers. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Thompson, D. M. 2005. Understanding Audio: Getting the Most Out of Your Project or Professional Recording Studio, Boston, Ma, Berklee.Google ScholarGoogle Scholar
  63. Thorndike, E. L. & Woodworth, R. S. 1901. The influence of Improvement in one Mental Function upon the Efficiency of Other Functions. Psychology Review, 8, 247--261.Google ScholarGoogle ScholarCross RefCross Ref
  64. Tibbetts, K., Ead, B., Umansky, A., Coalson, R., Bradley L. Schlaggar, M., Phd, Jill B. Firszt, P. & Judith E. C. Lieu, M. 2011. Interregional Brain interactions in Children with Unilateral Hearing Loss. Otolaryngology - Head and Neck Surgery, 144, 602--611.Google ScholarGoogle ScholarCross RefCross Ref
  65. Totilo, S. 2008. One-on-one with Shigeru Miyamoto: From 'Wii Music' to Bowser to... Motionplus? {online}. Mtv. Available: Http://Multiplayerblog.Mtv.Com/2008/10/27/one-on-one-with-Shigeru-Miyamoto/ Accessed 29-4-12}.Google ScholarGoogle Scholar
  66. Van Deun, L., Van Wieringen, A., Scherf, F., Deggouj, N., Desloovere, C., offeciers, F. E., Van De Heyning, P. H., Dhooge, I. J. & Wouters, J. 2009. Earlier intervention Leads to Better Sound Localization in Children with Bilateral Cochlear Implants. Audiology & Neurotology, 2009, 7--17.Google ScholarGoogle Scholar
  67. Wazen, D. J. J., Spitzer, D. J. B., Ghossaini, D. S. N., Fayad, D. J. N., Niparko, D. J. K., Cox, D. K., Brackmann, D. D. E. & Soli, D. S. D. 2003. Transcranial Contralateral Cochlear Stimulation in Unilateral Deafness. Otolaryngol Head Neck Surg, 129, 248--254.Google ScholarGoogle ScholarCross RefCross Ref
  68. Wazen, J. J., Ghossaini, S. N., Spitzer, J. B. & Kuller, M. 2005. Localization By Unilateral Baha Users. Otolaryngol Head Neck Surg, 132, 928--932.Google ScholarGoogle ScholarCross RefCross Ref
  69. Wikipedia. 2012. Multimedia {online}. Available: http://en.wikipedia.org/wiki/Multimedia Accessed 09 April 2012.Google ScholarGoogle Scholar

Index Terms

  1. A design template for multisensory and multimodal games to train and test children for sound localisation acuity

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        IE '13: Proceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death
        September 2013
        243 pages
        ISBN:9781450322546
        DOI:10.1145/2513002

        Copyright © 2013 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 September 2013

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        IE '13 Paper Acceptance Rate20of51submissions,39%Overall Acceptance Rate64of148submissions,43%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader