ABSTRACT
This paper presents an ongoing work on methods for usability evaluation of audio- and haptic-based video games for learners who are blind. We report a Standard Usability Problem List which we envision to be the basis for comparison of the Usability Evaluation Methods (UEM) in this context. In addition, we present a preliminary analysis of evidence on what problems different UEMs can reveal by evaluating audio, interaction mode, interface adaptation, and feedback.
Supplemental Material
- Oana Balan, Alin Moldoveanu, and Florica Moldoveanu. 2015. Navigational audio games: an effective approach toward improving spatial contextual learning for blind people. International Journal on Disability and Human Development 14,(January 2015), 109--118. http://dx.doi.org/10.1515/ijdhd-2014-0018 Google ScholarCross Ref
- Niels Ole. Bernsen and Laila Dybkjær. 2009. Multimodal Usability, London: Springer.Google Scholar
- Sambhavi Chandrashekar, Tony Stockman, Deborah Fels, and Rachel Benedyk. 2006. Using think aloud protocol with blind users: a case for inclusive usability evaluation methods. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '06). ACM, New York, NY, USA, 251--252. http://dx.doi.org/10.1145/1168987.1169040 Google ScholarDigital Library
- Parmit K. Chilana, Jacob O. Wobbrock, and Andrew J. Ko. 2010. Understanding usability practices in complex domains. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2337--2346. http://dx.doi.org/10.1145/1753326.1753678 Google ScholarDigital Library
- Erin C. Connors, Elizabeth R. Chrastil, Jaime Sánchez, and Lotfi B. Merabet. 2014. Action video game play and transfer of navigation and spatial cognition skills in adolescents who are blind. Frontiers in Human Neuroscience 8, 133 (November 2014). http://dx.doi.org/10.3389/fnhum.2014.00133 Google ScholarCross Ref
- Penny R. Cox and Mary K. Dykes. 2001. Effective Classroom Adaptations for Students with Visual Impairments. Teaching Exceptional Children 33, 6 (2001), 68--74. http://dx.doi.org/10.1177/004005990103300609 Google ScholarCross Ref
- Ticianne Darin, Jaime Sánchez, and Rossana Andrade. 2015. Dimensions to Analyze the Design of Multimodal Video games for the Cognition of People Who Are Blind. In Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems (IHC 2015). Brazilian Computer Society, Porto Alegre, Brazil, 2--11. http:// 10.13140/RG.2.1.1749.9287Google ScholarDigital Library
- Frederico Ferreira and Sofia Cavaco. 2014. Mathematics for all: A game-based learning environment for visually impaired students. In Proceedings of IEEE Frontiers in Education Conference (FIE'14), 1--8. http://dx.doi.org/10.1109/fie.2014.7044493 Google ScholarCross Ref
- Peter Forbrig, Regina Bernhaupt, Marco Winckler, and Janet Wesson. 2011. 5th Workshop on Software and Usability Engineering Cross Pollination: Patterns, Usability and User Experience. In Proceedings of 3th IFIP TC13 Conference on Human-Computer Interaction (Interact 2011), 718719. http://dx.doi.org/ 10.1007/978--3--642--237683_131Google ScholarCross Ref
- Cleotilde Gonzalez, Brad Best, Alice F. Healy, James A. Kole, and Lyle E. Bourne. 2011. A cognitive modeling account of simultaneous learning and fatigue effects. Cognitive Systems Research 12, 1 (2011), 19--32. http://dx.doi.org/10.1016/j.cogsys.2010.06.004 Google ScholarDigital Library
- Rex Hartson, Terence S. Andre, and Robert C. Williges. 2003. Criteria For Evaluating Usability Evaluation Methods. International Journal of Human-Computer Interaction 15, 1 (2003), 145-- 181. http://dx.doi.org/10.1207/s15327590ijhc1501_13 Google ScholarCross Ref
- Dean Inman, Ken Loge, and Arron Cram. 2000. Teaching orientation and mobility skills to blind children using computer generated 3D sound environments. In Proceedings of the 6th International Conference on Auditory Display (ICAD2000), Atlanta, GA.Google Scholar
- Orly Lahav and David Mioduser. 2008. Haptic feedback support for cognitive mapping of unknown spaces by people who are blind. International Journal of Human-Computer Studies 66, 1 (2008), 23--35. http://dx.doi.org/10.1016/j.ijhcs.2007.08.001 Google ScholarDigital Library
- Orly Lahav, David W. Schloerb, Siddarth Kumar, and Mandayam A. Srinivasan. 2008. Blind Aid: A learning environment for enabling people who are blind to explore and navigate through unknown real spaces. Virtual Rehabilitation (2008), 193--197. http://dx.doi.org/10.1109/icvr.2008.4625159 Google ScholarCross Ref
- Pavel Manakhov and Vyacheslav D. Ivanov. 2016. Defining Usability Problems. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 3144--3151. http://dx.doi.org/10.1145/2851581.2892387 Google ScholarDigital Library
- Chava Muchnik, Michal Efrati, Esther Nemeth, Michal Malin, and Minka Hildesheimer. 1991. Central Auditory Skills in Blind and Sighted Subjects. Scandinavian Audiology 20, 1 (1991), 19--23. http://dx.doi.org/10.3109/01050399109070785 Google ScholarCross Ref
- Makoto Ohuchi, Yukio Iwaya, Yôiti Suzuki, and Tetsuya Munekata. 2006. A comparative study of sound localization acuity of congenital blind and sighted people. Acoustical Science and Technology 27, 5 (2006), 290--293. http://dx.doi.org/10.1250/ast.27.290 Google ScholarCross Ref
- Paul J. Pagliano. 2001. Using a multisensory environment: a practical guide for teachers, London: David Fulton.Google Scholar
- Roope Raisamo, Arto Hippula, Saija Patomaki, Eva Tuominen, Virpi Pasto, and Matias Hasu. 2006. Testing Usability of Multimodal Applications with Visually Impaired Children. IEEE MultiMedia 13, 3 (July 2006), 70--76. http://dx.doi.org/10.1109/MMUL.2006.68 Google ScholarDigital Library
- Jaime Sánchez. 2003. Software Usability for Blind Children Questionnaire (SUBC). http://dx.doi.org/10.13140/RG.2.2.36286.08003Google ScholarCross Ref
- Jaime Sánchez. 2012. Development of Navigation Skills Through Audio Haptic Videogaming in Learners Who are Blind. Procedia Computer Science 14 (2012), 102--110. http://dx.doi.org/10.1016/j.procs.2012.10.012 Google ScholarCross Ref
- Jaime Sánchez, Nelson Baloian, Tiago Hassler, and Ulrich Hoppe. 2003. Audio Battleship: blind learners collaboration through sound. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 798--799. http://dx.doi.org/10.1145/765891.765998 Google ScholarDigital Library
- Jaime Sánchez, Héctor Flores, and Mauricio Sáenz. 2008. Mobile science learning for the blind. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 3201--3206. http://dx.doi.org/10.1145/1358628.1358831 Google ScholarDigital Library
- Jaime Sánchez, Javiera Mascaró. 2011. Audiopolis, navigation through a virtual city using audio and haptic interfaces for people who are blind. In Proceedings the 15th Human-Computer Interaction International (HCII). Orlando, Florida, USA. Springer-Verlag. 362--371. http://dx.doi.org/ 10.1007/978--3--642--21663--3_39Google ScholarCross Ref
- Jaime Sánchez and Mauricio Sáenz. 2006. Three Dimensional Virtual Environments for Blind Children. Cyber Psychology & Behavior 9, 2 (2006), 200--206. http://dx.doi.org/10.1089/cpb.2006.9.200 Google ScholarCross Ref
- Jaime Sánchez, Mauricio Sáenz, Alvaro Pascual Leone, and Lotfi Merabet. 2010. Enhancing navigation skills through audio gaming. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 3991--3996. http://dx.doi.org/10.1145/1753846.1754091 Google ScholarDigital Library
- Jaime Sánchez and Angelo Tadres. 2010. Audio and haptic based virtual environments for orientation and mobility in people who are blind. In Proceedings of the 12th international ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '10). ACM, New York, NY, USA, 237--238. http://dx.doi.org/10.1145/1878803.1878849 Google ScholarDigital Library
- Jaime Sánchez, Ticianne Darin, and Rossana Andrade. 2015. Multimodal Videogames for the Cognition of People Who Are Blind: Trends and Issues. In Proceedings of the 9th International Conference on Universal Access in Human Computer Interaction. Springer International Publishing, 535--546. http:// dx.doi.org/10.1007/978--3--319--20684--4_52Google ScholarCross Ref
- Diogo Simões and Sofia Cavaco. 2014. An orientation game with 3D spatialized audio for visually impaired children. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE '14). ACM, New York, NY, USA, Article 37 , 4 pages. http://dx.doi.org/10.1145/2663806.2663868 Google ScholarDigital Library
- Javier Torrente, Ángel Serrano-Laguna del Blanco, José Vallejo-Pinto, Pablo Moreno-Ger, and Baltasar Fernández-Manjón. 2014. Towards a low cost adaptation of educational games for people with disabilities. Computer Science and Information Systems 11, 1 (2014), 369--391. http://dx.doi.org/10.2298/csis121209013t Google ScholarCross Ref
- Javier Torrente, Ángel del Blanco, Pablo MorenoGer, Iván Martínez-Ortiz, and Baltasar Fernández Manjón. 2009. Implementing accessibility in educational video games with <e-Adventure>. In Proceedings of the first ACM International Workshop on Multimedia Technologies for Distance Learning (MTDL '09). ACM, New York, NY, USA, 5766. http://dx.doi.org/10.1145/1631111.1631122 Google ScholarDigital Library
- Ann P Turnbull. Exceptional lives: Special education in today's schools. Merrill/Prentice Hall, Order Department, 200 Old Tappan Rd., Old Tappan, NJ 07675, 1995. Equal columnsGoogle Scholar
Index Terms
- Investigating the Mode in Multimodal Video Games: Usability Issues for Learners who are Blind
Recommendations
Principles for Evaluating Usability in Multimodal Games for People Who Are Blind
Universal Access in Human-Computer Interaction. Multimodality and Assistive EnvironmentsAbstractMultimodal video games designed for increasing cognition of people who are blind should be friendly and pleasant to use, instead of adding complexity to the interaction, leading people to acquire cognitive skills while interacting. There are ...
Efficiency of multimodal metaphors in e-learning platform
SEPADS'10: Proceedings of the 9th WSEAS international conference on Software engineering, parallel and distributed systemsThe primary focus of this paper is to investigate the effect of including multimodal metaphors on the usability of e-learning interfaces. This investigation involved two different interface platforms performed by forty users. The first interface ...
Multimodal user interfaces for smart environments: the multi-access service platform
AVI '08: Proceedings of the working conference on Advanced visual interfacesUser interface modeling is a well accepted approach to handle increasing user interface complexity. The approach presented in this paper utilizes user interface models at runtime to provide a basis for user interface distribution and synchronization. ...
Comments