Adam J. Sporka
Sri H. Kurniawan
Murni Mahmud
Pavel Slavík
ABSTRACT
This paper reports a comparison of user performance (time and accuracy) when controlling a popular arcade game of Tetris using speech recognition or non-speech (humming) input techniques. The preliminary qualitative study with seven participants shows that users were able to control the game using both methods but required more training and feedback for the humming control. The revised interface, which implemented these requirements, was positively responded by users. The quantitative test with 12 other participants shows that humming excelled in both time and accuracy, especially over longer distances and advanced difficulty levels.
- Activision, Inc. Pitfall! A video game for Atari 2600, 1982.Google Scholar
- Bilmes, J. A., Li, X., Malkin, J., Kilanski, K., Wright, R., Kirchhoff, K., Subramanya, A., Harada, S., Landay, J. A., Dowden, P., and Chizeck, H. The vocal joystick: A voicebased human-computer interface for individuals with motor impairments. In Proceedings of Human Language Technology Conference (Vancouver, Canada). 2005. Google ScholarDigital Library
- Cohen, M. H., Giangola, J. P. and Balogh, J. Voice User Interface Design. Addison-Wesley, 2004 Google ScholarDigital Library
- Dai, L., Goldman, R., Sears, A., Lozier, J., Speech-Based Cursor Control: A Study of Grid-Based Solutions, In Proceedings of The Sixth International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2004, Atlanta, USA, ACM, 2004. Google ScholarDigital Library
- Gawley, R.E. Chirality Made Simple: A 1- and 2- Dimensional Introduction to Stereochemistry. Journal of Chemical Education, 82, 7 (Jul, 2005), 1009--1012Google ScholarCross Ref
- Hämäläinen, P., Mäki-Patola, T., Pulkki, V. and Airas, M. Musical computer games played by singing. In Proceedings of The 7th International Conference on Digital Audio Effects (Naples, Italy). 2004, 367--371.Google Scholar
- Igarashi, T., and Hughes, J. F., Voice as sound: using nonverbal voice input for interactive control. In Proceedings of the 14th annual ACM symposium on User interface software and technology. ACM Press, New York, 2001, 155--156. Google ScholarDigital Library
- Karimullah, A.S., Sears, A. Speech-Based Cursor Control, In Proceedings of The Fifth International ACM SIGCAPH Conference on Assistive Technologies, ASSETS 2002, Edinburgh, UK, ACM, 2002. Google ScholarDigital Library
- Makegames.com. Glossary. (Jun, 1 2006); http://www.fastgraph.com/makegames/glossary.html.Google Scholar
- Maglio, P. P. , and Kirsh, D. Epistemic Action Increases With Skill. In Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society. Lawrence Erlbaum, Mahwah, NJ, 1996, 391--396.Google Scholar
- Noyes, J. M., Frankish, C. R. Speech recognition technology for individuals with disabilities. Augmentative & Alternative Communication 8, 4, 1992, 297--303.Google ScholarCross Ref
- Pazhitnov, A., Gerasimov, V., Pavlovsky, D. Tetris. A video game. Academy of Sciences. Moscow, Russia, 1985.Google Scholar
- Persson, M. Development of three AI techniques for 2D platform games. Ph.D. Thesis, Department of Computer Science, Karlstad University, Sweden, 2005.Google Scholar
- Rabiner, L. R. On the use of autocorrelation analysis for pitch detection. IEEE Transactions on Acoustics, Speech, and Signal Processing, ASSP-25(1):24--33, February 1977.Google ScholarCross Ref
- Shahar, E. The PAH! game. (May, 29 2006); http://www.designer.co.il/pah/.Google Scholar
- Sporka, A. J., Kurniawan, S. H., and Slavik, P. Non-speech Operated Emulation of Keyboard. In Proceedings of the Cambridge Workshop on Universal Access and Assistive Technology, CWUAAT 2006. Designing Accessible Technology. Springer-Verlag, London, 2006, 145--154.Google ScholarCross Ref
- Sporka, A. J., Kurniawan, S. H., and Slavik, P. Acoustic control of mouse pointer. Universal Access in the Information Society, 4, 3 (Mar. 2006), ISSN 237--245. Google ScholarDigital Library
- Sporka, A., Kurniawan, S.H., Slavik, P., Mahmud, M. Tonal Control of Mouse Cursor: A Usability Study with The Elderly. In Proceedings of HCI International 2005, Las Vegas, 25--27 July, 2005, CD-ROM.Google Scholar
- Sporka, A. J., Kurniawan, S. H., and Slavik, P. Whistling User Interface (U3I). 8th ERCIM International Workshop "User Interfaces For All", LCNS 3196 (Vienna, June 2004). Springer-Verlag, Berlin Heidelberg, 2004, 472--478.Google ScholarCross Ref
- Usability First. Accessibility: Types of Accessibility Aids. (Jun, 1 2006); http://www.usabilityfirst.com/accessibility/types.txl.Google Scholar
- Watts, R., Robinson, P. Controlling computers by whistling. In Proceedings of Eurographics, Cambridge, UK, 1999.Google Scholar
- Wikipedia. Turn-based strategy -- Wikipedia, The Free Encyclopedia (Jun, 1 2006); http://en.wikipedia.org/wiki/Turn-based_game.Google Scholar
Index Terms
- Non-speech input and speech recognition for real-time control of computer games
Recommendations
Speech-Input Speech-Output Communication for Dysarthric Speakers Using HMM-Based Speech Recognition and Adaptive Synthesis System
Dysarthria is a motor speech disorder that causes inability to control and coordinate one or more articulators. This makes it difficult for a dysarthric speaker to utter certain speech sound units, thereby producing poorly articulated, slurred, and ...
Automatic Speech Recognition Used for Intelligibility Assessment of Text-to-Speech Systems
Verbal and Nonverbal Features of Human-Human and Human-Machine InteractionSpeech intelligibility is the most important parameter in evaluation of speech quality. In the contribution, a new objective intelligibility assessment of general speech processing algorithms is proposed. It is based on automatic recognition methods ...
Speech disorder Malay speech recognition system
SENSIG'09/VIS'09/MATERIALS'09: Proceedings of the 2nd WSEAS International Conference on Sensors, and Signals and Visualization, Imaging and Simulation and Materials ScienceAutomatic speech recognition systems have the potential to make hard to understand speech more easily recognizable. Designing a system that recognizes impaired speech is more difficult than a system that recognizes normal speech. The Automatic Malay ...
Comments