Abstract
Can the addition of sound enhance the reading experience on small screens when using Rapid Serial Visual Presentation (RSVP) for dynamic text presentation? In this paper we introduce Sonified RSVP and report findings from a usability evaluation where the experience of reading texts enhanced with nomic auditory icons was evaluated. At a comfortable pace 12 subjects read long Swedish texts of equal difficulty with and without the addition of sound on a handheld device. Reading speed (M≈217 wpm) and comprehension (M≈58% correct) did not differ significantly between the two conditions. The evaluation revealed a rather high task load for both conditions but no significant differences. However, the subjective rating of Immersion was rated significantly higher for the Sonified condition. Causes, implications and directions for further work are discussed based on these findings.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Back, M., Cohen, J., Gold, R., Harrison, S. and Minneman, S. (2001). Listen reader: an electronically augmented paper-based book. Proceedings of the SIG-CHI on Human Factors in Computing Systems 2001, 23–29, Seattle, WA, USA, ACM Press.
Björnsson, C. H. (1968). Läsbarhet, Stockholm, Liber (in Swedish).
Brewster, S., Raty V. P., and Kortekangas, A. (1996). Earcons as a method of providing navigational cues in a menu hierarchy. Proceeding of Human-Computer Interaction’96 by M. A. Sasse, R. J. Cunningham and R. L. Winder (Eds.), People and Computers.
Brewster, S. (1998). Using non speech sounds to provide navigation cues. ACM Transactions on Computer Human Interaction, 5(3), 224–259.
Bruijn, O. and Spence, R. (2000). Rapid Serial Visual Presentation: A space-time tradeoff in information presentation. In Proceedings of Advanced Visual Interfaces, AVI’2000.
Castelhano, M. S. and Muter, P. (2001). Optimizing the reading of electronic text using rapid serial visual presentation. Behaviour & Information Technology, 20(4), 237–247.
Chen, H.C. and Chan, K.T. (1990). Reading computer-displayed moving text with and without self-control over the display rate. Behaviour & Information Technology, 9, 467–477.
Duchnicky, R. L. and Kolers, P. A. (1983). Readability of text scrolled on visual display terminals as a function of window size. Human Factors, 25, 683–692.
Ericsson, T., Chincholle, D. and Goldstein, M. (2001). Both the device and the service influence WAP usability, IHM-HCI2001, Volume II, Usability in Practice by J. Vanderdonckt, A. Blandford and A. Derycke (Eds.), Short paper, 10–14 September, Lille, France, 79–85.
Forster, K. I. (1970). Visual perception of rapidly presented word sequences of varying complexity. Percep. Psychophys. 8, 215–221.
Gaver, W. (1986). Auditory icons: Using sound in computer interfaces. Human-Computer Interaction, 2, 167–177, Lawrence Erlbaum Associates, Inc.
Gaver, W. (1998). Auditory interfaces. In Handbook of Human-Computer Interaction, 2nd ed., 1003–1041.
Gilbert, L. C. (1959). Speed of processing verbal stimuli and its relation to reading. J Educ Psychol, 58, 8–14.
Goldstein, M., Anneroth, M., Sicheritz, K. and Lundberg, T. (2000). Enhancing the reading experience: Sonified on-line reading from a small PDA screen using RSVP. Fourth Swedish Symposium on Multimodal Communication, SsoMC.
Goldstein, M., Sicheritz, K. and Anneroth, M. (2001). Reading from a small display using the RSVP technique. Nordic Radio Symposium, NRS01.
Goldstein, M., Öquist, G., Bayat-M, M., Ljungstrand, P. and BjÖrk, S. (2001). Enhancing the reading experience: Using adaptive and sonified RSVP for reading on small displays. Proceedings of Workshop on Mobile Devices at IHM-HCI 2001, Lille, September 10–14.
Hart, S. G. and Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, by P. A. Hancock and N. Meshkati (Eds.). Elsevier Science Publishers, B.V. North-Holland.
Hearst, M. A. (1997). Dissonance on audio interfaces. IEEE Expert, 12, 5, 10–16, IEEE Computer Press.
Huey, E. B. (1968). The Psychology and Pedagogy of Reading. Massachusetts: MIT Press. (Originally published 1908).
Joula, J. F., Ward, N. J. and MacNamara, T. (1982). Visual search and reading of rapid serial presentations of letter strings, words and text. J. Exper. Psychol.: General, 111, 208–227.
Juola, J. F., Tiritoglu, A., and Pleunis, J. (1995). Reading text presented on a small display. Applied Ergonomics, 26, 227–229.
Just, M. A., and Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354.
Kang, T. J., and Muter, P. (1989). Reading Dynamically Displayed Text. Behaviour & Information Technology, 8(1), 33–42.
Kalyuga, S. (2000). When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology, 16(2), 161–172.
Kump, P. (1999). Break-trough rapid reading. New Jersey: Prentice-Hall Press.
Masson, M. E. J. (1983). Conceptual processing of text during skimming and rapid sequential reading. Memory & Cognition, 11(3), 262–274.
Mills, C. B. and Weldon, L. J. (1987). Reading text from computer screens. ACM Computing Surveys, 19(4), ACM Press.
Muter, P. (1996). Interface Design and Optimization of Reading of Continuous Text. In Cognitive aspects of electronic text processing. H. van Oostendorp and S. de Mul (Eds.). Norwood, N.J.:Ablex.
Muter, P., Kruk, R. S., Buttigieg, M. A., and Kang, T. J. (1988). Reader controlled computerized presentation of text. Human Factors, 30, 473–486.
Muter, P. and Maurutto, P. (1991). Reading and skimming from computer screens and books: The paperless office revisited? Behavior & Information Technology, 10, 257–266.
Najjar, L. J. (1996). Multimedia information and learning. Journal of Educational Multimedia and Hypermedia, 5, 129–150.
Norman, D. A. (1988). The Psychology of Everyday Things. Doubleday, NY, USA.
Paivio, A. (1971). Imagery and Verbal Processes. New York: Holt, Rinehart & Winston, Inc.
Paivio, A. (1986). Mental Representations. New York: Oxford University Press.
Potter, M. C. (1984). Rapid Serial Visual Presentation (RSVP): A method for studying language processing. In New Methods in Reading Comprehension Research. Kieras, D. E. and Just, M. A. (Eds.). Hillsdale, N.J.: Erlbaum.
Rahman, T. and Muter, P. (1999). Designing an interface to optimize reading with small display windows. Human Factors, 1(1), 106–117, Human Factors and Ergonomics Society.
Robeck, M. C. and Wallace, R. R. (1990). The Psychology of Reading: An Interdisciplinary Approach, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 2nd edition.
Rubin, G. S. and K. Turano. (1992). Reading without saccadic eye movements. Vision Research, 32(5), 895–902.
The Bailando prototype web page. A tool for research on small screen readability, available at: http://stp.ling.uu.se/~gustav/bailando/ (June 2002).
Tekfi, C. (1987). Readability formulas: An overview. Journal of Documentation, 43(3), 261–273.
Wickens, C. D. (1992). Engineering psychology and human performance, 2nd edition, Chapter 8, HarperCollins Publishers Inc., New York.
Williams, J. R. (1998). Guidelines for the use of multimedia in instruction. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1447–1451.
Öquist, G. (2001). Adaptive Rapid Serial Visual Presentation. Master’s Thesis, Department of Linguistics, Uppsala University, Sweden.
Öquist, G. and Goldstein, M. (2002). Towards an improved readability on mobile devices: Evaluating Adaptive Rapid Serial Visual Presentation. Proceedings of Mobile HCI’2002, 19–20 September 2002, Pisa, Italy, Springer Verlag.
Öquist, G., Björk, S. and Goldstein, M. (2002). Utilizing gaze detection to simulate the affordances of paper in the Rapid Serial Visual Presentation format. Proceedings of Mobile HCI’2002, 19–20 September 2002, Pisa, Italy, Springer Verlag.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Goldstein, M., Öquist, G., Björk, S. (2003). Evaluating Sonified Rapid Serial Visual Presentation: An Immersive Reading Experience on a Mobile Device. In: Carbonell, N., Stephanidis, C. (eds) Universal Access Theoretical Perspectives, Practice, and Experience. UI4ALL 2002. Lecture Notes in Computer Science, vol 2615. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36572-9_39
Download citation
DOI: https://doi.org/10.1007/3-540-36572-9_39
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00855-2
Online ISBN: 978-3-540-36572-3
eBook Packages: Springer Book Archive