Skip to main content
SpringerLink
Log in

Design Patterns for Auditory Displays

  • Conference paper
Book cover People and Computers XIX — The Bigger Picture

Abstract

This paper proposes the use of patterns in the design process for auditory displays and /or interfaces realized in other modalities. We introduce a meta-domain in which user interfaces can be designed using these patterns without determining their means of realization. The mode-independent description of such interfaces can then be used to create the real interface maintaining the strengths of the different interaction channels. While this work is focused on how this approach can be applied on auditory displays, we keep in mind that the approach shall be applicable on other interaction modalities equally. The development of a set of mode independent interaction patterns is shown along with descriptions of their representations in the auditory domain. A real world application was chosen to evaluate the approach; Microsoft Explorer was analysed, described through the mode independent interaction patterns

The meta domain as common ground for different representations of user interface.

and transformed into the auditory domain making extensive use of 3D audio rendering techniques. The result, a file manager created in a virtual audio environment, was evaluated with sighted persons as well as visually impaired and blind participants showing the feasibility and usability of the approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adcock, M. & Barrass, S. [2004], Cultivating Design Patterns for Auditory Displays, in S. Barrass & P. Vickers (eds.), Proceedings of the International Conference on Auditory Display (ICAD’04), International Community for Auditory Displays. Proceedings will be online via http://www.icad.org/.

    Google Scholar 

  • Bamford, J. S. [1995], An Analysis of Ambisonic Sound Systems of First and Second Order, Master’s thesis, University of Waterloo. http://audiolab.uwaterloo.ca/~jeffb/thesis/ thesis.html.

    Google Scholar 

  • Barrass, S. [2003], Sonification Design Patterns, in E. Brazil & B. Shinn-Cunningham (eds.), Proceedings of the International Conference on Auditory Display (ICAD’03), Boston University Publications for International Community for Auditory Displays, pp. 170–5. http://www.icad.org/websiteV2.0/Conferences/ICAD2003/paper/42 Barrass.pdf.

    Google Scholar 

  • Blattner, M. M., Sumikawa, D. A. & Greenberg, R. M. [1989], Earcons and Icons: Their Structure and Common Design Principles, Human-Computer Interaction 4(1), 11–44.

    Article  Google Scholar 

  • Brewster, S. A. [1994], Providing a Structured Method for Integrating Non-speech Audio into Human-Computer Interfaces, PhD thesis, University of York, England, UK.

    Google Scholar 

  • Edwards, W. K., Mynatt, E. D. & Rodriguez, T. [1993], The Mercator Project: A Nonvisual Interface to the X Window System, The X Resource 7 (summer).

    Google Scholar 

  • Frauenberger, C., Höldrich, R. & de Campo, A. [2004a], A Generic, Semantically Based Design Approach for Spatial Auditory Computer Displays, in S. Barrass & P. Vickers (eds.), Proceedings of the International Conference on Auditory Display (ICAD’ 04), International Community for Auditory Displays. Proceedings will be online via http://www.icad.org/.

    Google Scholar 

  • Frauenberger, C., Putz, V. & Höldrich, R. [2004b], Spatial Auditory Displays — A Study on the Use of Virtual Audio Environments as Interfaces for Users with Visual Disabilities, in G. Evangelista (ed.), Proceedings of the Seventh International Conference on Digital Audio Effects (DAFx04), Universita degli Studi di Napoli Federico II, pp.384–9.

    Google Scholar 

  • Gröhn, M., Lokki, T. & Takala, T. [2003], Comparison of Auditory, Visual and Audio-Visual Navigation in a 3D Space, in E. Brazil & B. Shinn-Cunningham (eds.), Proceedings of the International Conference on Auditory Display (ICAD’ 03), Boston University Publications for International Community for Auditory Displays, pp.200–3. http://www.icad.org/websiteV2.0/Conferences/ICAD2003/paper/49 Grohn.pdf.

    Google Scholar 

  • Kaltenbrunner, M. [2002], Y-Windows: Proposal for a Standard AUI Environment, in R. Nakatsy & H. Kawahara (eds.), Proceedings of the International Conference on Auditory Display (ICAD’02), Advanced Telecommunications Research Institute (ATR) for International Community for Auditory Displays, pp. 154–8. http://www.icad.org/websiteV2.0/Conferences/ICAD2002/proceedings/74_Kaltenbrunner.pdf.

    Google Scholar 

  • Kobayashi, M. & Schmandt, C. [1997], Dynamic SoundScape: Mapping Time to Space for Audio Browsing, in S. Pemberton (ed.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97), ACM Press, pp. 194–201.

    Google Scholar 

  • Kramer, G. (ed.) [1994], Auditory Display: Sonification, Audification, and Auditory Interfaces, Vol. 18 of Santa Fe Institute Studies in the Sciences of Complexity, Addison-Wesley.

    Google Scholar 

  • Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J., Miner, N. & Neuhoff, J. [2005], Sonification Report: Status of the Field and Research Agenda, http://www.icad.org/ websiteV2.0/References/nsf.html.

    Google Scholar 

  • Lokki, T. [2002], Creating Interactive Virtual Auditory Environments, IEEE Computer Graphics and Applications, special issue “Virtual Worlds, Real Sounds 22(4), 49–57. Electronic publication http://www.computer.org/cga/.

    Google Scholar 

  • McGookin, D. K. & Brewster, S. [2003], An Investigation into the Identification of Concurrently Presented Earcons, in E. Brazil & B. Shinn-Cunningham (eds.), Proceedings of the International Conference on Auditory Display (ICAD’03), Boston University Publications for International Community for Auditory Displays, pp.42–6. http://www.icad.org/websiteV2.0/Conferences/ICAD2003/paper/10 McGookin.pdf.

    Google Scholar 

  • Mynatt, E. [1995], Transforming Graphical Interfaces into Auditory Interfaces, PhD thesis, Georgia Institute of Technology.

    Google Scholar 

  • Mynatt, E. D. & Edwards, W. K. [1995], Metaphors for Nonvisual Computing, in W. K. Edwards (ed.), Extraordinary Human-Computer Interaction, Cambridge University Press, pp.201–20.

    Google Scholar 

  • Nielsen, J. [1993], Usability Engineering, Academic Press.

    Google Scholar 

  • Noisternig, M., Höldrich, R., Musil, T. & Sontacchi, A. [2003a], A 3D Ambisonic based Binaural Sound Reproduction System, in Proceedings of the AES 24th International Conference: Multichannel Audio, The New Reality, Audio Engineering Society.

    Google Scholar 

  • Noisternig, M., Musil, T., Sontacchi, A. & Höldrich, R. [2003b], 3D Binaural Sound Reproduction using a Virtual Ambisonic Approach, in Proceedings of the 2003 IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems (VECIMS’03), IEEE Publications, pp. 174–8.

    Google Scholar 

  • Norman, D. A. [1988], The Psychology of Everyday Things, Basic Books.

    Google Scholar 

  • Oh, E. L. & Lufti, R. A. [1999], Informational Masking by Everyday Sounds, Journal of the Acoustical Society of America 6(106), 3521–8.

    Article  Google Scholar 

  • Pulkki, V. [1997], Virtual Sound Source Positioning Using Vector Base Amplitude Panning, Journal of the Audio Engineering Society 45(6), 456–66.

    Google Scholar 

  • Putz, V. [2004], Spatial Auditory User Interfaces, Master’s thesis, Institute of Electronic Music and Acoustics, University of Music and Dramatic Arts Graz. http://iem.at/projekte/dsp/spatial/dp_putz.

    Google Scholar 

  • Schmandt, C. [1998], Audio Hallway: A Virtual Acoustic Environment for Browsing, in M. E. Atwood, C.-M. Karat, A. Lund, J. Coutaz & J. Karat (eds.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’98), ACM Press, pp. 163–70.

    Google Scholar 

  • Strauss, M., Höldrich, R. & Sontacchi, A. [2003], A Spatial Audio Interface for Desktop Applications, in Proceedings of the AES 24th International Conference: Multichannel Audio, The New Reality, Audio Engineering Society.

    Google Scholar 

  • Traetteberg, H. [2000], Model Based Design Patterns, Unpublished position paper given at CHI’00.

    Google Scholar 

  • van Welie, M. & Trætteberg, H. [2000], Interaction Patterns in User Interfaces, in Proceedings of the Pattern Languages of Programs Conference (PLoP2000), number wucs-00-29 in “Washington University Technical Report”, Washington University. http://jerry.cs.uiuc.edu/~plop/plop2k/proceedings/Welie/Welie.pdf.

    Google Scholar 

  • Verheijen, E. [1998], Sound Reproduction by Wave Field Synthesis, PhD thesis, TU Delft.

    Google Scholar 

  • Walker, A., Brewster, S. & McGookin, S. A. [2001], Diary in the Sky: A Spatial Audio Display for a Mobile Calendar, in A. Blandford, J. Vanderdonckt & P. Gray (eds.), People and Computers XV: Interaction without Frontiers (Joint Proceedings of HCI2001 and IHM2001), Springer-Verlag, pp.531–40.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Queen Mary University of London, Mile End Road, London, El 4NS, UK

    C Frauenberger & T Stockman

  2. Signal Processing and Speech Communication Laboratory, Graz University of Technology, Inffeldgasse 12, A-8010, Graz, Austria

    C Frauenberger

  3. Institute of Electronic Music and Acoustics, University of Music and Dramatic Arts Graz, Inffeldgasse 10/3, A-8010, Graz, Austria

    C Frauenberger, V Putz & R Höldrich

Authors
  1. C Frauenberger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. T Stockman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V Putz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. R Höldrich
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computing, Napier University, Edinburgh, UK

    Tom McEwan MSc, PgCert, MBCS, CITP, Ceng, ILTM (SEDA-accredited teacher in HE) & David Benyon BSc, MSc, PhD (SEDA-accredited teacher in HE) & 

  2. Department of Information Technology/HCI, Uppsala University, Uppsala, Sweden

    Jan Gulliksen MSc, PhD

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag London Limited

About this paper

Cite this paper

Frauenberger, C., Stockman, T., Putz, V., Höldrich, R. (2006). Design Patterns for Auditory Displays. In: McEwan, T., Gulliksen, J., Benyon, D. (eds) People and Computers XIX — The Bigger Picture. Springer, London. https://doi.org/10.1007/1-84628-249-7_30

Download citation

  • DOI: https://doi.org/10.1007/1-84628-249-7_30

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84628-192-1

  • Online ISBN: 978-1-84628-249-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation