Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Computer Music Modeling and Retrieval

International Conference on Auditory Display

CMMR 2009, ICAD 2009: Auditory Display pp 41–67Cite as

A Review of Methods and Frameworks for Sonic Interaction Design: Exploring Existing Approaches

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5954))

Abstract

This article presents a review of methods and frameworks focused on the early conceptual design of sonic interactions. The aim of the article is to provide novice and expert designers in human computer interaction an introduction to sonic interaction design, to auditory displays, and to the methods used to design the sounds and interactions. A range of the current best practices are analysed. These are discussed with regard to the key methods and concepts, by providing examples from existing work in the field. A complementary framework is presented to highlight how these methods can be used together by an auditory display designer at the early conceptual design stage. These methods are reflected upon and provides a closing discussion on the future directions of research that can be explored using these approaches.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Widmer, G., Rocchesso, D., Välimäki, V., Erkut, C., Gouyon, F., Pressnitzer, D., Penttinen, H., Polotti, P., Volpe, G.: Sound and music computing: Research trends and some key issues. Journal of New Music Research 36(3), 169–184 (2007)

    Article  Google Scholar 

  2. Melles, G.: An enlarged pragmatist inquiry paradigm for methodological pluralism in academic design research. Artifact 2(1), 3–11 (2008)

    Article  Google Scholar 

  3. Morse, J.M.: Principles of mixed methods and multimethod research design. In: Handbook of Mixed Methods in Social and Behavioral Research. Sage, Thousand Oaks (2003)

    Google Scholar 

  4. Brazil, E., Fernström, J.M.: Investigating ambient auditory information systems. In: ICAD 2007, Montreal, Canada, June 26-29, 2007, pp. 326–333 (2007)

    Google Scholar 

  5. Brewster, S.A.: Non-speech auditory output. In: The Human Computer Interaction Handbook, pp. 220–239. Lawrence Erlbaum Associates, Mahwah (2002)

    Google Scholar 

  6. Mynatt, E.: Designing with auditory icons. In: Kramer, G., Smith, S. (eds.) Second International Conference on Auditory Display (ICAD 1994), Santa Fe, New Mexico, Santa Fe Institute, pp. 109–119 (1994)

    Google Scholar 

  7. Frauenberger, C., Stockman, T., Bourguet, M.L.: A survey on common practice in designing audio in the user interface. In: Proceedings of BCS HCI 2007, British HCI Group (2007)

    Google Scholar 

  8. Hug, D.: Towards a heremeneutics and typology of sound for interactive commodities. In: CHI’08 Workshop on Sonic Interaction Design: Sound, Information, and Experience, pp. 11–16 (2008)

    Google Scholar 

  9. Blauert, J., Jekosch, U.: Sound-quality evaluaiton: A multi-layered problem. Acta Acustica 83, 747–753 (1997)

    Google Scholar 

  10. Jekosch, U.: Assigning Meaning to Sounds - Semiotics in the Context of Product-Sound Design. In: Communication Acoustics, pp. 193–219. Springer, Berlin (2005)

    Chapter  Google Scholar 

  11. Blauert, J.: Cognitive and aesthetic aspects of noise engineering. In: Proc. of Internoise 1996, Cambridge, USA (1996)

    Google Scholar 

  12. Cain, J.: Experience-based design: Towards a science of artful business innovation. Design Management Journal, 10–14 (Fall 1998)

    Google Scholar 

  13. Sanders, E.B.N., Dandavate, U.: Design for experience: New tools. In: Proc. of the First International Conference on Design and Emotion, pp. 87–92. Delft University of Technology, Delft (1999)

    Google Scholar 

  14. Mäkelä, A., Suri, J.F.: Supporting users’ creativity: Design to induce pleasurable experiences. In: Proc. of the Conference on Affective Human Factors, pp. 387–391. Asean Academic Press, London (2001)

    Google Scholar 

  15. Jääskö, V., Mattelmäki, T.: Observing and probing. In: Proc. of DPPI 2003, ACM, New York (2003)

    Google Scholar 

  16. Alben, L.: Quality of experience: Defining the criteria for effective interaction design. Interactions 3(11) (May-June 1993)

    Google Scholar 

  17. Wright, P.C., McCarthy, J., Meekison, L.: Making Sense of Experience. In: Funology: From Usability to Enjoyment, pp. 43–53. Kluwer Academic Publishers, Dordrecht (2003)

    Google Scholar 

  18. Pine, B.J.I., Gilmore, J.H.: Welcome to the experience economy. Harvard Business Review 76(4), 97–105 (1998)

    Google Scholar 

  19. Overbeeke, C.J., Wensveen, S.A.G.: Reflection on pleasure: From perception to experience, from affordances to irresistibles. In: Proc. of DPPI 2003, pp. 92–97. ACM Press, New York (2003)

    Chapter  Google Scholar 

  20. Kelly, G.A.: The Psychology of Personal Constructs, Norton (1955)

    Google Scholar 

  21. Fransella, F., Bell, R., Bannister, D.: A manual for repertory grid technique. John Wiley and Sons, Chichester (2004)

    Google Scholar 

  22. Bonebright, T.: Perceptual structure of everyday sounds: A multidimensional scaling approach. In: Hiipakka, J., Zacharov, N., Takala, T. (eds.) ICAD, Helsinki, Finland, Laboratory of Acoustics and Audio Signal Processing and the Telecommunications Software and Multimedia Laboratory, pp. 73–78. Univeristy of Helsinki, Espoo (2001)

    Google Scholar 

  23. Scavone, G.P., Lakatos, S., Cook, P.R.: Knowledge acquisition by listeners in a source learning task using physical models. J. Acoustic Society of America 107(5), 2817–2818 (2000)

    Article  Google Scholar 

  24. Coleman, G.W.: The Sonic Mapping Tool. PhD thesis, University of Dundee (August 2008)

    Google Scholar 

  25. Barrass, S.: Auditory Information Design. PhD thesis, Australian National University (1997)

    Google Scholar 

  26. Tomico, O., Pifarré, M., Lloveras, J.: Needs, desires and fantasies: techniques for analyzing user interaction from a subjective experience point of view. In: Proceedings of NordiCHI 2006, pp. 4–9. ACM Press, New York (2006)

    Google Scholar 

  27. Fernström, M., Brazil, E., Bannon, L.: Hci design and interactive sonification for fingers and ears. IEEE Multimedia 12(2), 36–44 (2005)

    Article  Google Scholar 

  28. Houix, O., Lemaitre, G., Misdariis, N., Susini, P.: Closing the loop of sound evaluation and design (closed) deliverable 4.1 everyday sound classification part 2 experimental classification of everyday sounds. FP6-NEST-PATH project no: 29085 Project Deliverable 4.1 Part 2, IRCAM (June 1, 2007)

    Google Scholar 

  29. Stone, H., Sidel, J.L.: Sensory Evaluation Practices, 3rd edn. Academic Press, London (2004)

    Google Scholar 

  30. Jaeger, S.R., Rossiter, K.L., Lau, K.: Consumer perceptions of novel fruit and familiar fruit: A repertory grid application. J. of the science of food and agriculture 85, 480–488 (2005)

    Article  Google Scholar 

  31. Berg, J.: Opaque - a tool for the elicitation and grading of audio quality attributes. In: Proc. of the 118th Convention of the Audio Engineering Society, Barcelona, Spain (May 2005)

    Google Scholar 

  32. Choisel, C., Wickelmaier, F.: Extraction of auditory features and elicitation of attributes for theassessment of multichannel reproduced sound. In: Proc. of the 118th Convention of the Audio Engineering Society, Barcelona, Spain (May 2005)

    Google Scholar 

  33. Fleshman Murphy, S.M.: Transition from Diagnosis to Treatment: Changes in Cancer Patients’ Constructions of Physicians and Self during the Early Phase of Treatment. PhD thesis, Texas Tech University, Texas, USA (December 2008)

    Google Scholar 

  34. Ballas, J.A.: Common factors in the identification of an assortment of brief everyday sounds. J. of Experimental Psychology 19(2), 250–267 (1993)

    Google Scholar 

  35. McAdams, S., Winsberg, S., Donnadieu, S., Soete, G.D., Krimphoff, J.: Perceptual scaling of synthesized musical timbres: common dimensions, specificities and latent subject classes. Psychological Research 58, 177–192 (1995)

    Article  Google Scholar 

  36. Brazil, E., Fernström, M., Ottaviani, L.: A new experimental technique for gathering similarity ratings for sounds. In: ICAD 2003, pp. 238–242 (2003)

    Google Scholar 

  37. Özcan, E., Van Egmond, R.: Characterizing descriptions of product sounds. In: Proc. of ICAD 2005, Limerick, Ireland, pp. 55–60 (2005)

    Google Scholar 

  38. Schafer, R.M.: The soundscape- Our sonic environment and the tuning of the world. Destiny Books, Rochester (1977)

    Google Scholar 

  39. Gaver, W.W.: Using and creating auditory icons. In: Kramer, G. (ed.) Auditory Display: Sonification, Audification and Auditory interfaces, pp. 417–446. Addison-Wesley Publishing Company, Reading (1994)

    Google Scholar 

  40. DeWitt, A., Bresin, R.: Sound design for affective interactive. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 523–533. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  41. Fernström, M., Brazil, E.: The shannon portal: Designing an auditory display for casual users in a public environment. In: Proc. of ICAD 2009, Copenhagen, Denmark (2009)

    Google Scholar 

  42. Bly, S.: Multivariate data analysis. In: Auditory Display: Sonification, Audification and Auditory interfaces, pp. 405–416. Addison-Wesley Publishing Company, Reading (1994)

    Google Scholar 

  43. Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction (Bradford Books). The MIT Press, Cambridge (2004)

    Google Scholar 

  44. Fujita, M.: On activating human communications with pet-type robot aibo. Proc. of the IEEE 92(11), 1804–1813 (2004)

    Article  Google Scholar 

  45. Turkle, S., Taggart, W., Kidd, C.D., Dasté, O.: Relational artifacts with children and elders: the complexities of cybercompanionship. Connection Science 18(4), 347–361 (2006)

    Article  Google Scholar 

  46. Reeves, B., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, Cambridge (1996)

    Google Scholar 

  47. Okunu, H.G., Nakadai, K., Kitano, H.: Realizing personality in audio-visually triggered non-verbal behaviors. In: Proc. of IEEE 2003 International Conference on Robotics and Automation, Taipei, Taiwan, September 14-19, 2003, pp. 392–397 (2003)

    Google Scholar 

  48. Kiesler, D.J.: The 1982 interpersonal circle: A taxonomy for complementarity in human transactions. Psychological Review 90(3), 185–214 (1983)

    Article  Google Scholar 

  49. Russell, J.A., Weiss, A., Mendelsohn, G.A.: Affect grid: A single-item scale of pleasure and arousal. J. of Personality and Social Psychology 57(3), 493–502 (1989)

    Article  Google Scholar 

  50. Barrass, S.: Clothing the homunculus. Visual Communication 7(3), 317–329 (2008)

    Article  Google Scholar 

  51. Pellarin, L., Böttcher, N., Olsen, J.M., Gregersen, O., Serafin, S., Guglielmi, M.: Connecting strangers at a train station. In: Proc. of the 2005 conference on New Interfaces For Musical Expression (NIME), pp. 152–155 (2005)

    Google Scholar 

  52. Franinovic, K., Visell, Y.: Recycled soundscapes. In: Proc. of Designing interactive systems: processes, practices, methods, and techniques (DIS), pp. 317–317 (2004)

    Google Scholar 

  53. Rocchesso, D., Bresin, R.: Emerging sounds for disappearing computers. In: Streitz, N.A., Kameas, A.D., Mavrommati, I. (eds.) The Disappearing Computer. LNCS, vol. 4500, pp. 233–254. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  54. Visell, Y., Franinovic, K., Scott, J.: Closing the loop of sound evaluation and design (closed) deliverable 3.2 experimental sonic objects: Concepts, development, and prototypes. FP6-NEST-PATH project no: 29085 Project Deliverable 3.2, HGKZ, Zurich (2008)

    Google Scholar 

  55. Rocchesso, D., Polotti, P.: Designing continuous multisensory interaction. In: Sonic Interaction Design: a Conf. Human Factors in Computing Systems (CHI) Workshop. COST Action IC061, April 2008, pp. 3–9 (2008)

    Google Scholar 

  56. Lemaitre, G., Houix, O., Visell, Y., Franinovic, K., Misdariis, N., Susini, P.: Toward the design and evaluation of continuous sound in tangible interfaces: The spinotron. International Journal of Human-Computer Studies 67, 976–993 (2009)

    Article  Google Scholar 

  57. Diaper, D.: Understanding task analysis for human-computer interaction. In: Diaper, D., Stanton, N.A. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 5–47. Lawrence Erlbaum Associates, Mahwah (2003)

    Google Scholar 

  58. Back, M., Des, D.: Micro-narratives in sound design: Context, character, and caricature in waveform manipulation. In: International Conference on Auditory Display ICAD 1996 (1996)

    Google Scholar 

  59. Hug, D.: Using a systematic design process to investigate narrative sound design strategies for interactive commodities. In: ICAD 2009, Copenhagen, Denmark, pp. 19–26 (2009)

    Google Scholar 

  60. Barrass, S.: A comprehensive framework for auditory display: Comments on barrass icad 1994. ACM Trans. On Applied Perception 2(4), 403–406 (2005)

    Article  Google Scholar 

  61. Adcock, M., Barrass, S.: Cultivating design patterns for auditory displays. In: Proc. of ICAD 2004, Sydney, Australia, July 6-9 (2004)

    Google Scholar 

  62. Frauenberger, C., Stockman, T.: Auditory display design—an investigation of a design pattern approach. International Journal of Human-Computer Studies 67(11), 907–922 (2009)

    Article  Google Scholar 

  63. Halpin, H., Robu, V., Shepherd, H.: The complex dynamics of collaborative tagging. In: Proc. of the 16th International Conference on World Wide Web (WWW 2007), pp. 211–220 (2007)

    Google Scholar 

  64. Brazil, E., Fernström, M.: Empirically based auditory display design. In: Sound and Music Computing Conference (SMC 2009), Porto, Portugal, pp. 7–12 (2009)

    Google Scholar 

  65. Papp, A.L.: Presentation of Dynamically Overlapping Auditory Messages in User Interfaces. Phd thesis, University of California (1997)

    Google Scholar 

  66. McGookin, D.: Understanding and Improving the Identification of Concurrently Presented Earcons. PhD thesis, University of Glasgow (2004)

    Google Scholar 

  67. Bonebright, T.L., Miner, N.E., Goldsmith, T.E., Caudell, T.P.: Data collection and analysis techniques for evaluating the perceptual qualities of auditory stimuli. ACM Transactions on Applied Perceptions 2(4), 505–516 (2005)

    Article  Google Scholar 

  68. Vanderveer, N.J.: Ecological Acoustics- Human Perception of Environmental Sounds. Phd, University of Cornell (1979)

    Google Scholar 

  69. Jensen, J.J., Skov, M.B.: A review of research methods in children’s technology design. In: Proc. of IDC 2005, Boulder, Colorado, USA, June 8-10 2005, pp. 80–87 (2005)

    Google Scholar 

  70. Hall, T.: Disappearing technology, emerging interactivity: a study of the design of novel computing to enhance children’s learning experience in museums. PhD thesis, Department of Computer Science and Information Systems, University of Limerick (November 2004)

    Google Scholar 

  71. Sinclair, J., Hingston, P., Masek, M.: Considerations for the design of exergames. In: GRAPHITE 2007: Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia, Perth, Australia, pp. 289–295. ACM Press, New York (2007)

    Chapter  Google Scholar 

  72. Lopez, M.J., Pauletto, S.: The design of an audio film for the visually impaired. In: Proc. of ICAD 2009, Copenhagen, Denmark (2009)

    Google Scholar 

  73. Barrass, S.: Haptic and Audio Interaction Design (chapter Haptic-Audio Narrative: from Physical Simulation to Imaginative Stimulation). In: McGookin, D., Brewster, S. (eds.) HAID 2006. LNCS, vol. 4129, pp. 157–165. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  74. Hug, D.: Genie in a bottle: Object-sound reconfigurations for interactive commodities. In: Proc. of Audio Mostly Conference, Pitea, Sweden, pp. 56–63 (2008)

    Google Scholar 

  75. Chion, M.: Audio-Vision: Sound on Screen, 1st edn. Columbia University Press (1994)

    Google Scholar 

  76. Richard, F., Roussaire, V.: Sound design of the passenger compartment - process ad tool for the control of engine sound character. In: Proc. of “Les journées du design sonore (IRCAM, SFA)”, Centre Georges Pompidou, Paris, October 13–15 (2004)

    Google Scholar 

  77. Le Nindre, B.: Brand sound identity: the case of sporty vehicles. In: Proc. of Les journées du design sonore (IRCAM, SFA)”, Centre Georges Pompidou, Paris, October 13–15 (2004)

    Google Scholar 

  78. Tourila, H., Monteleone, E.: Sensory food science in the changing society: opportunities, needs, and challengers. In: Trends in Food Science and Technology (2008) (article in Press, Corrected Proof)

    Google Scholar 

  79. Moskowitz, H.R., Gofman, A.: Selling Blue Elephants: How to make great products that people want before they even know they want them. Wharton School Publishing, Upper Saddle River (2007)

    Google Scholar 

  80. Moskowitz, H.R., Hartmann, J.: Consumer research: creating a solid base for innovative strategies. Trends in Food Science and Technology 19, 581–589 (2008)

    Article  Google Scholar 

  81. Wensveen, S.A.G., Overbeeke, K., Djajadiningrat, T.: Push me, shove me and i show you how you fell: recognising mood from emotionally rich interaction. In: Proc. of DIS 2002, pp. 335–340. ACM Press, London (2002)

    Google Scholar 

  82. Hassenzahl, M., Wessler, R.: Capturing design space from a user perspective: the repertory grid revisited. International Journal of Human-Computer Interaction 12(3,4), 441–459 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & Information Systems, University of Limerick, Limerick, Ireland

    Eoin Brazil

Authors
  1. Eoin Brazil
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. CNRS - LMA, 31 Chemin Joseph Aiguier, CNRS-LMA, 31 Chemin Joseph Aiguier, 13402, Marseille Cedex 20, France

    Sølvi Ystad

  2. Université Aix-Marseille, 38 bd. Charles Livon, Marseille, France

    Mitsuko Aramaki

  3. CNRS-LMA, 31, Chemin Joseph Aiguier, 13402, Marseille Cedex 20, France

    Richard Kronland-Martinet

  4. Aalborg University Esbjerg, Niels Bohr Vej 8, 6700, Esbjerg, Denmark

    Kristoffer Jensen

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brazil, E. (2010). A Review of Methods and Frameworks for Sonic Interaction Design: Exploring Existing Approaches. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds) Auditory Display. CMMR ICAD 2009 2009. Lecture Notes in Computer Science, vol 5954. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12439-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12439-6_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12438-9

  • Online ISBN: 978-3-642-12439-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation