Skip to main content
SpringerLink
Log in

Awareness Information with Speech and Sound

  • Chapter
  • First Online:
Awareness Systems

Part of the book series: Human-Computer Interaction Series ((HCIS))

In modern work environments, people have many tasks, collaborate with other people and use various equipment and services. Staying aware of other people, processes and situations in work environments is important. We naturally use our hearing to maintain this awareness; hearing other people talk let us know they are present, sounds of people walking, typing, etc. help us stay aware of overall situation almost without conscious effort. Such awareness can also be supported by technology; information can be presented with varying levels of subtlety ranging from loud warning signals to subtle cues, such as the sound of a hard drive indicating activity in a computer. Creating a computer system that supports our awareness of coworkers and overall situation in the workplace can increase our productivity and make the workplace a more social and enjoyable place.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alty J and Rigas D (1998) Communicating Graphical Information to Blind Users Using Music: The Role of Context. Proceedings of CHI ’98: Human Factors in Computing Systems, ACM Press, 574–581

    Google Scholar 

  • Baier G, Hermann T, Sahle S and Stephani U (2006) Sonified Epileptic Rhythms. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006)

    Google Scholar 

  • Bly SA, Harrison SR and Irwin S (1993) Media Spaces: Bringing People Together in a Video, Audio, and Computing Environment. Communications of the ACM 36(1):28–46

    Google Scholar 

  • Brewster SA (2002) NonSpeech Auditory Output. In: Jacko J and Sears A (eds.) The Human–Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum & AssociatesE, Mahwah, NJ

    Google Scholar 

  • Brush AJ (2005) Terminology and Evaluation: Two Challenges for Awareness Systems Research. Position paper for CHI 2005 Workshop on Awareness Systems: Known Results, Theory, Concepts and Future Challenges

    Google Scholar 

  • Butz A and Jung R (2005) Seamless User Notification in Ambient Soundscapes, Proceedings of the International Conference on Intelligent User Interfaces (IUI2005)

    Google Scholar 

  • Chalmers M and Galani A (2004) Seamful Interweaving: Heterogeneity in the Theory and Design of Interactive Systems. Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques

    Google Scholar 

  • Chapanis A (1975) Interactive Human Communication. Scientific American, 232:36–42

    Article  Google Scholar 

  • Dix A, Finlay J, Abowd G and Beale R (2004) Human–Computer Interaction, 3rd edn. Pearson Education, Upper Saddle River, NJ

    Google Scholar 

  • Dourish P and Bellotti V (1992) Awareness and Coordination in Shared Workspaces. Proceedings of the ACM CSCW Conference on Computer-Supported Cooperative Work, 107–114

    Google Scholar 

  • Endsley M (1995) Measurement of Situation Awareness in Dynamic Systems. Human Factors 37(1):65–84

    Google Scholar 

  • Eno B (1996) Generative Music. A Talk Delivered at the Imagination Conference, San Francisco, 8 June 1996. Published in: In Motion Magazine, 7 July 1996

    Google Scholar 

  • Erman LD, Hayes-Roth F, Lesser VR and Reddy DR (1980) The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty. ACM Computing Surveys (CSUR), 12(2):213–253

    Article  Google Scholar 

  • Gaver WW (1991) Sound Support for Collaboration. Proceedings of the Second European Conference on Computer-Supported Collaborative Work, 293–324

    Google Scholar 

  • Gaver WW (1993) Synthesizing Auditory Icons. In: Ashlund S, Mullet K, Henderson A, Hollnagel E, White T (eds.) Proceedings of the ACM CHI 93 Human Factors in Computing Systems Conference. Amsterdam, The Netherlands, 228–235

    Chapter  Google Scholar 

  • Gaver WW, Smith RB and O’Shea T (1991) Effective Sounds in Complex Systems: The ARKola Simulation. Proceedings of CHI ’91

    Google Scholar 

  • Grigg C (2003) Preview: Interactive XMF – A Standardized Interchange File Format for Advanced Interactive Audio Content. 115th Audio Engineering Society Convention

    Google Scholar 

  • Gong L and Lai J (2003) To Mix or Not to Mix Synthetic Speech and Human Speech? Contrasting Impact on Judge-Rated Task Performance Versus Self-Rated Performance and Attitudinal Responses. International Journal of Speech Technology, 6(2):123–131

    Article  Google Scholar 

  • Hartikainen M, Salonen E-P and Turunen M (2004) Subjective Evaluation of Spoken Dialogue Systems Using SERVQUAL Method. Proceedings of ICSLP 2004, 2273–2276

    Google Scholar 

  • Hermann T (2002) Sonification for Exploratory Data Analysis. Ph.D. Thesis, Bielefeld University

    Google Scholar 

  • Hermann T, Baier G, Stephani U and Ritter H (2006) Vocal Sonification of Pathologic EEG Features. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006)

    Google Scholar 

  • Huang X, Acero A and Hon H-W (2001) Spoken Language Processing – A Guide to Theory, Algorithm, and System Development. Prentice-Hall, Upper Saddle River, NJ

    Google Scholar 

  • Jung R and Butz A (2005) Effectiveness of User Notification in Ambient Soundscapes. Proceedings of the workshop on Auditory Displays for Mobile Context-Aware Systems at Pervasive 2005

    Google Scholar 

  • Kainulainen A, Turunen M, Hakulinen J, Salonen E-P, Prusi P and Helin L (2005) A Speech-Based and Auditory Ubiquitous Office Environment. Proceedings of 10th International Conference on Speech and Computer (SPECOM 2005), 231–234

    Google Scholar 

  • Kainulainen A, Turunen M and Hakulinen J (2006) An Architecture for Presenting Auditory Awareness Information in Pervasive Computing Environments. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006), 121–128

    Google Scholar 

  • Kainulainen A, Turunen M and Hakulinen J (2007) Soundmarks in Spoken Route Guidance. Proceedings of the 13th International Conference of Auditory Display (ICAD 2007)

    Google Scholar 

  • Kamm C (1994) User Interfaces for Voice Applications. In: Roe D and Wilpon J (eds.) Voice Communication Between Humans and Machines. National Academy Press, Washington, DC, 422–442

    Google Scholar 

  • Kilander F and Lönnqvist P (2002) A Whisper in the Woods. Proceedings of the Eight International Conference on Auditory Display (ICAD 2002)

    Google Scholar 

  • Kramer G, Walker B, Bonebright T, Cook P, Flowers J, Miner N; Neuhoff J, Bargar R, Barrass S, Berger J, Evreinov G, Fitch W, Gröhn M, Handel S, Kaper H, Levkowitz H, Lodha S, Shinn-Cunningham B, Simoni M and Tipei S (1999) The Sonification Report: Status of the Field and Research Agenda. Report Prepared for the National Science Foundation by Members of the International Community for Auditory Display. http://www.icad.org/node/400 Accessed 19 December 2007

  • Kraut R, Egido C and Galegher J (1988) Patterns of Contact and Communication in Scientific Research Collaboration. Proceedings of the 1988 ACM conference on Computer-Supported Cooperative Work, CSCW ’88

    Google Scholar 

  • Land MZ and MacConnell PN (1994) Method and Apparatus for Dynamically Composing Music and Sound Effects Using a Computer Entertainment System. U.S. Patent 5,315,057, 24 May 1994

    Google Scholar 

  • Mäkelä K, Hakulinen J and Turunen M (2003) The Use of Walking Sounds in Supporting Awareness. Proceedings of ICAD 2003, 144–147

    Google Scholar 

  • Matthews T, Rattenbury T, Carter S, Dey A and Mankoff J (2003) A Peripheral Display Toolkit. Intel Research Berkeley, Technical Report IRB-TR-03-018

    Google Scholar 

  • Mauney BS and Walker BN (2004) Creating Functional and Livable Soundscapes for Peripheral Monitoring of Dynamic Data. Proceedings of the Tenth International Conference on Auditory Display ICAD2004

    Google Scholar 

  • Microsoft Corporation (1998) Composing Music for Interactive Titles: An Overview of DirectMusic Producer. http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dnmusic/html/ interact.asp Accessed 3 June 2005

  • Mugglin S (2005) Music Theory for Songwriters. http://members.aol.com/chordmaps/ Accessed 3 June 2005

  • Mynatt ED (1994) Designing with Auditory Icons: How Well Do We Identify Auditory Cues? Proceedings of CHI’94

    Google Scholar 

  • Mynatt ED, Back M, Want R, Bear M and Ellis JB (1998) Designing Audio Aura. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

    Google Scholar 

  • Oviatt S, Coulston R and Lunsford R (2004) When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns. Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI 2004)

    Google Scholar 

  • Potard G (2006) Guernica 2006: Sonification of 2000 Years of War and World Population Data. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006)

    Google Scholar 

  • Prusi P, Kainulainen A, Hakulinen J, Turunen M, Salonen E-P and Helin L (2005) Towards Generic Spatial Object Model and Route Guidance Grammar for Speech-Based Systems. Interspeech 2005

    Google Scholar 

  • Rossing T, Moore F and Wheeler P (2002) The Science of Sound, 3rd edn. Addison Wesley, Reading, MA

    Google Scholar 

  • Salonen E-P, Turunen M, Hakulinen J, Helin L, Prusi P and Kainulainen A (2005) Distributed Dialogue Management for Smart Terminal Devices. Proceedings of Interspeech 2005, 849–852

    Google Scholar 

  • Sawhney N and Schmandt C (1999) Nomadic Radio: Scaleable and Contextual Notification for Wearable Audio Messaging. Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference, 96–103

    Google Scholar 

  • Schafer RM (1977) The Soundscape – Our Sonic Environment and the Tuning of the World. Destiny Books, Vermont, USA

    Google Scholar 

  • Schröder M (2001) Emotional Speech Synthesis: A Review. Proceedings of the 7th European Conference on Speech Communication and Technology, Eurospeech 2001

    Google Scholar 

  • Stifelman LJ (1994) The Cocktail Party Effect in Auditory Interfaces: A Study of Simultaneous Presentation. MIT Media Laboratory Technical Report

    Google Scholar 

  • Taylor P and Isard A (1997) SSML: A Speech Synthesis Markup Language. Speech Communications, 21(1–2):123–133

    Article  Google Scholar 

  • Temperley D (1997) An Algorithm for Harmonic Analysis. Music Perception, 15(1):31–68

    MathSciNet  Google Scholar 

  • Tran QT and Mynatt ED (2000) Music Monitor: Ambient Musical Data for the Home. Proceedings of the IFIP WG 9.3 International Conference on Home Oriented Informatics and Telematics (HOIT 2000), 173:85–92

    Google Scholar 

  • Turunen M, Hakulinen J, Räihä K-J, Salonen E-P, Kainulainen A and Prusi P (2005) An Architecture and Applications for Speech-Based Accessibility Systems. IBM Systems Journal, Special Issue on Accessibility, 44(3)

    Google Scholar 

  • Turunen M, Hurtig T, Hakulinen J, Virtanen A and Koskinen S (2006) Mobile Speech-based and Multimodal Public Transport Information Services. Proceedings of MobileHCI 2006 Workshop on Speech in Mobile and Pervasive Environments

    Google Scholar 

  • Turune M, Hakulinen J, Kainulaine A, Melto A and Hurtig T (2007) Design of a Rich Multimodal Interface for Mobile Spoken Route Guidance. Proceedings of Interspeech 2007 – Eurospeech, 2193–2196

    Google Scholar 

  • Vickers P and Hogg B (2006) Sonification Abstraite/Sonification Concrète: An ’Æsthetic Perspective Space’ for Classifying Auditory Displays in the Ars Musica Domain. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006)

    Google Scholar 

  • Walker BN, Nance A and Lindsay J (2006) Spearcons: Speech-Based Earcons Improve Navigation Performance in Auditory Menus. Proceedings of the 12th International Conference on Auditory Display (ICAD 2006)

    Google Scholar 

  • Wang G and Cook PR (2003) ChucK: A Concurrent, on-the-fly Audio Programming Language. Proceedings of the International Computer Music Conference (ICMC):219–226

    Google Scholar 

  • Weiser M and Brown JS (1997) The coming age of calm technology. In: Denning PJ and Metcalfe RM (eds.) Beyond Calculation: The next fifty years of computing, Springer-Verlag, New York Inc.

    Google Scholar 

  • Whitmore G (2003) Design with Music in Mind: A Guide to Adaptive Audio for Game Designers. Gamasutra.com, 29 May 2003. http://www.gamasutra.com/resource_guide/ 20030528/whitmore_pfv.htm Accessed 19 December 2007

  • Wisneski G, Ishii H, Dahley A, Gorbet M, Brave S, Ullmer B and Yarin P (1998) Ambient Displays: Turning Architectural Space into an Interface Between People and Digital Information. Proceedings of the First International Workshop on Cooperative Buildings (CoBuild ’98)

    Google Scholar 

  • You Y (2000) A Survey for the Study of Awareness in Co-Operative Systems. Proceedings of IRIS 23, Laboratorium for Interaction Technology, University of Trollhättan Uddevalla, Sweden

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Speech-based and Pervasive Interaction Group, TAUCHI, Department of Computer Sciences, University of Tampere, FIN-33014, Tampere, Finland

    Anssi Kainulainen, Markku Turunen & Jaakko Hakulinen

Authors
  1. Anssi Kainulainen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Markku Turunen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jaakko Hakulinen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anssi Kainulainen .

Editor information

Editors and Affiliations

    Rights and permissions

    Reprints and permissions

    Copyright information

    © 2009 Springer-Verlag London Limited

    About this chapter

    Cite this chapter

    Kainulainen, A., Turunen, M., Hakulinen, J. (2009). Awareness Information with Speech and Sound. In: Markopoulos, P., De Ruyter, B., Mackay, W. (eds) Awareness Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-477-5_10

    Download citation

    • DOI: https://doi.org/10.1007/978-1-84882-477-5_10

    • Published:

    • Publisher Name: Springer, London

    • Print ISBN: 978-1-84882-476-8

    • Online ISBN: 978-1-84882-477-5

    • eBook Packages: Computer ScienceComputer Science (R0)

    Publish with us

    Policies and ethics

    Search

    Navigation