Skip to main content

The Effects of Timbre on Voice Interaction

  • Conference paper
  • First Online:
Cross-Cultural Design (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14023))

Included in the following conference series:

Abstract

With the development of voice interaction and speech synthesis technology, the impact of different audio timbres on user experience is particularly important. This study focuses on the voice transmission of news information, taking users’ subjective emotional experience as the starting point, and conducts relevant experimental research to investigate the impact of different timbres on user experience in the process of voice interaction. This study conducted an experiment in which two types of data were collected from 30 participants each, including PAD scale data and behavioural questionnaire data to measure subjective emotional experience, and skin potential data to measure objective physiological indicators. The experimental data showed that different timbre gender and type elicited different emotions from the users. The timbre gender had a significant effect on the standard deviation of the skin conductance, i.e. the level of emotional arousal; the timbre type had a significant effect on the participants’ interest; the news type also influenced the level of interest and the users’ evaluation. Timbre gender and news category had a significant interaction effect, as did timbre type and news category, which influenced the degree of matching and user evaluation. Finally, based on the results, this paper further discusses the conclusions related to timbre gender, timbre type and news type, and gives practical suggestions for the design of speech interaction systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Martin, T.B.: Practical applications of voice input to machines. Proc. IEEE 64, 487–501 (1976)

    Article  Google Scholar 

  2. Ghorbel, M., Segarra, M.-T., Kerdreux, J., Keryell, R., Thepaut, A., Mokhtari, M.: Networking and communication in Smart Home for people with disabilities. Lecture Notes in Computer Science. 937–944 (2004)

    Google Scholar 

  3. Hildebrand, C., Efthymiou, F., Busquet, F., Hampton, W.H., Hoffman, D.L., Novak, T.P.: Voice analytics in business research: conceptual foundations, acoustic feature extraction, and applications. J. Bus. Res. 121, 364–374 (2020)

    Article  Google Scholar 

  4. Gocsál, Á.: Female listeners’ personality attributions to male speakers: the role of acoustic parameters of speech. Pollack Periodica. 4, 155–165 (2009)

    Article  Google Scholar 

  5. Norman, D.: Emotion & design. Interactions 9, 36–42 (2002)

    Article  Google Scholar 

  6. Scherer, K.R.: Personality inference from voice quality: the loud voice of extroversion. Eur. J. Soc. Psychol. 8, 467–487 (1978)

    Article  Google Scholar 

  7. Borkowska, B., Pawlowski, B.: Female voice frequency in the context of dominance and attractiveness perception. Anim. Behav. 82, 55–59 (2011)

    Article  Google Scholar 

  8. Jeong, J., Shin, D.-H.: It’s not what it speaks, but it’s how it speaks: a study into smartphone voice-user interfaces (VUI). In: Human-Computer Interaction: Interaction Technologies, pp. 284–291 (2015)

    Google Scholar 

  9. Edison Research. The Infinite Dial 2020. https://www.edisonresearch.com/the-infinite-dial-2020

  10. McHugh, S.: How podcasting is changing the audio storytelling genre. Radio J. Int. Stud. Broadcast Audio Media 14, 65–82 (2016)

    Article  Google Scholar 

  11. Pew Research Center. Audio and Podcasting Fact Sheet. https://www.journalism.org/fact-sheet/audio-and-podcasting

  12. Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. M.I.T. Press, Cambridge (1976)

    Google Scholar 

  13. Westie, F.R.: A technique for the measurement of race attitudes. Am. Sociol. Rev. 18, 73 (1953)

    Article  Google Scholar 

Download references

Acknowledgement

This study was supported by “the Fundamental Research Funds for the Central Universities”.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhe Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, R., Erleke, E., Wang, L., Huang, J., Chen, Z. (2023). The Effects of Timbre on Voice Interaction. In: Rau, PL.P. (eds) Cross-Cultural Design. HCII 2023. Lecture Notes in Computer Science, vol 14023. Springer, Cham. https://doi.org/10.1007/978-3-031-35939-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35939-2_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35938-5

  • Online ISBN: 978-3-031-35939-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics