Skip to main content
SpringerLink
Log in

Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents

  • Conference paper
  • First Online:
Social Robotics (ICSR 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14453 ))

Included in the following conference series:

  • 282 Accesses

Abstract

Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users’ emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tung, V.W.S., Au, N.: Exploring customer experiences with robotics in hospitality. Int. J. Contemp. Hosp. Manage. 30(7), 2680–2697 (2018). https://doi.org/10.1108/IJCHM-06-2017-0322

    Article  Google Scholar 

  2. Bartneck, C., Belpaeme, T., Eyssel, F., Kanda, T., Keijsers, M., Šabanović, S.: Human-Robot Interaction: An Introduction. Cambridge University Press, Cambridge (2020)

    Book  Google Scholar 

  3. Mataric, M., Scassellati, B.: Socially Assistive Robotics. In: Siciliano, B., Khatib, O., Kroger, T. (eds.) Springer Handbook of Robotics, vol. 200, pp. 1973–1988. Springer, Berlin (2008)

    Google Scholar 

  4. Walters, M.L., et al.: Evaluating the robot personality and verbal behavior of domestic robots using video-based studies. Adv. Robot. 25(18), 2233–2254 (2011)

    Article  Google Scholar 

  5. Shank, D.B., Graves, C., Gott, A., Gamez, P., Rodriguez, S.: Feeling our way to machine minds: People’s emotions when perceiving mind in artificial intelligence. Comput. Hum. Behav. 1(98), 256–266 (2019)

    Article  Google Scholar 

  6. Mathur, M.B., et al.: Uncanny but not confusing: Multisite study of perceptual category confusion in the Uncanny Valley. Comput. Hum. Behav. 1(103), 21–30 (2020)

    Article  Google Scholar 

  7. Zhou, H., Huang, M., Zhang, T., Zhu, X., Liu, B.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1 (2018)

    Google Scholar 

  8. Mindoro, J.N., Pilueta, N.U., Austria, Y.D., Lacatan, L.L., Dellosa, R.M.: Capturing students’ attention through visible behavior: a prediction utilizing YOLOv3 approach. In: 2020 11th IEEE control and system graduate research colloquium (ICSGRC), pp. 328–333. IEEE (2020)

    Google Scholar 

  9. Nepal, U., Eslamiat, H.: Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors 22(2), 464 (2022)

    Article  Google Scholar 

  10. Jiang, Y.: COTS recognition and detection based on Improved YOLO v5 model. In: 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), pp. 830–833. IEEE (2022)

    Google Scholar 

  11. Mollahosseini, A., Hasani, B., Mahoor, M.H.: AffectNet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput. 10(1), 18–31 (2017)

    Article  Google Scholar 

  12. Trabelsi, Z., Alnajjar, F., Parambil, M.M., Gochoo, M., Ali, L.: Real-time attention monitoring system for classroom: a deep learning approach for student’s behavior recognition. Big Data Cogn. Comput. 7(1), 48 (2023)

    Article  Google Scholar 

  13. Louie, W.Y., McColl, D., Nejat, G.: Acceptance and attitudes toward a human-like socially assistive robot by older adults. Assist. Technol. 26(3), 140–150 (2014)

    Article  Google Scholar 

  14. Ezer, N., Fisk, A.D., Rogers, W.A.: More than a servant: Self-reported willingness of younger and older adults to having a robot perform interactive and critical tasks in the home. Proc. Hum. Factors Ergon. Soc. Ann. Meeting 53(2), 136–140 (2009). https://doi.org/10.1177/154193120905300206

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Western Sydney University, Sydney, Australia

    Zhao Zou, Michael Lwin, Aila Khan & Omar Mubin

  2. United Arab Emirates University, Abu Dhabi, United Arab Emirates

    Fady Alnajjar & Muhammed Swavaf

  3. Swinburne University of Technology, Melbourne, Australia

    Abdullah Al Mahmud

Authors
  1. Zhao Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fady Alnajjar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Lwin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Abdullah Al Mahmud
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammed Swavaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Aila Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Omar Mubin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhao Zou .

Editor information

Editors and Affiliations

  1. Qatar University, Doha, Qatar

    Abdulaziz Al Ali

  2. Qatar University, Doha, Qatar

    John-John Cabibihan

  3. Qatar University, Doha, Qatar

    Nader Meskin

  4. University of Naples Federico II, Napoli, Italy

    Silvia Rossi

  5. Qingdao University, Qingdao, China

    Wanyue Jiang

  6. The University of Alabama, Tuscaloosa, AL, USA

    Hongsheng He

  7. National University of Singapore, Queenstown, Singapore

    Shuzhi Sam Ge

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zou, Z. et al. (2024). Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents. In: Ali, A.A., et al. Social Robotics. ICSR 2023. Lecture Notes in Computer Science(), vol 14453 . Springer, Singapore. https://doi.org/10.1007/978-981-99-8715-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8715-3_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8714-6

  • Online ISBN: 978-981-99-8715-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation