Skip to main content
Springer Nature Link
Log in

Exploring Acoustics Perception Through XR Spatial Audio Experiences: Experiments and Data Collection for the ‘Listen To the Theatre’ Project

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15029))

Included in the following conference series:

  • 456 Accesses

Abstract

The experience of a musical performance in a concert hall transcends the acoustic dimension, engaging all senses in an integrative manner to yield a holistic perceptual outcome. Despite this integrative nature, studies focusing on the auditory aspects of performances, employing spatial audio technologies, virtual acoustics, and immersive audiovisual renderings, contribute to a deeper understanding of performance space acoustics as a form of intangible cultural heritage. XR experiences could be considered not merely a product of research but also a process that could be analyzed through tests and surveys. Testing the model can be useful not only to evaluate its Quality of Experience and the realism of the rendering, but also for accessing data about the object of study, impossible to obtain otherwise. This research examines the application of tests and surveys within the XR project Listen To The Theatre, elucidating its utility and implications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Gerzon, M.A.: Recording concert hall acoustics for posterity. J. Audio Eng. Soc. 23(7), 569–571 (1975)

    Google Scholar 

  2. Farina, A., Ayalon R.: Recording concert hall acoustics for posterity. In: 24th AES Conference on Multimedia Audio, 26–28 June, Banff, Canada (2003)

    Google Scholar 

  3. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77, 1321–1329 (1994)

    Google Scholar 

  4. Van Tonder, C., Lopez, M.: Acoustic Atlas – Auralisation in the Browser. In: Proceedings of The International Conference on Immersive and 3D Audio: from Architecture to Automotive (I3DA), 8–10 September, Bologna, Italy (2021)

    Google Scholar 

  5. Monacchi, D.: L’arca dei suoni originari. Mondadori, Milano (2019)

    Google Scholar 

  6. Rindel, J. H.: The ERATO project and its contribution to our understanding of the acoustics of ancient Greek and Roman theatres. In: The Acoustics of Ancient Theatres Conference, 18–21 September, Patras, Greece (2011)

    Google Scholar 

  7. Lombardo, V., Valle, A., Nunnari, F., et al., Archeology of Multimedia, Association for Computing Machinery. In: Proceedings of the 2006 ACM Multimedia Conference, 23 – 27 October, New York, pp. 269–278 (2006)

    Google Scholar 

  8. Katz, B. F. G., Poirier-Quinot, D., Lyzwa, J.-M.: La Vierge 2020: reconstructing a virtual concert performance through historic auralisation of notre-dame cathedral. In: Proceedings of The International Conference on Immersive and 3D Audio: from Architecture to Automotive (I3DA), 8–10 September, Bologna, Italy (2021)

    Google Scholar 

  9. Katz, B. F. G., Murphy, D., Farina, A.: The past has ears (PHE): XR explorations of acoustic spaces as cultural heritage in augmented reality. Virtual Reality, and Computer Graphics.  pp. 91–98. Springer, Berlin (2020)

    Google Scholar 

  10. Bevilacqua, A., Merli, F. and Farina, A.: 3dof representation of the acoustic measurements inside the Comunale-Pavarotti Theatre of Modena. In: Proceedings of The International Conference on Immersive and 3D Audio: from Architecture to Automotive (I3DA), 8–10 September, Bologna, Italy (2021)

    Google Scholar 

  11. Abel, J. S., Woszczyk, W., Ko, D. et al.: Recreation of the acoustics of Hagia Sophia in Stanford’s Bing Concert Hall for the concert performance and recording of Cappella Romana. In: International Symposium of Room Acoustics, 9–11 June, Toronto, Canada (2013)

    Google Scholar 

  12. Turchet, L., Hamilton, R., Çamci, A.: Music in extended realities. IEEE Access 9, 15810–15832 (2021)

    Article  Google Scholar 

  13. http://www.qualinet.eu/resources/qualinet-white-paper/, Accessed 05 Dec 2024

  14. Gozzi, A., Grazioli, G.: Listen to the theatre! exploring florentine performative spaces. In: Proceedings of 2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA), Bologna, Italy (2023)

    Google Scholar 

  15. Hawkes, R.J., Hazel, D.: Subjective acoustic experience in concert auditoria. Acustica 24, 235–250 (1971)

    Google Scholar 

  16. Barron, M.: Subjective study of British symphony concert halls. Acta Acust. Acust. 66(1), 1–14 (1988)

    Google Scholar 

  17. Kahle, E.: Validation d’un modele objectif de la qualité acoustique dans un ensemble de salles de concerts et d’operas, Ph.D. thesis, Université du Maine, Le Mans, France (1995)

    Google Scholar 

  18. Shroeder, M.R., Gottlob, D., Siebrasse, K.F.: Comparative study of European concert halls: correlation of subjective preference with geometric and acoustic parameters. J. Acoust. Soc. Am. 56(4), 1195 (1974)

    Article  Google Scholar 

  19. Wilkens, H.: Mehrdimensionale Beschreibung subjektiver Beurteilungen der Akustik von Konzertsälen. Acustica, 38(10) (1977)

    Google Scholar 

  20. Soulodre, G.A., Bradley, J.S.: Subjective evaluation of new room acoustic measures. J. Acoustical Soc. Am. 98(1), 294–301 (1995)

    Article  Google Scholar 

  21. Berg, J., Rumsey, F.: Identification of quality attributes of spatial audio by repertory grid technique. J. Audio Eng. Soc. 54(5), 365–379 (2006)

    Google Scholar 

  22. Lokki, T.: Sensory evaluation of concert hall acoustics. In: Proceedings of the 21st International Congress on Acoustics (ICA), 2–7 June, Montréal, Canada (2013)

    Google Scholar 

  23. Lokki, T., Pätynen, J., Kuusinen, A., et al.: Concert hall acoustics assessment with individually elicited attributes. J. Acoustical Soc. Am. 130(2), 835–849 (2011)

    Article  Google Scholar 

  24. Zacharov, N.: Sensory Evaluation of Sound. Taylor & Francis Group, Boca Raton (2019)

    Google Scholar 

  25. Carpentier, T.: Workshop on spatialization. In: Spatialization, Orchestration, Perception – IRCAM Forum Workshops Hors Les Murs, 5 February 5, Montréal, Canada (2021)

    Google Scholar 

  26. Shinn-Cunningham, B.G., Kopco, N., Martin, T.J.: Localizing nearby sound sources in a classroom: Binaural room impulse responses. J. Acoustical Soc. Am. 117(5), 3100–3115 (2005)

    Article  Google Scholar 

  27. Vigeant, M.C., Wang, L.M. Rindel, J. H. et al.: Multi-channel orchestral anechoic recordings for auralizations. In: Proceedings of the International Symposium on Room Acoustics (ISRA), 29 – 31 August, Melbourne, Australia (2010)

    Google Scholar 

  28. Beranek, L. L.: Music, acoustics & architecture. Robert E. Krieger Publishing Co.Inc., New York 1979. I ed. John Wiley & Sons, Inc. (1962)

    Google Scholar 

  29. Thery, D., Postma, and Katz, B. F. G.: Influence des visuels sur l’évaluation subjective d’auralisations dans un contexte de réalité virtuelle. In: 29ème conférence francophone sur l’Interaction Homme-Machine, AFIHM, 29 August-1 September, Poitiers, Francia (2017)

    Google Scholar 

  30. IEEE Recommended Practice for Speech Quality Measurements: IEEE Trans. Audio Electroacoust. 17(3), 225–246 (1969)

    Article  Google Scholar 

  31. Baume, C.: Evaluation of Acoustic Features for Music Emotion Recognition. In: 134th Convention of the Audio Engineering Society, 4–7 May, Rome, Italy (2013)

    Google Scholar 

  32. Mo, R., Wu, B., Horner, A.: The effects of reverberation on the emotional characteristics of musical instruments. Society 63(12),  966–979 (2016)

    Google Scholar 

  33. Ekman, I. and Kajastila, R.: Localisation cues affect emotional judgements– results from a user study on scary sound. In: AES 35th International Conference: Audio for Games, 11–13 February, London, United Kingdom (2009)

    Google Scholar 

  34. Chanel, G., Kronegg, J., Grandjean, D. et al.: Emotion Assessment: Arousal Evaluation Using EEG’s and Peripheral Physiological Signals, Multimedia Content Representation, Classification and Security. In: Proceedings of International Workshop MRCS 2006, Istambul, Turkey, 11–13  September (2006)

    Google Scholar 

  35. Nikhil, G., Rohit, G., Apoorv, A., et al.: Decoding the neural signatures of valence and arousal from portable EEG headset. Front. Human Neurosci.  Sec. Brain-Comput. Interfaces 16 (2022)

    Google Scholar 

  36. Tajadura-Jiménez, A., Larsson, P., Vâljamäe, A., et al.: When room size matters: acoustic influences on emotional responses to sounds. Emotion 10(3), 416–422 (2010)

    Google Scholar 

  37. O’Regan, S., Faul, S., Marnane, W.: Automatic detection of EEG artefacts arising from head movements. In: Annual International Conference of the IEEE Engineering in Medicine and Biology, 31 August-4 September, pp. 6353–6356. IEEE New York, USA (2010)

    Google Scholar 

  38. Li, T.-M., Chao, H.-C., Zhang, J.: Emotion classification based on brain wave: a survey. Human-centric Comput. Inform. Sci. 9(42) (2019)

    Google Scholar 

  39. Kweon, S. H. , Kweon, H. J., Kim, S.-J., et al.: A Brain wave research on VR (virtual reality) usage: comparison between VR and 2D Video in EEG measurement. In: Proceedings of the AHFE 2017 International Conference on Human Factors and Systems Interaction,  17−21 July, pp. 194–203. Stati Uniti d’America, Los Angeles, California (2017)

    Google Scholar 

  40. Ferdig, R.E., Kosko, K.W., Gandolfi, E.: The use of ambisonic audio to improve presence, focus, and noticing while viewing 360 video. Virtual Worlds Res. 13(2–3) (2020)

    Google Scholar 

  41. Rankin, C.H., Abrams, T., Barry, R J.: Habituation revisited: an updated and revised description of the behavioral characteristics of habituation. Neurobiol. Learn. Memory 92(2), 135–138 (2009)

    Google Scholar 

  42. Goldstone, R.L.: Perceptual learning. Annual Rev. Psychol. 49(1),  585–612 (1998)

    Google Scholar 

  43. Khan, Z. A., Adnan, J., Raz, S.A.: Cognitive learning theory and development: higher education case study  In: Ortega-Sánchez, D., Stavropoulos. K.K.M. (ed.): Education- Annual Volume 2023. IntechOpen, London, United Kingdom (2023)

    Google Scholar 

  44. Tcherkassof, A., Bollon, T., Michel, D., et al.: Facial expressions of emotions: A methodological contribution to the study of spontaneous and dynamic emotional faces. Eur. J. Soc. Psychol. 37(6), 1325–1345 (2021)

    Article  Google Scholar 

  45. Trochidis, K. Sears, D., Tran, D.-L. et al.: Psychophysiological measures of emotional response to romantic orchestral music and their musical and acoustic correlates. In: 9th International Symposium CMMR, 19–22 June, London, United Kingdom (2012)

    Google Scholar 

  46. Jacobsen, F.A., Hafli, E.W., Tronstad, C., et al.: Classification of emotions based on electrodermal activity and transfer learning - a pilot study. J. Electr. Bioimpedance 12(1), 178–183 (2021)

    Article  Google Scholar 

  47. Horvers, A. Tombeng, N. Bosse, T. et al.: Detecting emotions through electrodermal activity. in: learning contexts: a systematic review. Sensors 21(23), 7869 (2021)

    Google Scholar 

  48. Vitali Rosati, M.: On Editorialization. Structuring Space And Authority In The Digital Age. Institute Of Network Cultures, Amsterdam (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Université de Montréal, Faculté de Musique, Montréal, Canada

    Andrea Gozzi

  2. Dipartimento di Formazione, Lingue, Intercultura, Letterature e Psicologia (FORLILPSI), Università degli Studi di Firenze, Florence, Italy

    Andrea Guazzini

Authors
  1. Andrea Gozzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrea Guazzini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Gozzi .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. CNR-STIIMA, Lecco, Italy

    Marco Sacco

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gozzi, A., Guazzini, A. (2024). Exploring Acoustics Perception Through XR Spatial Audio Experiences: Experiments and Data Collection for the ‘Listen To the Theatre’ Project. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2024. Lecture Notes in Computer Science, vol 15029. Springer, Cham. https://doi.org/10.1007/978-3-031-71710-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-71710-9_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-71709-3

  • Online ISBN: 978-3-031-71710-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics