Abstract
In typical environments, the direct path between a sound source and a listener is often occluded. However, due to the phenomenon of diffraction, sound still reaches the listener by “bending” around an obstacle that lies directly in the line of straight propagation. Modeling occlusion/diffraction effects is a difficult and computationally intensive task and thus generally ignored in virtual reality and videogame applications. Driven by the gaming industry, consumer computer graphics hardware and the graphics processing unit (GPU) in particular, have greatly advanced in recent years, outperforming the computational capacity of central processing units. Given the affordability, widespread use, and availability of computer graphics hardware, here we describe a computationally efficient GPU-based method that approximates acoustical occlusion/diffraction effects in real time. Although the method has been developed primarily for videogames where occlusion/diffraction is typically overlooked, it is relevant for dynamic and interactive virtual environments as well.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Allen JB, Berkley DA (1979) Image method for efficiently simulating small-room acoustics. J Acoust Soc Am 65(4):943–950
Bass HE, Sutherland LC, Zuckerwar AJ (1990) Atmospheric absorption of sound: update. J Acoust Soc Am 88(4):2019–2021
Biot MA, Tolstoy I (1957) Formulation of wave propagation in infinite media by normal coordinates with an application to diffraction. J Acoust Soc Am 29(3):381–391
Buck I, Foley T, Horn D, Sugerman J, Fatahalian K, Houston M, Hanrahan P (2004) Brook for GPUs: Stream computing on graphics hardware. ACM Transactions on Graphics 23(3):777–786
Calamia PT, Svensson UP, Funkhouser TA (2005) Integration of edge-diffraction calculations and geometrical-acoustics modeling. In: Proceedings of forum acusticum 2005 (Budapest, Hungary), August 29–September 2 2005, pp 2499–2504
Cremer L, Müller HA (1978) Principles and applications of room acoustics, vol 1. Applied Science Publishers LTD, Barking
IEEE (1987) IEEE standard for binary floating-point arithmetic. ACMSIGPLAN Notices 22, 2 (Feb.), 9–25
Ekman M, Warg F, Nilsson J (1994) An in-depth look at computer performance growth. Comput Architect News 33(1):144–147
Foley D, van Dam J,A, Feiner SK, Hughes JF, Phillips RL (1994) Introduction to computer graphics. Addison-Wesley Publishing Co., Reading
Funkhouser T, Tsingos N, Carlbom I, Elko G, Sondhi M, West JE, Pingali G, Min P, Ngan A (2004) A beam tracing method for interactive architectural acoustics. J Acoust Soc Am 115(2):739–756
Geer D (2005) Taking the graphics processor beyond graphics. IEEE Comput 39(9):14–16
Hamidi F, Kapralos B (2009) A review of spatial sound for virtual environments and games with graphics processing units. Open Virtual Real J 1(1):8–17
Hecht E (2002) Optics, 4th edn. Pearson Education Inc, San Francisco
Hillesland KE, Lastra A (2004) GPU floating-point paranoia. In: Proceedings of ACM workshop on general purpose computing on graphics processors 2004 (Los Angeles, California, USA), August 7–8 2004, C, 8
Jensen HW (2001) Realistic image synthesis using photon mapping. A. K. Peters, Ltd., Natick
Kapralos B, Jenkin M, Milios E (2008a) Sonel mapping: a probabilistic acoustical modeling method. Building Acoust 15(4):289–313
Kapralos B, Jenkin M, Milios E (2008b) Virtual audio systems. Presence Teleoperators Virtual Environ 17(6):524–549
Keller JB (1962) Geometrical theory of diffraction. J Opt Soc Am 52(2):116–130
Kuttrff H (2000) Room acoustics, 4th edn. Spon Press, London
Lokki T, Svensson P, Savioja L. An efficient auralization of edge diffraction. In: Proceedings of the audio engineering society 21st international conference on architectural acoustics and sound reinforcement (St. Petersburg, Russia), June 1–3 2002, pp 317–325
Luebke D, Humphreys G (2007) How GPUs work. IEEE Comput 40(2):96–100
Mark WR, Glanville PS, Akeley K, Kilgard MJ. Cg: a system for programming graphics hardware in a C-like language. In: Proceedings of the ACM international conference on computer graphics and interactive techniques SIGGRAPH 2003 (San Diego, CA. USA), July 27–31 2003, pp 896–907
Mehta M, Johnson J, Rocafort J (1999) Architectural acoustics principles and design. Prentice Hall Inc., Upper Saddle River
Menshikov (2003) Modern audio technologies in games. http://ixbtlabs.com/articles2/sound-technology/index.html
Murphy DT, Beeson M (2003) Modelling spatial sound occlusion and diffraction effects using the digital waveguide mesh. In: Proceedings of the audio engineering society 24th international conference: multichannel audio the new reality, (Banff, Alberta, Canada), June 26–28, 2003, pp 207–216
Owens JD, Luebke D, Govindaraju N, Harris M, Krüger J, Lefohn AE, Purcell TJ (2007) A survey of general-purpose computation on graphics hardware. Comput Graph Forum 26(1):80–113
Rost R (2006) OpenGL shading language, 2nd edn. Addison-Wesley Professional, Boston
Sherrod A (2008) Game graphics programming. Course Technology. Cengage Learning, Boston
Svensson UP, Fred RI, Vaderkooy J (1999) An analytic secondary source model of edge diffraction impulse responses. J Acoust Soc Am 106(5):2331–2344
Torres RR, Svensson P, Kleiner M (2001) Computation of edge diffraction for more accurate room acoustics auralization. J Acoust Soc Am 109(2):600–610
Tsingos N, Gascuel JD (1997) Soundtracks for computer animation: sound rendering in dynamic environments with occlusion. In: Proceedings of Graphics Interface’97, Kelowna, BC, Canada, May 21–23, 1997, pp 9–16
Tsingos N, Gascuel JD (1998) Fast rendering of sound occlusion and diffraction effects for virtual acoustic environments. In: 104th convention of the Audio Engineering Society (Amsterdam, The Netherlands), May 16–19, 1998, preprint no. 4699
Tsingos N, Funkhouser T, Ngan A, Carlbom I (2001) Modeling acoustics in virtual environments using the uniform theory of diffraction. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques (SIGGRAPH 2001), 2001, pp 545–552
Tsingos N, Carlbom I, Elko G, Funkhouser T, Kubli B (2002) Validation of acoustical simulations in the “Bell Labs Box”. IEEE Comput Graph Appl 22(4):28–37
Tsingos N, Dachsbacher C, Lefebvre S, Dellepiane M (2007) Instant sound scattering. Rendering Techniques. In: Proceedings of the eurographics symposium on rendering, Grenoble, France, June 25–27
Acknowledgments
The financial support of the Natural Sciences and Engineering Research Council of Canada (NSERC) in the form of an Undergraduate Summer Research Award and a Post Graduate Scholarship to Brent Cowan and a Discovery Grant to Bill Kapralos is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Additional information
CR Subject Classification H.5 INFORMATION INTERFACES AND PRESENTATION, H.5.1 Multimedia Information Systems -Artificial, augmented, and virtual realities. I.3 COMPUTER GRAPHICS, I.3.1 Hardware Architecture -Graphics processors.
Appendix A
Appendix A
In this section, the GLSL vertex and fragment shader source code in addition to the source code to implement the scaling filters is provided (the scaling filters are generated using the CPU once during initialization; the scaling filtering is performed on the CPU).
1.1 A.1 Vertex shader
1.2 A.2 Fragment shader
1.3 A.3 Receiver scaling filters
Rights and permissions
About this article
Cite this article
Cowan, B., Kapralos, B. GPU-based real-time acoustical occlusion modeling. Virtual Reality 14, 183–196 (2010). https://doi.org/10.1007/s10055-010-0166-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-010-0166-6