Abstract
CTBTO is operating and maintaining the international monitoring system of Seismic, Infrasound, Hydroacoustic and Airborne radionuclide facilities to detect a nuclear explosion over the globe. The monitoring network of CTBTO, especially with regard to infrasound and hydroacoustic, is quite unique because the network covers over the globe, and the data is opened to scientific use. CTBTO has been developing and improving the methodologies to analyze observed signals intensively. In this context, hydroacoustic modelling software, especially which that solves the partial differential equation directly, is of interest. As seen in the analysis of the Argentinian submarine accident, the horizontal reflection can play an important role in identifying the location of an underwater event, and as such, accurate modelling software may help analysts find relevant waves efficiently. Thus, CTBTO has been testing a parabolic equation based model (3D-SSFPE) and building a finite difference time domain (FDTD) model. At the same time, using such accurate models require larger computer resources than simplified methods such as ray-tracing. Thus we accelerated them using OpenMP and OpenACC, or the hybrid of those. As a result, in the best case scenarios, (1) 3D-SSFPE was accelerated by approximately 19 times to the original Octave code, employing the GPU-enabled Octfile technology, and (2) FDTD was accelerated by approximately 160 times to the original Fortran code using the OpenMP/OpenACC hybrid technology, on our DGX—Station with V100 GPUs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
DGX Station web page. https://www.nvidia.com/en-us/data-center/dgx-station/. Accessed 12 July 2019
Interoperability between OpenACC and cuFFT. https://www.olcf.ornl.gov/tutorials/mixing-openacc-with-gpu-libraries/. Accessed 16 July 2019
MULTI GPU PROGRAMMING WITH MPI AND OPENACC. https://gputechconf2017.smarteventscloud.com/connect/sessionDetail.ww?SESSION_ID=110507&tclass=popup. Accessed 22 July 2019
The API reference guide for cuFFT. https://docs.nvidia.com/cuda/cufft/index.html. Accessed 13 July 2019
ubuntu-toolchain-r/test web page. https://launchpad.net/~ubuntu-toolchain-r/+archive/ubuntu/test. Accessed 13 July 2019
Amante, C.: Etopo1 1 arc-minute global relief model: procedures, data sources and analysis (2009). https://doi.org/10.7289/v5c8276m, https://data.nodc.noaa.gov/cgi-bin/iso?id=gov.noaa.ngdc.mgg.dem:316
Calore, E., Gabbana, A., Kraus, J., Schifano, S.F., Tripiccione, R.: Performance and portability of accelerated lattice Boltzmann applications with OpenACC. Concurr. Comput.: Pract. Exper. 28(12), 3485–3502 (2016). https://doi.org/10.1002/cpe.3862
Etter, P.: Underwater Acoustic Modeling and Simulation, 4th edn. Taylor & Francis (2013)
Frigo, M., Johnson, S.G.: The design and implementation of FFTW3. Proc. IEEE 93(2), 216–231 (2005). Special issue on “Program Generation, Optimization, and Platform Adaptation”
Heaney, K.D., Campbell, R.L.: Three-dimensional parabolic equation modeling of mesoscale eddy deflection. J. Acoust. Soc. Am. 139(2), 918–926 (2016). https://doi.org/10.1121/1.4942112
Heaney, K.D., Prior, M., Campbell, R.L.: Bathymetric diffraction of basin-scale hydroacoustic signals. J. Acoust. Soc. Am. 141(2), 878–885 (2017). https://doi.org/10.1121/1.4976052
Kageyama, A., Sato, T.: “Yin-Yang grid”: an overset grid in spherical geometry. Geochem. Geophys. Geosyst. 5(9) (2004). https://doi.org/10.1029/2004GC000734
Kushida, N.: Globalacoustic2D dual GPU (2019). https://doi.org/10.5281/zenodo.3351369
Kushida, N.: Globalacoustic2D OpenMP (2019). https://doi.org/10.5281/zenodo.3351284
Kushida, N.: GPU version of “Split Step Fourier PE method to solve the Lloyd’s Mirror Problem”, August 2019. https://doi.org/10.5281/zenodo.3359888
Kushida, N.: Hydroacoustic wave propagation from Vema to Bermuda using FDM, July 2019. https://doi.org/10.5281/zenodo.3349551
Kushida, N.: OpenACC enabled oct file (2019). https://doi.org/10.5281/zenodo.3345905
Kushida, N., Le Bras, R.: Acoustic wave simulation using an overset grid for the global monitoring system. In: AGU Fall Meeting. Oral Presentation: AGU Fall Meeting 2017, New Orleans, USA, 11–15 December 2017 (2017)
Lin, Y.T.: Split Step Fourier PE method to solve the Lloyd’s Mirror Problem, August 2019. https://doi.org/10.5281/zenodo.3359581
Lin, Y.T., Duda, T.F., Newhall, A.E.: Three-dimensional sound propagation models using the parabolic-equation approximation and the split-step Fourier method. J. Comput. Acoust. 21(01), 1250018 (2013). https://doi.org/10.1142/s0218396x1250018x
Ostashev, V.E., Wilson, D.K., Liu, L., Aldridge, D.F., Symons, N.P., Marlin, D.: Equations for finite-difference, time-domain simulation of sound propagation in moving inhomogeneous media and numerical implementation. J. Acoust. Soc. Am. 117(2), 503–517 (2005). https://doi.org/10.1121/1.1841531
Shockley, R.C., Northrop, J., Hansen, P.G., Hartdegen, C.: Sofar propagation paths from Australia to Bermuda: comparison of signal speed algorithms and experiments. J. Acoust, Soc. Am. 71(1), 51–60 (1982). https://doi.org/10.1121/1.387250
Wang, L.S., Heaney, K., Pangerc, T., Theobald, P., Robinson, S.P., Ainslie, M.: Review of underwater acoustic propagation models. NPL report, October 2014. http://eprintspublications.npl.co.uk/6340/
Acknowledgement
One of the authors, Noriyuki Kushida, would like to express his gratitude to Dr Tammy Taylor, the director of the International Data Centre of CTBTO, on her encouragement on the work. And also he would like to express his gratitude to CEA in France as well as PRACE, on their support for the development of FDM by awarding the machine times on Irena Skylake. Finally, he would like to thank Dr Yuka Kushida for her English correction. She has pointed out errors which had been overlooked even by a native speaker.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kushida, N., Lin, YT., Nielsen, P., Le Bras, R. (2020). Acceleration in Acoustic Wave Propagation Modelling Using OpenACC/OpenMP and Its Hybrid for the Global Monitoring System. In: Wienke, S., Bhalachandra, S. (eds) Accelerator Programming Using Directives. WACCPD 2019. Lecture Notes in Computer Science(), vol 12017. Springer, Cham. https://doi.org/10.1007/978-3-030-49943-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-49943-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49942-6
Online ISBN: 978-3-030-49943-3
eBook Packages: Computer ScienceComputer Science (R0)