Abstract
In this paper, we describe the Graphics Processing Unit (GPU) implementation of our City-LES code on detailed large eddy simulations, including the multi-physical phenomena on fluid dynamics, heat absorption and reflection by surface and building materials, cloud effects, and even sunlight effect. Because a detailed simulation involving these phenomena is required for analyses at the street level and several meters of resolution, the computation amount is enormous, and ordinary CPU computation cannot provide sufficient performance. Therefore, we implemented the entire code on GPU clusters with large-scale computing. We applied OpenACC coding to incrementally implement relatively easy programming and eliminate data transfers between the CPU and GPU memories. Based on this research, we determined that the elimination of data transfers is effective, even in the case where a part of the code execution on the GPU is slower than the CPU, owing to the absence of spatial parallelism. The objective of this study is to perform a complete climate simulation on a few square-kilometers field around the Tokyo Station, considering the finest resolution of the original highlighted area of the Marathon race in the Olympic Games Tokyo 2020. We successfully transferred the entire code to the GPU to provide approximately eight times the performance of CPU-only computation on multi-GPU per node with a large scale cluster.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ikeda, R., Kusaka, H., Iizuka, S., Boku, T.: Development of urban meteorological LES model for thermal environment at city scale. In: Proceeding of the 9th International Conference for Urban Climate, Toulouse, France (2015)
Tsuji, D., Boku, T., Ikeda, R., Sato, T., Tadano, H., Kusaka, H.: Parallelized GPU code of city-level large eddy simulation. In: Proceeding of International Symposium on Parallel and Distributed Computing (ISPDC), Warsaw, Jun. 2020 (2020)
Aoki, T., Shimokawabe, T.: Chapter 16: Of GPU solutions to multi-scale problems in science and engineering: large-scale numerical weather prediction on GPU supercomputer. In: David, A.Y., Wang, L., Chi, X., Johnsonn, L., Ge, W., Shi, Y. (eds.) Lecture Notes in Earth System Sciences. Springer, Berlin (2013)
Ahmad, N.H., Inagaki, A., Kanda, M., Onodera, N., Aoki, T.: Large eddy simulation of the gust factor using Lattice Boltzmann method within a huge and high resolution Urban Area of Tokyo. J. Jpn. Soc. Civil Eng. Ser. B1 71(4), I_37−I_42. https://doi.org/10.2208/jscejhe.71.I_37
Tadano, H., Ikeda, R., Kusaka, H.: Speeding up Large Eddy Simulation by Multigrid Preconditioned Krylov Subspace Methods with Mixed Precision. In: The 35th JSST Annual Conference International Conference on Simulation Technology (JSST2016), Kyoto, Japan (Oct. 2016)
Nvidia: CORPORATION: PGI, Resources, Cuda Fortran. https://www.pgroup.com/resources/cudafortran.htm
Team-SCALE R-CCS RIKEN, SCALE by Riken R-CCS. http://r-ccs-climate.riken.jp/scale/a/index.html
Cygnus Supercomputer. https://www.ccs.tsukuba.ac.jp/wp-content/uploads/sites/14/2018/12/About-Cygnus.pdf
Acknowledgment
The authors thank our colleagues for their substantial support and suggestions, especially Mr. Ryosaku Ikeda at Weathernews Inc., Prof. Doan Quang Van, Prof. Norihisa Fujita, and Prof. Ryohei Kobayashi, all in the CCS at the University of Tsukuba. This research was partially supported by the MEXT “Next Generation Supercomputing” program, with the titled project “Development of Computing-Communication Unified Supercomputer in Next Generation.” In addition, this study was supported by MCRP at CCS, University of Tsukuba, which provided the Cygnus supercomputer used in the research, under the “HPC application and system software development on FPGA-GPU combined platform” Project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 IFIP International Federation for Information Processing
About this paper
Cite this paper
Watanabe, K., Kikuchi, K., Boku, T., Sato, T., Kusaka, H. (2022). High Resolution of City-Level Climate Simulation by GPU with Multi-physical Phenomena. In: Cérin, C., Qian, D., Gaudiot, JL., Tan, G., Zuckerman, S. (eds) Network and Parallel Computing. NPC 2021. Lecture Notes in Computer Science(), vol 13152. Springer, Cham. https://doi.org/10.1007/978-3-030-93571-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-93571-9_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-93570-2
Online ISBN: 978-3-030-93571-9
eBook Packages: Computer ScienceComputer Science (R0)
