Abstract
TRIP is an in-house Computational Fluid Dynamics (CFD) software that can simulate subsonic, transonic, and supersonic flows with complex geometries. With the increase of computation and memory requirement for large-scale CFD simulations, it is an inevitable trend to use massively parallel computers for parallel computing. In this paper, with a dual-level hybrid and heterogeneous programming model using MPI + OpenACC, we port and optimize the TRIP software on the Sunway TaihuLight supercomputer. A series of optimization techniques, including data reconstruction, data packing, loop refactoring and array swapping, are explored. In addition, a grid preprocessing tool is developed for reducing the load imbalance caused by the non-cube shape of sub grids. Scalability tests show that TRIP can achieve 66.9% parallel efficiency of strong scaling and 96% efficiency of weak scaling when the cores are increased from 10,400 to 665,600.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yuntao, W.: Development and application of TRIP2.0_SOLVER. Acta Aerodynamica Sinica 106(4), 2205 (2007)
Haohuan, F.: The Sunway Taihu Light supercomputer: system and applications. Sci. China (Inf. Sci.) 59(07), 113–128 (2016). https://doi.org/10.1007/s11432-016-5588-7
Jian, Z., Chunbao, Z.: Extreme-scale phase field simulations of coarsening dynamics on the Sunway TaihuLight supercomputer. In: International Conference for High Performance Computing, Networking, Storage and Analysis, Salt Lake City. IEEE Press (2016)
Chao, Y., Wei, X.: 10M-core scalable fully-implicit solver for nonhydrostatic atmospheric dynamics. In: International Conference for High Performance Computing, Networking, Storage and Analysis, Salt Lake City. IEEE Press (2016)
Fu, H., He, C.: 18.9-Pflops nonlinear earthquake simulation on Sunway TaihuLight: enabling depiction of 18-hz and 8-meter scenarios. In: International Conference for High Performance Computing, Networking, Storage and Analysis, Denver. IEEE Press (2017)
Ahusborde, E., Glockner, S.: A 2D block-structured mesh partitioner for accurate flow simulations on non-rectangular geometries. Comput. Fluids 43(1), 2–13 (2011)
Fang, L., Zhihui, L.: Research on adaptation of CFD software based on many-core architecture of 100P domestic supercomputing system. Comput. Sci. 47(01), 24–30 (2020)
Delong, M., Minhua, W.: Porting and optimizing OpenFOAM on Sunway TaihuLight system. Comput. Sci. 10(44), 64–70 (2017)
Chao, Y.: The Computational Fluid Dynamics Method and its Application. Beihang University Press, Beijing (2006). (in Chinese)
Juan, Z., Linsheng, L.: Automatic partition algorithm based on multi-region and multi-code problem. Comput. Eng. 36(9), 73–75 (2010)
Acknowledgment
This work was supported by National Key Research and Development Program under grant# 2016YFB0200703 and National Numerical Windtunnel Project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yue, H., Deng, L., Meng, D., Wang, Y., Sun, Y. (2020). Parallelization and Optimization of Large-Scale CFD Simulations on Sunway TaihuLight System. In: Dong, D., Gong, X., Li, C., Li, D., Wu, J. (eds) Advanced Computer Architecture. ACA 2020. Communications in Computer and Information Science, vol 1256. Springer, Singapore. https://doi.org/10.1007/978-981-15-8135-9_19
Download citation
DOI: https://doi.org/10.1007/978-981-15-8135-9_19
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8134-2
Online ISBN: 978-981-15-8135-9
eBook Packages: Computer ScienceComputer Science (R0)
