skip to main content
10.1145/3404397.3404421acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicppConference Proceedingsconference-collections
Article

Large-scale Simulations of Peridynamics on Sunway Taihulight Supercomputer

Published: 17 August 2020 Publication History

Editorial Notes

The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on June 3, 2021. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.

Abstract

Peridynamics (PD) methods are good at describing solid mechanical behaviours and have the superiority on simulating the discontinuous problems. They can be applied to many fields, such as materials science, human health, and industrial manufacturing, etc., which motivates us to provide their efficient numerical simulations on the Sunway TaihuLight supercomputer. However, massive and complex calculations of PD simulations and the characteristics of Sunway TaihuLight bring challenges to efficient parallel PD simulations. In this paper, we present a series of performance optimization techniques to perform a large-scale parallel PD simulation application on Sunway TaihuLight. We first design the data grouping and SPM-based caching to increase the bandwidth of data transmission and reduce the time of the main memory access. Further, we design and implement vectorization and instruction-level optimization for PD applications to improve computational performance. Finally, we offer the overlapping strategies of data transmission and computation so that data transmission can be covered by computation. Our work in a core group improves the performance of the serial version on the SW26010 processor by 181 times. Compared to the serial and single-CPU Peridigm-based simulations on Intel Xeon E5-2680 V3, our work gets a speedup of 60 times and 6 times, respectively. Near linear scalability is also obtained. When testing the weak scaling, the simulation of a 296,222,720-point example achieves 1.14 PFLOPS with 8192 (532,480 cores) processes. When testing the strong scaling, 90% parallel efficiency is observed as the number of processes increases 64 times to 4096 processes.

Supplementary Material

3404421-vor (3404421-vor.pdf)
Version of Record for "Large-scale Simulations of Peridynamics on Sunway Taihulight Supercomputer" by Li et al., 49th International Conference on Parallel Processing (ICPP '20).

References

[1]
Yulong Ao, Chao Yang, Xinliang Wang, Wei Xue, Haohuan Fu, Fangfang Liu, Lin Gan, Ping Xu, and Wenjing Ma. 2017. 26 pflops stencil computations for atmospheric modeling on sunway taihulight. In 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 535–544.
[2]
Ebrahim Askari, Jifeng Xu, and Stewart Silling. 2006. Peridynamic analysis of damage and failure in composites. In 44th AIAA aerospace sciences meeting and exhibit. 88.
[3]
Paul Demmie and Stewart Silling. 2007. An approach to modeling extreme loading of structures using peridynamics. Journal of Mechanics of Materials and Structures 2, 10(2007), 1921–1945.
[4]
Patrick Diehl and Marc Alexander Schweitzer. 2015. Efficient neighbor search for particle methods on GPUs. In Meshfree Methods for Partial Differential Equations VII. Springer, 81–95.
[5]
Xiaohui Duan, Ping Gao, Tingjian Zhang, Meng Zhang, Weiguo Liu, Wusheng Zhang, Wei Xue, Haohuan Fu, Lin Gan, Dexun Chen, 2018. Redesigning LAMMPS for peta-scale and hundred-billion-atom simulation on Sunway TaihuLight. In SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 148–159.
[6]
Jiarui Fang, Haohuan Fu, Wenlai Zhao, Bingwei Chen, Weijie Zheng, and Guangwen Yang. 2017. swdnn: A library for accelerating deep learning applications on sunway taihulight. In 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 615–624.
[7]
Haohuan Fu, Junfeng Liao, Jinzhe Yang, Lanning Wang, Zhenya Song, Xiaomeng Huang, Chao Yang, Wei Xue, Fangfang Liu, Fangli Qiao, 2016. The Sunway TaihuLight supercomputer: system and applications. Science China Information Sciences 59, 7 (2016), 072001.
[8]
YL Hu and Erdogan Madenci. 2017. Peridynamics for fatigue life and residual strength prediction of composite laminates. Composite Structures 160(2017), 169–184.
[9]
Jooeun Lee, Seong Eun Oh, and Jung-Wuk Hong. 2017. Parallel programming of a peridynamics code coupled with finite element method. International Journal of Fracture 203, 1-2 (2017), 99–114.
[10]
Emma Lejeune and Christian Linder. 2017. Modeling tumor growth with peridynamics. Biomechanics and modeling in mechanobiology 16, 4 (2017), 1141–1157.
[11]
Shigang Li, Baodong Wu, Yunquan Zhang, Xianmeng Wang, Jianjiang Li, Changjun Hu, Jue Wang, Yangde Feng, and Ningming Nie. 2018. Massively scaling the metal microscopic damage simulation on sunway taihulight supercomputer. In Proceedings of the 47th International Conference on Parallel Processing. 1–11.
[12]
David J Littlewood. 2015. Roadmap for peridynamic software implementation. SAND Report, Sandia National Laboratories, Albuquerque, NM and Livermore, CA (2015).
[13]
Wenyang Liu and Jung-Wuk Hong. 2012. Discretized peridynamics for brittle and ductile solids. International journal for numerical methods in engineering 89, 8(2012), 1028–1046.
[14]
Charles McEniry. 2007. The mathematics behind the fast inverse square root function code. Tech. rep. (2007).
[15]
CODY AARON MITTS. 2019. Simulating Crack Initiation and Propagation in Ceramic Matrix Composites using Peridynamics. http://hdl.handle.net/10150/632537
[16]
Farshid Mossaiby, A Shojaei, M Zaccariotto, and U Galvanetto. 2017. OpenCL implementation of a high performance 3D Peridynamic model on graphics accelerators. Computers & Mathematics with Applications 74, 8 (2017), 1856–1870.
[17]
Siavash Nadimi. 2015. State-based peridynamics simulation of hydraulic fracture phenomenon in geological media. The University of Utah.
[18]
NSCCWX. 2016. Sunway taihulight compiler user guide. http://www.nsccwx.cn:1337/uploads/01f3b96b132946808bfcd5997d188a6d.pdf
[19]
Naveen Prakash and Gary D Seidel. 2016. Electromechanical peridynamics modeling of piezoresistive response of carbon nanotube nanocomposites. Computational Materials Science 113 (2016), 154–170.
[20]
Stewart A Silling. 2000. Reformulation of elasticity theory for discontinuities and long-range forces. Journal of the Mechanics and Physics of Solids 48, 1 (2000), 175–209.
[21]
Stewart A Silling and Ebrahim Askari. 2005. A meshfree method based on the peridynamic model of solid mechanics. Computers & structures 83, 17-18 (2005), 1526–1535.
[22]
Christian Willberg, Lasse Wiedemann, and Martin Rädel. 2019. A mode-dependent energy-based damage model for peridynamics and its implementation. Journal of Mechanics of Materials and Structures 14, 2(2019), 193–217.
[23]
Zhigeng Xu, James Lin, and Satoshi Matsuoka. 2017. Benchmarking sw26010 many-core processor. In 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE, 743–752.
[24]
Jian Zhang, Chunbao Zhou, Yangang Wang, Lili Ju, Qiang Du, Xuebin Chi, Dongsheng Xu, Dexun Chen, Yong Liu, and Zhao Liu. 2016. Extreme-scale phase field simulations of coarsening dynamics on the sunway taihulight supercomputer. In SC’16: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 34–45.

Cited By

View all
  • (2024)PDMATLAB2D: A Peridynamics MATLAB Two-dimensional CodeJournal of Peridynamics and Nonlocal Modeling10.1007/s42102-023-00104-w6:1(149-205)Online publication date: 23-Jan-2024
  • (2024)Matrix‐based implementation and GPU acceleration of hybrid FEM and peridynamic model for hydro‐mechanical coupled problemsInternational Journal for Numerical Methods in Engineering10.1002/nme.7504125:18Online publication date: 12-Jun-2024
  • (2023)The Peridigm Meshfree Peridynamics CodeJournal of Peridynamics and Nonlocal Modeling10.1007/s42102-023-00100-06:1(118-148)Online publication date: 8-May-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICPP '20: Proceedings of the 49th International Conference on Parallel Processing
August 2020
844 pages
ISBN:9781450388160
DOI:10.1145/3404397
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Large-scale simulation
  2. Manycore computing
  3. Peridynamics
  4. Sunway Taihulight

Qualifiers

  • Article
  • Research
  • Refereed limited

Conference

ICPP '20

Acceptance Rates

Overall Acceptance Rate 91 of 313 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)3
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)PDMATLAB2D: A Peridynamics MATLAB Two-dimensional CodeJournal of Peridynamics and Nonlocal Modeling10.1007/s42102-023-00104-w6:1(149-205)Online publication date: 23-Jan-2024
  • (2024)Matrix‐based implementation and GPU acceleration of hybrid FEM and peridynamic model for hydro‐mechanical coupled problemsInternational Journal for Numerical Methods in Engineering10.1002/nme.7504125:18Online publication date: 12-Jun-2024
  • (2023)The Peridigm Meshfree Peridynamics CodeJournal of Peridynamics and Nonlocal Modeling10.1007/s42102-023-00100-06:1(118-148)Online publication date: 8-May-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media