Abstract
The paper presents a description of par3Dhp—a 3D, parallel, fully automatic hp-adaptive finite element code for elliptic and Maxwell problems. The parallel implementation is an extension of the sequential code 3Dhp90, which generates, in a fully automatic mode, optimal hp meshes for various boundary value problems. The system constitutes an infrastructure for a class of parallel hp adaptive computations. Its modular structure allows for an independent parallelization of each component of the system. The presented work addresses parallelization of these components, including distributed data structures, load balancing and domain redistribution, parallel (multi-frontal) solver, optimal hp mesh refinements, and a main control module. All components communicate through a distributed data structure, and the control module synchronizes work of all components. The concept of ghost elements has been used to simplify the communication algorithms for parallel mesh refinements. The system has been implemented in Fortran 90 and MPI, and the load balancing is done through an interface with the ZOLTAN library. Numerical results are presented for the model Fichera problem.
Similar content being viewed by others
References
Demkowicz L, Rachowicz W, Devloo Ph (2001) A fully automatic hp-adaptivity. J Sci Comput 17(1–3):127–155
Demkowicz L (2003a) hp-Adaptive finite elements for time-harmonic Maxwell equations. In: Ainsworth M, Davies P, Duncan D, Martin P, Rynne P (eds) Topics in computational wave propagation, Lecture Notes in Computational Science and Engineering. Springer, Berlin Heidelberg New York
Demkowicz L (2003b) Fully automatic hp-adaptivity for Maxwell’s equations. TICAM Report 03-45
D’Angelo J, Mayergoyz I (1996) Large-scale finite element scattering analysis on massively parallel computers. In: Itoh T, Pelosi G, Silvester PP (eds) Finite element software for microwave engineering. Wiley, Nw York
Stewart JR, Edwards HC (2002) SIERRA Framework Version 3: h-adaptivity design and use. SAND2002-4016. Sandia National Laboratories, Albuquerque
Edwards HC (2002) SIERRA Framework Version 3: core services theory and design. SAND2002-3616. Sandia National Laboratories, Albuquerque
Edwards HC, Stewart JR, Zepper JD (2002) Mathematical abstractions of the SIERRA computational mechanics framework. In: Proceedings of the 5th World congress comp. mech., Vienna, Austria
Edwards HC, Stewart JR (2001) SIERRA, a software environment for developing complex multiphysics applications. In: Computational fluid and solid mechanics proceedings of first MIT conference, Cambridge
Edwards HC (2005) Sierra framework for parallel adaptive multiphisics computational mechanics applications. VIII US National Congress on Computational Mechanics, Austin
Laszloffy A, Long J, Patra AK (2000) Simple data management, scheduling and solution strategies for managing the irregularities in parallel adaptive hp finite element simulations. Parallel Comput 26:1765–1788
Bauer AC, Patra AK (2004) Robust and efficient domain decomposition preconditioners for adaptive hp finite element approximations of linear elasticity with and without discontinuous coefficients. Int J Numer Meth Eng 59(3):337–364
Patra AK (1995) Parallel HP adaptive finite element analysis for viscous incompressible fluid problems. Dissertation, University of Texas at Austin
Bajer A, Rachowicz W, Walsh T, Demkowicz L (2001) A two-grid parallel solver for time harmonic maxwell’s equations and hp meshes. In: Proceedings of second european conference on computational mechanics, Cracow, June 25–29
Demkowicz L (2002) 2D hp-Adaptive finite element package (2Dhp90) Version 2.0. TICAM Report 02-06
Demkowicz L, Pardo D, Rachowicz W (2002) 3D hp-Adaptive finite element package (3Dhp90) Version 2.0, The ultimate (?) data structure for three-dimensionsl, anisotropic hp refinements, TICAM Report 02-24
Dong Xue, Demkowicz L (2002) Geometrical modeling package. Version 2.0. TICAM Report 02-30
Paszynski M, Kurtz J, Demkowicz L (2004) Parallel fully automatic hp-adaptive 2D finite element package. ICES Report 04-07. Computer methods in applied mechanics and engineering (in press)
Rachowicz W, Pardo D, Demkowicz L (2004) Fully automatic hp-adaptivity in three dimensions. ICES Report 04-22. Computer methods in applied mechanics and engineering (in press)
Remacle JF, Xiangrong Li, Shephard MS, Flaherty JE (2005) Anisotropic adaptive simulations of transient flows using discontinuous galerkin methods. Int J Numer Meth Eng 62 (7): 899–923
Kurtz J (2005) Fully automatic hp-adaptivity for acoustic and electromagnetic scattering in three dimensions. PhD proposal. CAM PhD Program, ICES, The University of Texas at Austin. http://www.ices.utexas.edu/~kurtzj/proposal
Booch G, Rumbaugh J, Jacobson I (1998) The unified modeling language user guide, 1st edn. Addison-Wesley Professional, Reading
ZOLTAN Zoltan: data-management services for parallel applications. http://www.cs.sandia.gov/Zoltan
Paszynski M, Milfeld K (2004) h-Relation personalized communication strategy for hp-adaptive computations. TICAM Report 04-40
Walsh T, Demkowicz L (1999) A parallel multifrontal solver for hp-adaptive finite elements. TICAM Report 99-01
Foster I (1995) Designing and building parallel programs. http://www-unix.mcs.anl.gov/dbpp
Patra AK, Kim DW (1998) Efficient mesh partitioning for adaptive hp finite element meshes. In: Choi-Hong Lai, Petter E. Bjorstad, Mark Cross, Olof B (eds) Widlundeleventh international conference on domain decomposition methods. Greenwich, August 1998
Pardo D, Demkowicz L (2002) Integration of hp-adaptivity and multigrid. I. A Two Grid Solver for hp Finite Elements. TICAM Report 02-33
MUMPS: a MUltifrontal massively parallel sparse direct solver. http://www.enseeiht.fr/lima/apo/MUMPS
Acknowledgments
The work of the second author has been supported by Air Force under Contract F49620-98-1-0255. The computations reported in this work were done through the National Science Foundation’s National Partnership for Advanced Computational Infrastructure. The authors are greatly indebted to Jason Kurtz for numerous discussions on the subject.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article is available at http://dx.doi.org/10.1007/s00366-007-0059-9.
Rights and permissions
About this article
Cite this article
Paszyński, M., Demkowicz, L. Parallel, fully automatic hp-adaptive 3D finite element package. Engineering with Computers 22, 255–276 (2006). https://doi.org/10.1007/s00366-006-0036-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-006-0036-8