Abstract
This paper presents the design and preliminary evaluation of hierarchical partitioning and load-balancing techniques for distributed structured adaptive mesh refinement (SAMR) applications. The overall goal of these techniques is to enable the load distribution to reflect the state of the adaptive grid hierarchy and exploit it to reduce synchronization requirements, improve load-balance, and enable concurrent communications and incremental redistribution. The hierarchical partitioning algorithm (HPA) partitions the computational domain into subdomains and assigns them to hierarchical processor groups. Two variants of HPA are presented in this paper. The static hierarchical partitioning algorithm (SHPA) assigns portions of overall load to processor groups. In SHPA, the group size and the number of processors in each group is setup during initialization and remains unchanged during application execution. It is experimentally shown that SHPA reduces communication costs as compared to the Non-HPA scheme, and reduces overall application execution time by up to 59%. The adaptive hierarchical partitioning algorithm (AHPA) dynamically partitions the processor pool into hierarchical groups that match the structure of the adaptive grid hierarchy. Initial evaluations of AHPA show that it can reduce communication costs by up to 70%.
Similar content being viewed by others
References
S. B. Baden and S. J. Fink. Communication overlap in multi-tier parallel algorithms. In Conf. Proc. Supercomputing 98, Orlando, FL, 1998.
M. Berger and J. Oliger. Adaptive mesh refinement for hyperbolic partial differential equations. Journal of Computational Physics, 53:484–512, 1984.
R. Buyya (ed.). High Performance Cluster Computing, Vol. 1, Prentice Hall, 1999.
S. Chandra, J. Steensland, M. Parashar, and J. Cummings. An experimental study of adaptive application sensitive partitioning strategies for SAMR applications. In 2nd Los Alamos Computer Science Institute Symposium, October 2001.
Chombo, Applied Numerical Algorithms Group, Lawrence Berkeley National Laboratory, http://seesar.lbl.gov/anag/chombo/.
J. Cummings, M. Aivazis, R. Samtaney, R. Radovitzky, S. Mauch, and D. Meiron. A virtual test facility for the simulation of dynamic response in materials. Journal of Supercomputing, 23:39–50, 2002.
I. Foster, C. Kesselman, and S. Tuecke. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications, 15:200–222, 2001.
S. Kohn. SAMRAI: Structured adaptive mesh refinement applications infrastructure. Technical report, Lawrence Livermore National Laboratory, 1999.
M. Lo and S. Dandamudi. Performance of hierarchical load sharing in heterogeneous distributed systems. In International Conference on Parallel and Distributed Computing Systems, Dijon, France, pp. 370–377, 1996.
P. MacNeice. Paramesh. URL: http://esdcd.gsfc.nasa.gov/ESS/macneice/paramesh/paramesh.html, 1999.
M. Parashar. GrACE. URL: http://www.caip.rutgers.edu/~parashar/TASSL/Projects/GrACE, 2003.
M. Parashar and J. Browne. On partitioning dynamic adaptive grid hierarchies. In 29th Annual Hawaii International Conference on System Sciences, pp. 604–613, January 1996.
R. Pollak. A hierarchical load balancing environment for parallel and distributed supercomputer. In International Symposium on Parallel and Distributed Supercomputing, Fukuoka, Japan, September 1995.
H. Sagan. Space Filling Curves, Springer-Verlag, 1994.
B. A. Shirazi, A. R. Hurson, and K. M. Kavi. Scheduling and load balancing in parallel and distributed systems, IEEE Computer Society Press, Los Alamitos, 1995.
J. Steensland. 1995. VAMPIRE. URL: http://www.tdb.uu.se/~johans/research/vampire/vampirel. html, 2000.
J. D. Teresco, M. W. Beall, J. E. Flaherty, and M. S. Shephard. A hierarchical partition model for adaptive finite element computation. Computer Methods in Applied Mechanics and Engineering, 184:269–285, 2000.
Rights and permissions
About this article
Cite this article
Li, X., Parashar, M. Hierarchical Partitioning Techniques for Structured Adaptive Mesh Refinement Applications. The Journal of Supercomputing 28, 265–278 (2004). https://doi.org/10.1023/B:SUPE.0000022099.81839.a3
Issue Date:
DOI: https://doi.org/10.1023/B:SUPE.0000022099.81839.a3