Abstract
Existing automatic parallelizers for distributed-memory machines require the user to explicitly specify how the data of the sequential program is mapped to the processors of the target machine. In this paper, we outline the features of a software tool to provide automatic support for this task. The tool is being implemented within the Vienna Fortran Compilation System using a combination of both analytical and heuristic methods.
The work described in this paper was carried out as part of the research project ”Virtual Shared Memory for Multiprocessor Systems with Distributed Memory” funded by the Austrian Research Foundation (FWF) under the grant number P7576-TEC. The authors assume all responsibility for the contents.
Preview
Unable to display preview. Download preview PDF.
References
V. Balasundaram, G. Fox, K. Kennedy, and U. Kremer: An Interactive Environment for Data Partitioning and Distribution. Proc. DMCC5, Mar 1990, 1160–1170
V. Balasundaram and K. Kennedy: A Technique for Summarizing Data Access and its Use in Parallelism Enhancing Transformations. SIGPLAN '89 Conf. Programming Language Design and Implementation, 1989, 43–53
Benkner,S., Chapman,B.M., Zima,H.P.: Vienna Fortran 90. Proc. Scalable High Performance Computing Conference, Williamsburg, April 1992, 51–59
B. Chapman, H. Herbeck and H. Zima: Automatic Support for Data Distribution. Proc. Sixth Distributed Memory Computing Conference, Portland, 51–58
B. Chapman, P. Mehrotra and H. Zima: Vienna Fortran — A Fortran Language Extension for Distributed Memory Multiprocessors. In: J. Saltz, P. Mehrotra (Eds): Compilers and Runtime Software for Scalable Multiprocessors, Elsevier, Amsterdam (1991)
B. Chapman, P. Mehrotra and H. Zima: Vienna Fortran. Scientific Programming, 1(1), Wiley, August 1992
Marina Chen, Young-il Choo, and Jingke Li: Theory and Pragmatics of Compiling Efficient Parallel Code. YALEU/DCS/TR-760, December 1989
N.P. Chrisochoides, C.E. Houstis, E.N. Houstis, P.N. Papachiou, S.K. Kortesis and J.R. Rice: DOMAIN DECOMPOSER: A Software Tool for Mapping PDE Computations to Parallel Architectures. Domain Decomposition Methods for Differential Equations, SIAM, 341–357, 1991.
T. Fahringer: A Static Parameter Based Performance Prediction Tool for Parallel Programs for Distributed Memory Systems, Invited Paper, 7th ACM Int. Conf. on Supercomputing, Tokyo, 1993
T. Fahringer and C. Huber: The Weight Finder, A Profiler for Fortran 77 Programs. Tech. Report, Dept. of Computer Science, University of Vienna, Sep. 1992
G. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker: Solving Problems On Concurrent Processors Vol. I. 1988 Prentice-Hall International, Inc.
H.M. Gerndt: Array Distribution in SUPERB. Proc. ACM Int.Conf. on Supercomputing, Crete,164–174 (Jun 1989)
H.M. Gerndt: Automatic Parallelization for Distributed-Memory Multiprocessing Systems. Ph.D. Dissertation, University of Bonn, Also: ACPC/TR90-1, Austrian Center for Parallel Computation
H.M. Gerndt, and H.P. Zima: Optimizing Communication in SUPERB. Proc. Conpar 90 — VAPP IV, LNCS 457, 300–311
Manish Gupta, and Prithviraj Banerjee: Automatic Data Partitioning on Distributed Memory Multiprocessors. UILU-ENG-90-2248, Coordinated Science Lab., University of Illinois
Manish Gupta and Prithviraj Banerjee: Demonstration of Automatic Data Partitioning Techniques for Parallelizing Compilers for Multicomputers. IEEE Transactions on Parallel and Distributed Systems, 3(2), 179–193, March 1992
Manish Gupta: Automatic Data Partitioning on Distributed Memory Multicomputers. Ph.D. Thesis, University of Illinois at Urbana-Champaign, UILu-ENG-92-2237, Coordinated Science Lab, University of Illinois, 1992
Michael Hind: Full Interprocedural Dependence Analysis. Tech. Report, IBM T.J. Watson Research Center, 1992 (to appear)
David E. Hudak and Santosh G. Abraham: Compiler Techniques for Data Partitioning of Sequentially Iterated Parallel Loops. Proc. ACM Int. Conf. on Supercomputing, 187–200 (1990)
Kathleen Knobe, Joan D. Lukas, and Guy L. Steele: Data Optimization: Allocation of Arrays to Reduce Communication on SIMD Machines. Journal of Parallel and Distributed Computing 8, 102–118 (1990)
Fung F. Lee: Partitioning of Regular Computation on Multiprocessor Systems. Journal of Parallel and Distributed Computing 9, 312–317 (1990)
Jingke Li, and Marina Chen: Index Domain Alignment: Minimizing Cost of Cross-Referencing Between Distributed Arrays. YALEU/DCS/TR-725 November 1989
Jingke Li, and Marina Chen: Synthesis of Explicit Communication from Shared-Memory Program References. YALEU/DCS/TR-755 May 1990
Zhiyuan Li and Pen-Chuang Yew: Interprocedural Analysis for Parallel Computing. In Int. Conf. on Parallel Processing, Vol 2, 221–228, 1988
M. Mace: Globally Optimal Selection of Memory Storage Patterns. Ph.D. Thesis, Duke University, Durham, USA, May 1983
J. Ramanujam: Compile-time Techniques for Parallel Execution of Loops on Distributed Memory Multiprocessors. TR-90-09-01, Dept. Electrical and Comp. Engineering, Louisiana State University (1990)
J. Ramanujam, and P. Sadayappan: Compile-Time Techniques for Data Distribution in Distributed Memory Machines. TR-90-09-03, Dept. Electrical and Comp. Engineering, Louisiana State University (Sept. 1990)
H. P. Zima, P. Brezany, B. Chapman, P. Mehrotra and A. Schwald: Vienna Fortran — A Language Specification Version 1.1. Technical Report ACPC/TR 92-4, (March 1992). Also: ICASE Interim Report 21, NASA Langley Research Center, Hampton, March 1992
H.P. Zima, H.-J. Bast, and H.M. Gerndt: SUPERB — a Tool for Semi-Automatic MIMD/SIMD Parallelization. Parallel Computing, 6, 1–18 (1988)
H.P. Zima, and B. Chapman: Supercompilers for Parallel and Vector Computers. ACM Press Frontier Series, Addison-Wesley 1990
H. P. Zima, and B. Chapman: Compiling for Distributed-Memory Systems. Invited paper, Proceedings of the IEEE, Special Section on Languages and Compilers for Parallel Machines, February 1993
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1994 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chapman, B.M., Fahringer, T., Zima, H.P. (1994). Automatic support for data distribution on distributed memory multiprocessor systems. In: Banerjee, U., Gelernter, D., Nicolau, A., Padua, D. (eds) Languages and Compilers for Parallel Computing. LCPC 1993. Lecture Notes in Computer Science, vol 768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57659-2_11
Download citation
DOI: https://doi.org/10.1007/3-540-57659-2_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-57659-4
Online ISBN: 978-3-540-48308-3
eBook Packages: Springer Book Archive