Abstract
In this paper we present a systematic method for mapping systolizable problems onto Distributed Memory Multiprocessors. A systolizable problem is a problem for which it is possible to design a Systolic Algorithm. As a first stage, we design a Systolic Algorithm for the problem to be solved. Then, different transformations are applied to this Systolic Algorithm in order to adapt it to the available Distributed Memory Multiprocessor. One of these transformations is what we call band interleaving. This transformation which is the main contribution of this paper permits to increase the granularity of the parallel algorithm reducing in this way the communication requirements. We will show how the proposed transformations modify the original sequential code in order to obtain the parametrized code for each Processing Element of the Distributed Memory Multiprocessor. The method is illustrated with an example consisting in the design of a parallel algorithm to solve a triangular system of equations on a Distributed Memory Multiprocessor System with a ring topology. Some measurements of performance are presented for the case of a Transputer-based network.
This work has been supported by the Ministry of Education of Spain (CICYT) in program TIC 299/89, and ESPRIT PCA 4146.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
D.Callahan and K.Kennedy. "Compiling Programs for Distributed-Memory Multiprocessors". J.Supercomputing 2, october 1988, pp. 151–169, Kluwer Academic Publishers.
A.Fernández, J.M.Llaberia, J.J.Navarro, M.Valero-García and M.Valero. "On the Use of Systolic Algorithms for Programming Distributed Memory Multiprocessors", Proc. Int'l. Conference on Systolic Arrays, Prentice Hall, pp. 631.640, 1989.
J.A.B.Fortes and D.I.Moldovan. "Data Broadcasting in Linearly Scheduled Array Processors", Proc. 11th Int'l Annual Symp on Computer Architecture, pp. 224–231, 1984.
G. A. Geist and M. T. Heath. "Parallel Algorithms for Matrix Computations", The Characteristics of Parallel Algorithms, MIT 1987, pp. 233–251.
M. Heath and C. Romine. "Parallel Solution of RTriangular Systems on Distributed-Memory Multiprocessors", SIAM J. Sci. Stat. Comput. 9 (1988), pp. 558–588.
O.H. Ibarra and S.M. Sohn. "On Mapping Systolic Algorithms onto the Hypercube". Int'l Conf. on Parallel Processing, Vol.I, pp 121–124, 1989.
C.T. King, L.M. Ni, "Grouping in Nested Loops for Parallel Execution on Multicomputers", Int'l Conf. on Parallel Processing, Vol.II, pp 31–38, 1989.
H.T.Kung and C.E.Leiserson. "Systolic Arrays (for VLSI)", Sparse Matrix Proc. 1978, 1979, Society for Industrial and Applied Mathematics (SIAM), pp.256–282.
C.Lengauer. "Towards Systolizing Compilation: an Overview". Proc. Parallel Architectures and Languages Europe, PARLE'89. Lecture Notes in Computer Science 366, Springer-Verlag, pp. 253–272, 1989.
G. Li and T. Coleman. "A Parallel Triangular Solver for a Distributed-Memory Multiprocessor", SIAM J. Sci. Stat. Comput. 9 (1988), pp. 485–502.
D.I. Moldovan. "On the Design of Algorithms for VLSI Systolic Arrays", Proc. of the IEEE, vol 71, no. 1, 1983. pp. 113–120.
C. Moler. "Matrix Computation on Distributed Memory Multiprocessors", Hypercube Multiprocessors 1986, pp 181–195.
D. I. Moldovan and J. A. B. Fortes. "Partitioning and Mapping Algorithms into Fixed Size Systolic Arrays", IEEE Trans. on Computers, Vol. 35, no. 1, 1986, pp. 1–12.
P.Quinton. "Automatic Synthesis of Systolic Arrays from Uniform Recurrent Equations", 11th Int'l Annual Symp. on Computer Architecture, pp.208–214, 1984.
J.Ramanujan and P.Sadayappan. "A Methodology for Parallelizing Programs for Multicomputers and Complex Memory Multiprocessors", Supercomputing 89, pp 637–646, 1989.
J.Torres, E.Ayguade, J.Labarta, J.M.Llabería, M.Valero. "On Automatic Loop Data-Mapping for Distributed-Memory Multiprocessors", Proceedings of the 2nd European Distributed Memory Computers Conference, Springer-Verlag (in this volume), 1991.
V.VanDongen and P.Quinton. "Uniformization of Linear Recurrence Equations: a Step Towards the Automatic Synthesis of Systolic Arrays", Proc. Int'l Conf. on Systolic Arrays, pp. 473–482, 1988.
C. Whitty-Stevens. "The Transputer". Proc 12th Int'l Symp. of Computer Architecture, 1985, pp. 292–300.
Y.Won and J.M.Delosme. "Boadcast Removal in Systolic Algorithms", Proc Int'l Conf. on Systolic Arrays, pp. 403–412, 1988.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1991 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández, A., Liabería, J.M., Navarro, J.J., Valero-García, M. (1991). Interleaving partitions of systolic algorithms for programming distributed memory multiprocessors. In: Bode, A. (eds) Distributed Memory Computing. EDMCC 1991. Lecture Notes in Computer Science, vol 487. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032926
Download citation
DOI: https://doi.org/10.1007/BFb0032926
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-53951-3
Online ISBN: 978-3-540-46478-5
eBook Packages: Springer Book Archive