Skip to main content

Knowledge-based parallelization for distributed memory systems

  • Conference paper
  • First Online:
Parallel Computation (ACPC 1991)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 591))

Abstract

In current automatic parallelization systems for distributed-memory machines, the user must explicitly specify how the data domain of the sequential program is to be decomposed and distributed across the processors. In this paper, we outline the salient features of a new knowledge-based software tool that provides automatic support for data partitioning. The basic guidelines for the design of the tool are discussed, followed by a description of the adopted partitioning strategy.

The work described in this paper is being carried out as part of the research project “Virtual Shared Memory for Multiprocessor Systems with Distributed Memory” funded by the Austrian Research Foundation (FWF) under the grant number P7576-TEC. The authors assume all responsibility for the contents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alfred V. Aho, Ravi Sethi, Jeffrey D. Ullman: Compilers. Principles, Techniques and Tools Addison-Wesley, 1986

    Google Scholar 

  2. Pradup Bose: Heuristic Rule-Based Program Transformations for Enhanced Vectorization Proc. Int. Conf. on Parallel Processing, 1988

    Google Scholar 

  3. Pradup Bose: Interactive Program Improvement Via EAVE: An Expert Adviser for Vectorization Proc. International Conference on Supercomputing, St. Malo, July 1988

    Google Scholar 

  4. Vasanth Balasundaram: Interactive Parallelization of Numerical Scientific Programs Rice COMP TR89-95, July 1989

    Google Scholar 

  5. D. Callahan and K. Kennedy: Compiling programs for distributed-memory multiprocessors Journal of Supercomputing, 2(2), 151–69

    Google Scholar 

  6. Marina Chen, Young-il Choo, and Jingke Li: Theory and Pragmatics of Compiling Efficient Parallel Code YALEU/DCS/TR-760 December 1989

    Google Scholar 

  7. Fox, Johnson, Lyzenga, Otto, Salmon, Walker: Solving Problems On Concurrent Processors Vol. I 1988 Prentice-Hall International, Inc.

    Google Scholar 

  8. Gerndt, H.M.: Array Distribution in SUPERB Proc. ACM Int.Conf. on Supercomputing, Crete, 164–174 (Jun 1989)

    Google Scholar 

  9. H.M. Gerndt: Automatic Parallelization for Distributed-Memory Multiprocessing Systems Ph.D. Dissertation, University of Bonn, Technical Report Series ACPC/TR90-1, Austrian Center for Parallel Computation

    Google Scholar 

  10. Gerndt,H.M., Zima,H.: Optimizing Communication in SUPERB Technical Report Series ACPC/TR 90-3, Austrian Center for Parallel Computation (1990)

    Google Scholar 

  11. Manish Gupta, Prithviraj Banerjee: Automatic Data Partitioning on Distributed Memory Multiprocessors

    Google Scholar 

  12. Mehdi T. Harandi, Jim Q. Ning: Knowledge-Based Program Analysis IEEE Software, January 1990, 74–81

    Google Scholar 

  13. David E. Hudak and Santosh G. Abraham: Compiler Techniques for Data Partitioning of Sequentially Iterated Parallel Loops ACM Report 1990

    Google Scholar 

  14. Kathleen Knobe, Joan D. Lukas, Guy L. Steele: Data Optimization: Allocation of Arrays to Reduce Communication on SIMD Machines Journal of Parallel and Distributed Computing 8, 102–118 (1990)

    Article  Google Scholar 

  15. Kobos, VanKooten, Walker: The Myrias Computer System in Algorithms and Applications on Parallel and Vector Computers, 1987

    Google Scholar 

  16. Fung F. Lee: Partitioning of Regular Computation on Multiprocessor Systems Journal of Parallel and Distributed Computing 9, 312–317 (1990)

    Article  Google Scholar 

  17. Jingke Li, Marina Chen: Index Domain Alignment: Minimizing Cost of Cross-Referencing Between Distributed Arrays YALEU/DCS/TR-725 November 1989

    Google Scholar 

  18. Jingke Li and Marina Chen: Synthesis of Explicit Communication from Shared-Memory Program References YALEU/DCS/TR-755 May 1990

    Google Scholar 

  19. J. Ramanujam, P. Sadayappan: Compile-Time Techniques for Data Distribution in Distributed Memory Machines

    Google Scholar 

  20. Anne Rogers, Keshav Pingali: Process Decomposition Through Locality of Reference SIGPLAN 1989

    Google Scholar 

  21. K. Wang: An Experiment in Parallel Programming Environment: The Expert Systems Approach In: K.S. Fu (Ed.): Some Prototype Examples for Expert Systems, TR-EE-85-1, Electronic Engineering School, Purdue University, 1985, 591–624

    Google Scholar 

  22. K. Wang: A Framework for Intelligent Parallel Compilers Tech. Report CSD-TR-1044, CER-90-52, Dept. Computer Science, Purdue University, November, 1990

    Google Scholar 

  23. K. Wang and D. Gannon: Applying AI Techniques to Program Optimizations for Parallel Computers In: K.Hwang and D. DeGroot (Eds.): Parallel Processing for Supercomputers and Artificial Intelligence, McGraw-Hill, 1989, 441–485

    Google Scholar 

  24. Zima H.P., Bast H.-J. and Gerndt H.M.: SUPERB — a tool for semi-automatic MIMD/SIMD parallelization Parallel Computing, 6, 1–18 (1988)

    Article  Google Scholar 

  25. Zima H.P., Chapman B.: Supercompilers for Parallel and Vector Computers ACM Press Frontier Series, Addison-Wesley 1990

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Hans P. Zima

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chapman, B.M., Herbeck, H.M. (1992). Knowledge-based parallelization for distributed memory systems. In: Zima, H.P. (eds) Parallel Computation. ACPC 1991. Lecture Notes in Computer Science, vol 591. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-55437-8_72

Download citation

  • DOI: https://doi.org/10.1007/3-540-55437-8_72

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-55437-0

  • Online ISBN: 978-3-540-47073-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics