Skip to main content

Program analysis of overlap area usage in self-similar parallel programs

  • Data Locality
  • Conference paper
  • First Online:
Languages and Compilers for Parallel Computing (LCPC 1997)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1366))

Abstract

Highly parallel computers have the memory capacity and potential speed to perform very high-resolution time-dependent calculations. Parallel computers with hundreds of fast processors require highly scalable algorithms to avoid wasting expensive resources. On these machines careful attention must be given to program design to fully exploit scalable algorithms. We have proposed a programming model that can express a class of scalable algorithms. In this paper we show how compiler analysis can ease the task of writing programs within this programming model. We have used this programming model manually and have achieved good results in reducing communication and synchronization overhead. We describe early results of a prototype compiler transformation tool called TOPAZ that applies this analysis to real programs.

This work was supported by the Office of Naval Research under grant no. N0001494-1-0846 and by the National Science Foundation under grant no. ASC-9523480.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Saman P. Amarasinghe, Jennifer M. Anderson, Christopher S. Wilson, Shih-Wei Liao, Brian R. Murphy, Robert S. French, Monica S. Lam, and Mary W. Hall. Multiprocessors from a Software Perspective. IEEE Micro, pages 52-61, June 1996.

    Google Scholar 

  2. Bèatrice Creusillet and François Irigoin. Interprocedural Array Region Analyses. International Journal of Parallel Programming, 24(6):513–546, 1996.

    Google Scholar 

  3. R. Bleck, C. Rooth, D. Hu, and L. Smith. Salinity-driven thermocline transients in a wind-and thermohaline-forced isopycnic coordinate model of the North Atlantic. Journal of Physical Oceanography, 22(12):1486–1505, 1992.

    Google Scholar 

  4. Rainer Bleck and Eric Chassignet. Simulating the oceanic circulation with isopycnic-coordinate models. In S. K. Majumdar and E. W. Miller, editors, The Oceans: Physical-Chemical Dynamics and Human Impact, chapter 2, pages 17–39. Pennsylvania Acad. Sci., 1994.

    Google Scholar 

  5. Rainer Bleck, Sumner Dean, Matthew O'Keefe, and Aaron Sawdey. A comparison of data-parallel and message-passing versions of the Miami Isopycnic Coordinate Ocean Model (MICOM). Parallel Computing, 21(10):1695–1720, 1995.

    Google Scholar 

  6. A. F. Blumberg and G. L. Mellor. A description of a three-dimensional costal ocean circulation model. In N. Heaps, editor, Three-Dimensional Costal Ocean Models, volume 4, page 208. American Geophysical Union, 1987.

    Google Scholar 

  7. Zeki Bozkus, Alok Choudhary, Geoffrey Fox, Tomasz Haupt, and Sanjay Ranka. A Compilation Approach for Fortran 90D/HPF Compilers. In Languages and Compilers for Parallel Computing, 1993.

    Google Scholar 

  8. P. Colella and P. R. Woodward. The piecewise parabolic method (PPM) for gasdynamical simulations. Journal of Computational Physics, 54:174–201, 1984.

    Google Scholar 

  9. Ron Cytron, Jeanne Ferrante, Barry K. Rosen, Mark N. Wegman, and F. Kenneth Zadeck. Efficiently computing static single assignment form and the control dependence graph. ACM Transactions on Programming Languages and Systems, 13(4):451–490, Oct 1991.

    Google Scholar 

  10. S.I. Feldman, David M. Gay, Mark W. Maimone, and N.L. Schryer. A Fortran-to-C Converter. Computer Science Technical Report 149, AT&T Bell Laboratories, March 1995. See http://vvv.netlib.org/f2c/.

    Google Scholar 

  11. Richard Friedman, Dennis Goodrow, John Levesque, Scott Peter, and Roni Sawdayi. FORGExplorer DMP User's Guide. Applied Parallel Research, October 1995.

    Google Scholar 

  12. Mary W. Hall, Jennifer M. Anderson, Saman P. Amarasinghe, Brian R. Murphy, Shih-Wei Liao, Edouard Bugnion, and Monica S. Lam. Maximizing Multiprocessor Performance with the SUIF Compiler. Computer, pages 84–89, December 1996.

    Google Scholar 

  13. High Performance Fortran Forum. High Performance Fortran language specification. Scientific Programming, 2(1–2):1–170, 1993.

    Google Scholar 

  14. Seema Hiranandani, Ken Kennedy, Chau-Wen Tseng, and Scott Warren. The D Editor: A New Interactive Parallel Programming Tool. In Proceedings of Supercomputing '94, 1994.

    Google Scholar 

  15. Ken Kennedy, John Mellor-Crummey, and Gerald Roth. Optimizing Fortran 90 Shift Operations on Distributed-Memory Multicomputers. In Languages and Compilers for Parallel Computing, number 1033 in Lecture Notes in Computer Science. Springer-Verlag, August 1995.

    Google Scholar 

  16. Clyde P. Kruskal and Alan Weiss. Allocating Independent Subtasks on Parallel Processors. IEEE Transactions on Software Engineering, SE-11(10), October 1985.

    Google Scholar 

  17. T. N. Nguyen, J. Gu, and Z. Li. An Interprocedural Parallelizing Compiler and Its Support for Memory Hierarchy Research. In Languages and Compilers for Parallel Computing, number 1033 in Lecture Notes in Computer Science. Springer-Verlag, August 1995.

    Google Scholar 

  18. Matthew O'Keefe, Terence Parr, Steven Anderson, B. Kevin Edgar, Paul Woodward, and Henry Dietz. The Fortran-P Translator: Towards Automatic Translation of Fortran 77 Programs for Massively Parallel Processors. Scientific Programming, 4(1):1–21, 1995.

    Google Scholar 

  19. Terence Parr. SORCERER-A Source-to-Source Translator Generator. Technical Report 93-088, AHPCRC, University of Minnesota, September 1993.

    Google Scholar 

  20. Terence Parr and Russell Quong. ANTLR: a predicated-LL(k) parser generator. Software-Practice and Experience, 25(7):789–810, 1995.

    Google Scholar 

  21. Bernardo Rodriguez, Leslie Hart, and Tom Henderson. A Library for the Portable Parallelization of Operational Weather Forecast Models. In Gerad-R. Hoffmann and Norbert Kreitz, editors, Proceedings of the Sixth ECMWF Workshop on the Use of Parallel Processors in Meteorology: Coming of Age, pages 148–161, 1995.

    Google Scholar 

  22. Aaron Sawdey, Matthew O'Keefe, and Rainer Bleck. The Design, Implementation, and Performance of a Parallel Ocean Circulation Model. In Geerd-R. Hoffmann and Norbert Kreitz, editors, Proceedings of the Sixth ECMWF Workshop on the Use of Parallel Processors in Meteorology: Coming of Age, pages 523–550, 1995.

    Google Scholar 

  23. Aaron Sawdey, Matthew O'Keefe, and Wesley B. Jones. A General Programming Model for Developing Scalable Ocean Circulation Applications. In Proceedings of the Seventh ECMWF Workshop on the Use of Parallel Processors in Meteorology, 1997.

    Google Scholar 

  24. Karl Solchenbach. Grid applications on distributed memory architectures: Implementation and evaluation. Parallel Computing, 7(3):341–56, 1988.

    Google Scholar 

  25. Michael Wolfe. High Performance Compilers for Parallel Computing. AddisonWesley Publishing Company, 1996.

    Google Scholar 

  26. Paul R. Woodward. Piecewise-Parabolic Methods for Astrophysical Fluid Dynamics. In K. H. A. Winkler and M. L. Norman, editors, Astrophysical Radiation Hydrodynamics, pages 245–326. D. Reidel Publishing Company, 1986.

    Google Scholar 

  27. Paul R. Woodward, July 1997. Personal communication.

    Google Scholar 

  28. Hans P. Zima, Heinz-J. Bast, and Michael Gerndt. SUPERB: A tool for semiautomatic MIMD/SIMD parallelization. Parallel Computing, 6(1):1–18, 1988.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Zhiyuan Li Pen-Chung Yew Siddharta Chatterjee Chua-Huang Huang P. Sadayappan David Sehr

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sawdey, A., O'Keefe, M. (1998). Program analysis of overlap area usage in self-similar parallel programs. In: Li, Z., Yew, PC., Chatterjee, S., Huang, CH., Sadayappan, P., Sehr, D. (eds) Languages and Compilers for Parallel Computing. LCPC 1997. Lecture Notes in Computer Science, vol 1366. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032685

Download citation

  • DOI: https://doi.org/10.1007/BFb0032685

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64472-9

  • Online ISBN: 978-3-540-69788-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics