Skip to main content
SpringerLink
Log in

OpenMP Runtime Support for Clusters of Multiprocessors

  • Conference paper
  • First Online:
OpenMP Shared Memory Parallel Programming (WOMPAT 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2716))

Included in the following conference series:

Abstract

This paper presents a prototype runtime system, providing support at the backend of the NANOS OpenMP compiler, that enables the execution of unmodified OpenMP Fortran programs on both SMPs and clusters of multiprocessors, either through the hybrid programming model (MPI+OpenMP) or directly on top of Software Distributed Shared Memory (SDSM). The latter is feasible by adopting a share-everything approach for the generated by the OpenMP compiler code, which corresponds to the “default shared” philosophy of OpenMP. Specifically, the user-level thread stacks and the Fortran common blocks are allocated explicitly, though transparently to the programmer, in shared memory. The management of the internal runtime system structures and of the forkjoin multilevel parallelism is based on explicit communication, exploiting however the shared-memory hardware of the available SMP nodes whenever this is possible. The modular design of the runtime system allows the integration of existing unmodified SDSM libraries, despite their design for SPMD execution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. E. Ayguadé, J. Labarta, X. Martorell, N. Navarro, and J. Oliver, NanosCompiler: A Research Platform for OpenMP Extensions, In Proceedings of the 1st European Workshop on OpenMP, Lund (Sweden), October 1999.

    Google Scholar 

  2. V.K. Barekas, P.E. Hadjidoukas, E.D. Polychronopoulos, and T. S. Papatheodorou, An OpenMP Implementation for Multiprogrammed SMPs, In Proceedings of the 3st European Workshop on OpenMP, Barcelona, Spain, August 2001.

    Google Scholar 

  3. A. Basumallik, S.J. Min, and R. Eigenmann, Towards OpenMP Execution on Software Distributed Shared Memory Systems, In Proceedings of the International Workshop on OpenMP: Experiences and Implementations (WOMPEI’02), Lecture Notes in Computer Science, #2327, Springer Verlag, May 2002.

    Google Scholar 

  4. J.M. Bull, Measuring Synchronization and Scheduling Overheads in OpenMP, In Proceedings of the 1st European Workshop on OpenMP, Lund, Sweden, October 1999.

    Google Scholar 

  5. F. Cappello, O. Richard, and D. Etiemble, Investigating the performance of two programming models for clusters of SMP PCs, In Proceedings of the 6th IEEE Symposium On High-Performance Computer Architecture (HPCA-6), Toulouse, France, January 2000.

    Google Scholar 

  6. R. Friedman, M. Goldin, A. Itzkovitz, and A. Schuster, Millipede: Easy Parallel Programming in Available Distributed Environments, Journal of Software: Practice and Experience, 27(8): 929–965, August 1997.

    Article  Google Scholar 

  7. P.E. Hadjidoukas, E.D. Polychronopoulos, and T.S. Papatheodorou, Integrating MPI and the Nanothreads Programming Model, In Proceedings of the 10th Euromicro Workshop on Parallel, Distributed and Network-Based Processing (PDP 2002), Las Palmas, Spain, January 2002.

    Google Scholar 

  8. P.E. Hadjidoukas, E.D. Polychronopoulos, and T.S. Papatheodorou, Runtime Support for Multigrain and Multiparadigm parallelism, In Proceedings of the 10th International Conference on High Performance Computing (HIPC’ 02), Bangalore, India, December 2002.

    Google Scholar 

  9. P.E. Hadjidoukas, E.D. Polychronopoulos, and T.S. Papatheodorou, Implementing the Nanothreads Programming Model on top of the POSIX Threads API, In Proceedings of the 20th IASTED Applied Informatics International Conference, Innsburg, Austria, February 2002.

    Google Scholar 

  10. C. Hu, H. Lu, A. Cox, and W. Zwaenepoel, OpenMP for Networks of SMPs, In Proceedings of the Second Merged Symposium, IPPS/SPDP 99, 1999.

    Google Scholar 

  11. W.W. Hu, W.S. Shi, and Z.M. Tang, JIAJIA: An SVM System Based on A New Cache Coherence Protocol, In Proceedings of the High Performance Computing and Networking (HPCN’99), April 1999.

    Google Scholar 

  12. Intel Corporation, Intel Fortran Compiler, Available at: http://developer.intel.com.

  13. P. Jamieson, and A. Bilas, CableS: Thread Control and Memory System Extensions for Shared Virtual Memory Clusters, In Proceedings of the Workshop on OpenMP Applications and Tools. Purdue University, West Lafayette, Indiana. July 2001.

    Google Scholar 

  14. Y. Jegou, Controlling Distributed Shared Memory Consistency from High Level Programming Languages, In Proceedings of Parallel and Distributed Processing, IPDPS 2000 Workshops, pages 293–300, May 2000.

    Google Scholar 

  15. H. Jin, M. Frumkin, and J. Yan, The OpenMP Implementation of NAS Parallel Benchmarks and its Performance, Technical Report NAS-99-011, NASA Ames Research Center, October 1999.

    Google Scholar 

  16. S. Karlsson and M. Bronsson, A Fully Compliant OpenMP implementation on Software Distributed Shared Memory, In Proceedings of the 10th International Conference on High Performance Computing (HIPC’ 02), Bangalore, India, December 2002.

    Google Scholar 

  17. X. Martorell, J. Labarta, N. Navarro, and E. Ayguad’e, A Library Implementation of the Nano-Threads Programming Model, In Proceedings of the 2nd Euro-Par Conference, Lyon, pp. 644–649, August 1996.

    Google Scholar 

  18. Message Passing Interface Forum, MPI: A message-passing interface standard, International Journal of Supercomputer Applications and High Performance Computing, Volume 8, Number 3/4, 1994.

    Google Scholar 

  19. MPI Software Technology, Inc., http://www.mpi-softtech.com.

  20. S.J. Min, S.W. Kim, M. Voss, S.I. Lee, and R. Eigenmann, Portable Compilers for OpenMP, In Proceedings of WOMPAT 2001, Workshop on OpenMP Applications and Tools, Lecture Notes in Computer Science, 2104, pages 11–19, July 2001.

    Google Scholar 

  21. NANOS ESPRIT Project No. 21097, http://research.ac.upc.es/nanos.

  22. OpenMP Architecture Review Board, OpenMP Specifications, Available at: http://www.openmp.org.

  23. S.M. Paas, M. Dormanns, T. Bemmerl, K. Scholtyssik, and S. Lankes, Computing on a Cluster of PCs: Project Overview and Early Experiences, In Proceedings of the 1st Workshop on Cluster-Computing, TU Chemnitz-Zwickau, November 1997.

    Google Scholar 

  24. C.D. Polychronopoulos, Nano-Threads: Compiler Driven Multithreading, In Proceedings of the 4th International Workshop on Compilers for Parallel Computing CPC’93, Delft (The Netherlands), December 1993.

    Google Scholar 

  25. POP (Performance Portability of OpenMP) IST/FET project (IST-2001-33071), http://www.cepba.upc.es/pop.

  26. M. Sato, S. Satoh, K. Kusano, and Y. Tanaka, Design of OpenMP compiler for an SMP Cluster, In Proceedings of the 1st European Workshop on OpenMP, Lund (Sweden), October 1999.

    Google Scholar 

  27. R. Stets, S. Dwarkadas, N. Hardavellas, G. Hunt, L. Kontothanassis, S. Parthasarathy, and M. Scott, Cashmere-2L: Software Coherent Shared Memory on a Clustered Remote-Write Network, In Proceedings of the 16th ACM Symposium on Operating Systems Principles (SOSP-16). October 1997.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. High Performance Information Systems Laboratory (HPCLAB), Department of Computer Engineering and Informatics, University of Patras, Rio, 26500, Patras, Greece

    Panagiotis E. Hadjidoukas, Eleftherios D. Polychronopoulos & Theodore S. Papatheodorou

Authors
  1. Panagiotis E. Hadjidoukas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eleftherios D. Polychronopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Theodore S. Papatheodorou
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, 10 King’s College Road, Toronto, Ontario, M5S 3G4, Canada

    Michael J. Voss

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hadjidoukas, P.E., Polychronopoulos, E.D., Papatheodorou, T.S. (2003). OpenMP Runtime Support for Clusters of Multiprocessors. In: Voss, M.J. (eds) OpenMP Shared Memory Parallel Programming. WOMPAT 2003. Lecture Notes in Computer Science, vol 2716. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45009-2_15

Download citation

  • DOI: https://doi.org/10.1007/3-540-45009-2_15

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40435-4

  • Online ISBN: 978-3-540-45009-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation