Skip to main content
Springer Nature Link
Log in

Towards Portable Runtime Support for Irregular and Out-of-Core Computations

  • Conference paper
  • First Online:
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1697))

  • 451 Accesses

Abstract

In this paper, we present the lip - a runtime system which enables easy and portable parallelization of irregular and out-of-core computations. Functions for handling irregular data were developed using the same concept as in the CHAOS library. Out-of-core parallelization is based on the idea of in-core section, and functions for out-of-core data are implemented with capabilities provided by MPI-IO. The new library may be used in C, Fortran and Java programs. Results of performance tests for a generic irregular out-of-core program on HP S2000 are presented and possible further extensions are discussed

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Brezany, P.: Input/Output Intensively Parallel Computing, LNCS 1220, Springer, Berlin Heildelberg New York (1997).

    Google Scholar 

  2. Saltz, J., et al.: A Manual for the CHAOS Runtime Library, UMIACS Technical Reports CS-TR-3437 and UMIACS-TR-95-34, University of Maryland; March 1995; ftp://hpsl.cs.umd.edu/pub/chaos_distribution

  3. Bubak, M., Łuszczek, P., and Wierzbowska, A.: Porting CHAOS Library to MPI. In Alexandrov, V., Dongarra, J., (eds.) Recent Advances in Parallel Virtual Machine and Message Passing Interface, Proc. 5th European PVM/MPI Users’ Group Meeting, Liverpool, UK, September 7–9, 1998, LNCS 1497, Springer, pp. 131–136.

    Chapter  Google Scholar 

  4. Moyer, S. and Sunderam, V.S.: Parallel I/O as a Parallel Application. International Journal of Supercomputer Applications, 9 (1995) 95–107.

    Article  Google Scholar 

  5. Seamons, K. E., Chen, Y., Jones, P., Jozwiak, J., and Winslett, M.: Server Directed Collective I/O in Panda. In Proc. Supercomputing’99, San Diego, California, December 1995, http://drl.cs.uiuc.edu/panda/

  6. Brezany, P., Mueck, T.A., and Schikuta, E.: A Software Architecture for Massively Parallel Input/Output. In Waśniewski. J., et al.: Applied Parallel Computing, Proc. PARA’96, Lyngby, August 1996, LNCS 1184, Springer, pp. 85–96.

    Google Scholar 

  7. Carretro, J., No, J., Park, S., Choudhary, A., and Chen, P.: COMPASSION: A Parallel I/O Runtime System Including Chunking and Compression for Irregular Applications. In: Sloot, P., Bubak, M., Hertzberger, B., (eds.): Proc. Int. Conf. High Performance Computing and Networking, Amsterdam, April 21–23, 1998, LNCS 1401, Springer, 1998, pp. 668–677.

    Chapter  Google Scholar 

  8. Message Passing Interface Forum: MPI-2: Extensions to the Message-Passing Interface, July 18, 1997; http://www.mpi-forum.org/docs/mpi-20.ps

  9. Saphir, W.: Porting Applications from NX to MPI. Talk presented at NAS on July 26, 1994, http://parallel.nas.nasa.gov/Parallel/Talks/nx2mpi/nx2mpi.html

  10. Bordawekar, R., Choudhary, A.: Issues in Compiling I/O Intensive Problems. In Jain, R., Werth, J., and Browne, J.C. (Eds.) Input/Output in Parallel and Distributed Computer Systems, chapter 3, pp. 69–96, Kluwer, 1996.

    Google Scholar 

  11. Brezany, P., Choudhary, A., and Dang, M.: Parallelization of Irregular Codes Including Out-of-Core Data and Index Arrays. In Proceedings of Parallel Computing 1997-PARCO’97, Bonn, Germany, September 1997, Elsevier, pp. 132–140.

    Google Scholar 

  12. Thakur, R., Gropp, W., and Lusk, E.: Data Sieving and Collective I/O in ROMIO. In Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, February 1999, pp. 182–189.

    Google Scholar 

  13. Thakur, R., Gropp, W., and Lusk, E.: A Case for Using MPI’s Derived Datatypes to Improve I/O Performance. In Proc. of SC98: High Performance Networking and Computing November 1998.

    Google Scholar 

  14. Thakur, R., Lusk, E., and Gropp, W.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Memorandum ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Revised July 1998; http://www.mcs.anl.gov/romio/

  15. MPICH-A Portable Implementation of MPI, http://www.mcs.anl.gov/mpi/mpich/

  16. Geist, A., et al.: PVM: Parallel Virtual Machine. A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, Massachusetts (1994)

    Google Scholar 

  17. Java Grande Forum, http://www.javagrande.org/

  18. LAM/MPI Parallel Computing: LAM/MPI Parallel Computing

    Google Scholar 

  19. Brezany, P., Winslett, M.: Advanced Data Repository Support for Java Scientific Programming In: Sloot, P., Bubak, M., Hoekstra, A., Hertzberger, B., (eds.): Proc. Int. Conf. High Performance Computing and Networking, Amsterdam, April 12–14, 1999, LNCS 1593, Springer, 1999, pp. 1127–1136.

    Chapter  Google Scholar 

  20. HP Java Project, http://www.npac.syr.edu/projects/pcrc/HPJava/

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059, Kraków, Poland

    Marian Bubak

  2. Academic Computer Centre - CYFRONET, Nawojki 11, 30-950, Kraków, Poland

    Marian Bubak & Piotr Łuszczek

Authors
  1. Marian Bubak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Piotr Łuszczek
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. OakRidge National Laboratory, University of Tennessee, 107, Ayres Hall, Knoxville, TN, 37996-1301, USA

    Jack Dongarra

  2. Computer Science Department Computer Architecture and Operating Systems Group, Universitat Autònoma of Barcelona, E-08193, Bellaterra, Barcelona, Spain

    Emilio Luque  & Tomàs Margalef  & 

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bubak, M., Łuszczek, P. (1999). Towards Portable Runtime Support for Irregular and Out-of-Core Computations. In: Dongarra, J., Luque, E., Margalef, T. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 1999. Lecture Notes in Computer Science, vol 1697. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48158-3_8

Download citation

  • DOI: https://doi.org/10.1007/3-540-48158-3_8

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-66549-6

  • Online ISBN: 978-3-540-48158-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics