Skip to main content
Springer Nature Link
Log in

Advanced Library Support for Irregular and Out-of-Core Parallel Computing

  • Conference paper
  • First Online:
High-Performance Computing and Networking (HPCN-Europe 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2110))

Included in the following conference series:

Abstract

Large scale irregular applications involve data arrays and other data structures that are too large to fit in main memory and hence reside on disks; such applications are called out-of-core applications. We present a design and implementation of lip, a new parallel library that is intended to efficiently support parallel execution of irregular out-of-core codes on parallel systems. We discuss the lip structure and application interface, as well as an application that has been implemented using that interface. The library has been implemented on top of MPI/MPI-IO and, therefore, is fully portable.We introduce preliminary performance results from a template CFD codes to demonstrate the efficacy of the presented techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. R. Bordawekar, A. Choudhary. Issues in Compiling I/O Intensive Problems. In: R. Jain, J. Werth, J. Browne (eds.) Input/Output in Parallel and Distributed Computer Systems, Kluwer Academic Publ., 1996, pp. 69–96.

    Google Scholar 

  2. P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Out-of-Core Applications for Distributed-Memory Systems. Proceedings of HCPN 97, Vienna, April 1997, Springer-Verlag, LNCS 1225.

    Google Scholar 

  3. P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Codes Including Out-of-Core Data and Index Arrays, “Parallel Computing 1997-PARCO’97”, Bonn, Germany, September 1997.

    Google Scholar 

  4. P. Brezany, V. Sipkova, B. Chapman, R. Griemel Automatic Parallelization of the AVL FIRE Benchmark for a Distributed-Memory System In: PARA’95, Lyngby, Denmark, Springer Verlag, LNCS 1041, pp. 50–60.

    Google Scholar 

  5. M. Bubak, P. OLuszczek, Towards Portable Runtime Support for Irregular and Outof-Core Computations. In: J. Dongarra, E. Luque, T. Margalef, (Eds.), Proceedings of 6th European PVM/MPI Users’ Group Meeting, Barcelona, Spain, September 1999, LNCS 1697, Springer-Verlag Berlin-Heidelberg, 1999, pp. 59–66.

    Google Scholar 

  6. M. Bubak, P. OLuszczek, M. Malawski, K. Zając, Irregular and Out-of-Core Computing on SGI Origin 2000 in: Proceedings of 1st SGI Users Conference, Cracow, Poland, October 2000, ACC Cyfronet UMM, 2000, pp. 185–193.

    Google Scholar 

  7. A. Choudhary, et al. PASSION: Parallel and Scalable Software for Input-Output. CRPC-TR94483, Rice University, Houston, 1994.

    Google Scholar 

  8. T.H. Cormen and A. Colvin. ViC*: A Preprocessor for Virtual-Memory C*. TR: PCS-TR94-243, Dept. of Computer Science, Dartmouth College, Nov. 1994.

    Google Scholar 

  9. C. Koelbel, P. Mehrotra, J. Saltz, and S. Berryman. Parallel Loops on Distributed Machines. In Proceedings of the 5th Distributed Memory Computing Conference, Charleston, pages 1097–1119, IEEE Comp. Soc. Press, April 1990.

    Google Scholar 

  10. C.-W. Ou and S. Ranka SPRINT: Scalable Partitioning, Refinement, and Incremental partitioning Techniques. http://www.npac.syr.edu/projects/~pcrc/maryland/.

  11. J. Nieplocha and I. Foster. Disk Resident Arrays: An Array-Oriented I/O Library for Out-Of-Core Computations. In Proc. of the Sixth Symposium on the Frontiers of Massively Parallel Computation, IEEE Press, October 1996, pp. 196–204.

    Google Scholar 

  12. M. Paleczny, K. Kennedy, and C. Koelbel. Compiler Support for Out-of-Core Arrays on Parallel Machines. In Proceedings of the 7th Symposium on the Frontiers of Massively Parallel Computation, McLean, VA, pages 110–118, February 1995.

    Google Scholar 

  13. R. Ponnusamy et al. CHAOS runtime library. Techn. Report, University of Maryland, May 1994.

    Google Scholar 

  14. R. Thakur, R. Bordawekar, and A. Choudhary. Compiler and Runtime Support for Out-of-Core HPF Programs. In Proceedings of the 1994_ACM International Conference on Supercomputing, pages 382–391, Manchester, July 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Software Science, University of Vienna, Liechtensteinstrasse 22, A, 1090, Vienna, Austria

    Peter Brezany

  2. Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059, Kraków, Poland

    Marian Bubak, Maciej Malawski & Katarzyna Zając

  3. Academic Computer Centre - CYFRONET, Nawojki 1, 30-950, Kraków, Poland

    Marian Bubak

Authors
  1. Peter Brezany
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marian Bubak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maciej Malawski
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Katarzyna Zając
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Mathematics, Computer Science, Physics,and Astronomy, University of Amsterdam, Kruislaan 403, 1098, SJ, Amsterdam, The Netherlands

    Bob Hertzberger  & Alfons Hoekstra  & 

  2. California Institute of Technology, Caltech 158-79, Pasadena, CA, 91125, USA

    Roy Williams

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brezany, P., Bubak, M., Malawski, M., Zając, K. (2001). Advanced Library Support for Irregular and Out-of-Core Parallel Computing. In: Hertzberger, B., Hoekstra, A., Williams, R. (eds) High-Performance Computing and Networking. HPCN-Europe 2001. Lecture Notes in Computer Science, vol 2110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48228-8_44

Download citation

  • DOI: https://doi.org/10.1007/3-540-48228-8_44

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42293-8

  • Online ISBN: 978-3-540-48228-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation