Skip to main content
Springer Nature Link
Log in

Language and Compiler Support for Out-of-Core Irregular Applications on Distributed-Memory Multiprocessors

  • Conference paper
  • First Online:
Languages, Compilers, and Run-Time Systems for Scalable Computers (LCR 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1511))

  • 245 Accesses

Abstract

Current virtual memory systems provided for scalable computer systems typically offer poor performance for scientific applications when an application’s working data set does not fit in main memory. As a result, programmers who wish to solve “out-of-core” problems efficiently typically write a separate version of the parallel program with explicit I/O operations. This task is onerous and extremely difficult if the application includes indirect data references. A promising approach is to develop a language support and a compiler system on top of an advanced runtime system which can automatically transform an appropriate in-core program to efficiently operate on out-of-core data. This approach is presented in this paper. Our proposals are discussed in the context of HPF and its compilation environment.

The work described in this paper is being carried out as part of the research project “Aurora” supported by the Austrian Research Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. G. Bachler and R. Greimel. Parallel CFD in the Industrial Environment. UNICOM Seminars, London, 1994.

    Google Scholar 

  2. P. Brezany and V. Sipkova. Coupling Parallel Data and Work Partitioners to the Vienna Fortran Compilation System. In Proceedings of the Conference EUROSIM-HPCN Challenges 1996. North Holland, Elsevier, June 1996.

    Google Scholar 

  3. P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Out-of-Core Applications for Distributed-Memory Systems. Proc. of HCPN 97, Vienna, April 1997, Springer-Verlag, LNCS 1225.

    Google Scholar 

  4. P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Codes Including Out-of-Core Data and Index Arrays. In Proceedings of the conference “Parallel Computing 1997-PARCO’97”, North Holland, Elsevier, April 1998.

    Google Scholar 

  5. B. M. Chapman, P. Mehrotra, and H. P. Zima. Extending HPF for advanced data parallel applications. TR 94-7, Univ. of Vienna, 1994.

    Google Scholar 

  6. A. Choudhary, et al. PASSION: Parallel and Scalable Software for Input-Output. CRPC-TR94483, Rice University, Houston, 1994.

    Google Scholar 

  7. A. Choudhary, C. Koelbel, and K. Kennedy. Preliminary Proposal to Provide Support for OOC Arrays in HPF. Document of the HPFF, Sep. 7, 1995.

    Google Scholar 

  8. T. H. Cormen and A. Colvin. ViC*: A Preprocessor for Virtual-Memory C*. TR: PCS-TR94-243, Dept. of Computer Science, Dartmouth College, Nov. 1994.

    Google Scholar 

  9. C. Koelbel, P. Mehrotra, J. Saltz, and S. Berryman. Parallel Loops on Distributed Machines. In Proceedings of the 5th Distributed Memory Computing Conference, Charleston, pages 1097–1119, IEEE Comp. Soc. Press, April 1990.

    Google Scholar 

  10. M. Paleczny, K. Kennedy, and C. Koelbel. Compiler Support for Out-of-Core Arrays on Parallel Machines. In Proceedings of the 7th Symposium on the Frontiers of Massively Parallel Computation, McLean, VA, pages 110–118, February 1995.

    Google Scholar 

  11. R. Thakur, R. Bordawekar, and A. Choudhary. Compiler and Runtime Support for Out-of-Core HPF Programs. In Proceedings of the 1994 ACM International Conference on Supercomputing, pages 382–391, Manchester, July 1994.

    Google Scholar 

  12. R. Ponnusamy, et al. A Manual for the CHAOS Runtime Library. Technical Report, University of Maryland, May 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Software Technology and Parallel Systems, University of Vienna, Liechtensteinstrasse 22, A-1090, Vienna, EM

    Peter Brezany & Minh Dang

  2. ECE Department, Northwestern University, Evanston, EM

    Alok Choudhary

Authors
  1. Peter Brezany
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alok Choudhary
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Minh Dang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computer Science and Electrical and Computer Engineering School of Computer Science, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA, 15213-3891, USA

    David R. O’Hallaron

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brezany, P., Choudhary, A., Dang, M. (1998). Language and Compiler Support for Out-of-Core Irregular Applications on Distributed-Memory Multiprocessors. In: O’Hallaron, D.R. (eds) Languages, Compilers, and Run-Time Systems for Scalable Computers. LCR 1998. Lecture Notes in Computer Science, vol 1511. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49530-4_25

Download citation

  • DOI: https://doi.org/10.1007/3-540-49530-4_25

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65172-7

  • Online ISBN: 978-3-540-49530-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation