Abstract
Current virtual memory systems provided for scalable computer systems typically offer poor performance for scientific applications when an application’s working data set does not fit in main memory. As a result, programmers who wish to solve “out-of-core” problems efficiently typically write a separate version of the parallel program with explicit I/O operations. This task is onerous and extremely difficult if the application includes indirect data references. A promising approach is to develop a language support and a compiler system on top of an advanced runtime system which can automatically transform an appropriate in-core program to efficiently operate on out-of-core data. This approach is presented in this paper. Our proposals are discussed in the context of HPF and its compilation environment.
The work described in this paper is being carried out as part of the research project “Aurora” supported by the Austrian Research Foundation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
G. Bachler and R. Greimel. Parallel CFD in the Industrial Environment. UNICOM Seminars, London, 1994.
P. Brezany and V. Sipkova. Coupling Parallel Data and Work Partitioners to the Vienna Fortran Compilation System. In Proceedings of the Conference EUROSIM-HPCN Challenges 1996. North Holland, Elsevier, June 1996.
P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Out-of-Core Applications for Distributed-Memory Systems. Proc. of HCPN 97, Vienna, April 1997, Springer-Verlag, LNCS 1225.
P. Brezany, A. Choudhary, and M. Dang. Parallelization of Irregular Codes Including Out-of-Core Data and Index Arrays. In Proceedings of the conference “Parallel Computing 1997-PARCO’97”, North Holland, Elsevier, April 1998.
B. M. Chapman, P. Mehrotra, and H. P. Zima. Extending HPF for advanced data parallel applications. TR 94-7, Univ. of Vienna, 1994.
A. Choudhary, et al. PASSION: Parallel and Scalable Software for Input-Output. CRPC-TR94483, Rice University, Houston, 1994.
A. Choudhary, C. Koelbel, and K. Kennedy. Preliminary Proposal to Provide Support for OOC Arrays in HPF. Document of the HPFF, Sep. 7, 1995.
T. H. Cormen and A. Colvin. ViC*: A Preprocessor for Virtual-Memory C*. TR: PCS-TR94-243, Dept. of Computer Science, Dartmouth College, Nov. 1994.
C. Koelbel, P. Mehrotra, J. Saltz, and S. Berryman. Parallel Loops on Distributed Machines. In Proceedings of the 5th Distributed Memory Computing Conference, Charleston, pages 1097–1119, IEEE Comp. Soc. Press, April 1990.
M. Paleczny, K. Kennedy, and C. Koelbel. Compiler Support for Out-of-Core Arrays on Parallel Machines. In Proceedings of the 7th Symposium on the Frontiers of Massively Parallel Computation, McLean, VA, pages 110–118, February 1995.
R. Thakur, R. Bordawekar, and A. Choudhary. Compiler and Runtime Support for Out-of-Core HPF Programs. In Proceedings of the 1994 ACM International Conference on Supercomputing, pages 382–391, Manchester, July 1994.
R. Ponnusamy, et al. A Manual for the CHAOS Runtime Library. Technical Report, University of Maryland, May 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brezany, P., Choudhary, A., Dang, M. (1998). Language and Compiler Support for Out-of-Core Irregular Applications on Distributed-Memory Multiprocessors. In: O’Hallaron, D.R. (eds) Languages, Compilers, and Run-Time Systems for Scalable Computers. LCR 1998. Lecture Notes in Computer Science, vol 1511. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49530-4_25
Download citation
DOI: https://doi.org/10.1007/3-540-49530-4_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65172-7
Online ISBN: 978-3-540-49530-7
eBook Packages: Springer Book Archive