Abstract
In parallel programs with large out-of-core arrays stored in files, it is necessary to read/write smaller sections of the arrays from/to files. We describe a runtime method for accessing sections of out-of-core arrays efficiently. This method, called the extended two-phase method, uses collective I/O in which processors cooperate to read/write out-of-core data in an efficient manner. The I/O workload is divided among processors dynamically, depending on the access requests. Performance results on the Intel Touchstone Delta show that the extended two-phase method performs considerably better than a direct method for different access patterns, array sizes, and number of processors. We have used the extended two-phase method in the PASSION runtime library for parallel I/O.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Applications Working Group of the Scalable I/O Initiative. Preliminary Survey of I/O Intensive Applications. Scalable I/O Initiative Working Paper Number 1. On World-Wide Web at http://www.ccsf.caltech.edu/SIO/SIO_apps.ps, 1994.
R. Bordawekar, A. Choudhary, and J. del Rosario. An Experimental Performance Evaluation of Touchstone Delta Concurrent File System. In Proceedings of the 7 th ACM International Conference on Supercomputing, July 1993.
R. Bordawekar, J. del Rosario, and A. Choudhary. Design and Evaluation of Primitives for Parallel I/O. In Proceedings of Supercomputing’93, pages 452–461, November 1993.
P. Corbett, D. Feitelson, Y. Hsu, J. Prost, M. Snir, S. Fineberg, B. Nitzberg, B. Traversat, and P. Wong. MPI-IO: A Parallel I/O Interface for MPI, Version 0.3. Technical Report NAS-95-002, NASA Ames Research Center, January 1995.
P. Corbett, D. Feitelson, J. Prost, and S. Baylor. Parallel Access to Files in the Vesta File System. In Proceedings of Supercomputing’93, pages 472–481, November 1993.
E. DeBenedictis and J. del Rosario. nCUBE Parallel I/O Software. In Proceedings of 11 th International Phoenix Conference on Computers and Communications, pages 117–124, April 1992.
J. del Rosario, R. Bordawekar, and A. Choudhary. Improved Parallel I/O via a Two-Phase Runtime Access Strategy. In Proceedings of the Workshop on I/O in Parallel Computer Systems at IPPS’93, pages 56–70, April 1993.
J. del Rosario and A. Choudhary. High Performance I/O for Parallel Computers: Problems and Prospects. IEEE Computer, pages 59–68, March 1994.
K. Klimkowski and R. van de Geijn. Anatomy of an Out-of-Core Dense Linear Solver. In Proceedings of the 1995 International Conference on Parallel Processing, pages III-29–III-33, August 1995.
D. Kotz. Disk-directed I/O for MIMD Multiprocessors. In Proceedings of the 1994 Symposium on Operating Systems Design and Implementation, pages 61–74, November 1994. Updated as Technical Report PCS-TR94–226, Dept. of Computer Science, Dartmouth College.
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. Version 1.0, May 1994.
K. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-Directed Collective I/O in Panda. In Proceedings of Supercomputing’95, December 1995. To appear.
R. Thakur. Runtime Support for In-Core and Out-of-Core Data-Parallel Programs. PhD thesis, Dept. of Electrical and Computer Engineering, Syracuse University, May 1995.
R. Thakur, R. Bordawekar, A. Choudhary, R. Ponnusamy, and T. Singh. PASSION Runtime Library for Parallel I/O. In Proceedings of the Scalable Parallel Libraries Conference, pages 119–128, October 1994.
D. Womble, D. Greenberg, R. Riesen, and S. Wheat. Out of Core, Out of Mind: Practical Parallel I/O. In Proceedings of the Scalable Parallel Libraries Conference, pages 10–16, October 1993.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Kluwer Academic Publishers
About this chapter
Cite this chapter
Thakur, R., Choudhary, A. (1996). Runtime Support for Out-of-Core Parallel Programs. In: Jain, R., Werth, J., Browne, J.C. (eds) Input/Output in Parallel and Distributed Computer Systems. The Kluwer International Series in Engineering and Computer Science, vol 362. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1401-1_6
Download citation
DOI: https://doi.org/10.1007/978-1-4613-1401-1_6
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4612-8607-3
Online ISBN: 978-1-4613-1401-1
eBook Packages: Springer Book Archive