Abstract
In this paper, we propose a parallel I/O system utilizing parallel commodity network attached to multiple I/O processors of parallel processing systems. I/O requests from user application are automatically distributed to parallel I/O channels to achieve the best utilization of parallel network, and the system provides highly scalable performance according to the number of channels. We also provides an API for easy user-level programming and a set of utilities for high-speed data transfer and real-time parallelized visualization based on it.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Watson, R.W., Coyne, R.A.: The Parallel I/O Architecture of the High-Performance Storage System (HPSS), Proc. of the 1995 IEEE MSS Symposium, 1995.
Sang, J.: Multithreaded Data Transfer over Parallel Links, Proc. of PDPTA’99, 1999.
Sterling, T., Becker, D., Savarese, D., et.al.: BEOWULF: A Parallel Workstation for Scientific Computation, Proc. of Int. Conf. on Parallel Processing 1995, 1995.
MPI-2: Extensions to the Message-Passing Interface, http://www.mpi-forum.org/
Matsubara, M., Numa, H., Boku, T.: Commodity Network based Parallel I/O System for Massively Parallel Processors, Proc. of PDPTA’99, 1999.
Boku, T., Itakura, K., Nakamura, H., Nakazawa, K.: CP-PACS: A massively parallel processor for large scale scientific calculations, Proc. of ICS’97, 1997.
Advanced Visual Systems Inc.: AVS/Express, http://www.avs.com/software/soft_t/avsxps.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Boku, T., Matsubara, M., Itakura, K. (2001). PIO: Parallel I/O System for Massively Parallel Processors. In: Hertzberger, B., Hoekstra, A., Williams, R. (eds) High-Performance Computing and Networking. HPCN-Europe 2001. Lecture Notes in Computer Science, vol 2110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48228-8_39
Download citation
DOI: https://doi.org/10.1007/3-540-48228-8_39
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42293-8
Online ISBN: 978-3-540-48228-4
eBook Packages: Springer Book Archive