Abstract
The computational performance of multiprocessors continues to improve by leaps and bounds, fueled in part by rapid improvements in processor and interconnection technology. I/O performance thus becomes ever more critical, to avoid becoming the bottleneck of system performance. In this paper we provide an introduction to I/O architectural issues in multiprocessors, with a focus on disk subsystems. While we discuss examples from actual architectures and provide pointers to interesting research in the literature, we do not attempt to provide a comprehensive survey. We concentrate on a study of the architectural design issues, and the effects of different design alternatives.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
George S. Almasi and Allan Gottlieb. Highly Parallel Computing. Ben-jamin/Cummings, 2nd edition, 1994.
Gene M. Amdahl. Validity of the single processor approach to achieving large scale computing capabilities. In AFIPS Conference Proceedings, volume 30, pages 483–485, Spring 1967.
Sandra Johnson Baylor, Caroline Benveniste, and Yarsun Hsu. Performance evaluation of a massively parallel I/O subsystem. This volume.
Sandra Johnson Baylor, Caroline B. Benveniste, and Yarson Hsu. Performance evaluation of a parallel I/O architecture. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 404–413, Barcelona, July 1995.
BBN Advanced Computers, Cambridge, MA. Inside the Butterfly Plus, October 1987.
Robert E. Benner. Parallel graphics algorithms on a 1024–processor hypercube. In Proceedings of the Fourth Conference on Hypercube Concurrent Computers and Applications, pages 133–140. Golden Gate Enterprises, Los Altos, CA, 1989.
Lawrence Berdahl. Parallel transport protocol proposal. Lawrence Livermore National Labs, January 3, 1995. Draft.
Matthias A. Blumrich, Kai Li, Richard Alpert, Cezary Dubnicki, Edward W. Feiten, and Jonathan Sandberg. Virtual memory mapped network interface for the SHRIMP multicomputer. In Proceedings of the 21st Annual International Symposium on Computer Architecture, pages 142–153, 1994.
C. Bornstein and P. Steenkiste. Data reshuffling in support of fast I/O for distributed-memory machines. In Proceedings of the Third IEEE International Symposium on High Performance Distributed Computing, pages 227–235, August 1994.
J. C. Browne, A. G. Dale, C. Leung, and R. Jenevein. A parallel multi-stage I/O architecture with self-managing disk cache for database management applications. In Proceedings of the Fourth International Workshop on Database Machines. Springer-Verlag, March 1985.
Pei Cao, Swee Boon Lim, Shivakumar Venkataraman, and John Wilkes. The TickerTAIP parallel RAID architecture. ACM Transactions on Computer Systems, 12(3): 236–269, August 1994.
Convex Exemplar Scalable Parallel Processing System. Convex Computer Corporation, 1994. Order number 080–002293–000.
Peter M. Chen, Edward K. Lee, Garth A. Gibson, Randy H. Katz, and David A. Patterson. RAID: high-performance, reliable secondary storage. ACM Computing Surveys, 26(2): 145–185, June 1994.
Tzi-cker Chiueh. Performance optimization for parallel tape arrays. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 375–384, Barcelona, July 1995.
Alok Choudhary, Rajesh Bordawekar, Michael Harry, Rakesh Krishnaiyer, Ravi Ponnusamy, Tarvinder Singh, and Rajeev Thakur. PASSION: parallel and scalable software for input-output. Technical Report SCCS-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.
Samuel S. Coleman and Richard W. Watson. New architectures to reduce I/O bottlenecks in high-performance systems. In Proceedings of the Twenty-Sixth Annual Hawaii International Conference on System Sciences, volume I, pages 5–14, 1993.
Thomas H. Cormen and David Kotz. Integrating theory and practice in parallel file systems. In Proceedings of the 1993 DAGS/PC Symposium, pages 64–74, Hanover, NH, June 1993. Dartmouth Institute for Advanced Graduate Studies. Revised as Dartmouth PCS-TR93–188 on 9/20/94.
Robert A. Coyne, Harry Hulen, and Richard Watson. The high performance storage system. In Proceedings of Supercomputing ’93, pages 83–92, 1993.
Juan Miguel del Rosario. High performance parallel I/O on the nCUBE 2. Transactions of the Institute of Electronics, Information and Communications Engineers, J75D-I(8): 626–636, August 1992.
Juan Miguel del Rosario and Alok Choudhary. High performance I/O for parallel computers: Problems and prospects. IEEE Computer, 27(3):59–68, March 1994.
David DeWitt and Jim Gray. Parallel database systems: The future of high-performance database systems. Communications of the ACM, 35(6): 85–98, June 1992.
David J. DeWitt, Shahram Ghandeharizadeh, Donovan A. Schneider, Allan Bricker, Hui-I Hsaio, and Rick Rasmussen. The Gamma database machine project. IEEE Transactions on Knowledge and Data Engineering, 2(1):44–62, March 1990.
Ann L. Drapeau and Randy H. Katz. Striping in large tape libraries. In Proceedings of Supercomputing ’93, pages 378–387, 1993.
Ann L. Drapeau, Ken W. Shirrif, John H. Hartman, Ethan L. Miller, Srinivasan Seshan, Randy H. Katz, Ken Lutz, David A. Patterson, Edward K. Lee, Peter H. Chen, and Garth A. Gibson. RAID-II: a high-bandwidth network file server. In Proceedings of the 21st Annual International Symposium on Computer Architecture, pages 234–244, 1994.
Bob Duzett and Ron Buck. An overview of the nCUBE 3 supercomputer. In Proceedings of the Fourth Symposium on the Frontiers of Massively Parallel Computation, pages 458–464, 1992.
Dror G. Feitelson, Peter F. Corbett, Sandra Johnson Baylor, and Yarson Hsu. Parallel I/O subsystems in massively parallel supercomputers. IEEE Parallel and Distributed Technology, pages 33–47, Fall 1995.
Dror G. Feitelson, Peter F. Corbett, Yarson Hsu, and Jean-Pierre Prost. Parallel I/O systems and interfaces for parallel computers. In Multiprocessor Systems — Design and Integration. World Scientific, 1996. To appear.
Dror G. Feitelson, Peter F. Corbett, and Jean-Pierre Prost. Performance of the Vesta parallel file system. In Proceedings of the Ninth International Parallel Processing Symposium, pages 150–158, April 1995.
M. J. Flynn. Very high-speed computing systems. Proceedings of the IEEE, 54(12): 1901–1909, December 1966.
Robert J. Flynn and Haldun Hadimioglu. A distributed hypercube file system. In Proceedings of the Third Conference on Hypercube Concurrent Computers and Applications, pages 1375–1381, 1988.
James C. French, Terrence W. Pratt, and Mriganka Das. Performance measurement of the Concurrent File System of the Intel iPSC/2 hypercube. Journal of Parallel and Distributed Computing, 17(1–2): 115–121, January and February 1993.
Joydeep Ghosh, Kelvin D. Goveas, and Jeffrey T. Draper. Performance evaluation of a parallel I/O subsystem for hypercube multiprocessors. Journal of Parallel and Distributed Computing, 17(1–2):90–106, January and February 1993.
Garth A. Gibson. Redundant Disk Arrays: Reliable, Parallel Secondary Storage. An ACM Distinguished Dissertation 1991. MIT Press, 1992.
Thomas Gross and Peter Steenkiste. Architecture implications of high-speed I/O for distributed-memory computers. In Proceedings of the 8th ACM International Conference on Supercomputing, pages 176–185, July 1994.
Haldun Hadimioglu and Robert J. Flynn. The design and analysis of a tightly coupled hypercube file system. In Proceedings of the Fifth Annual Distributed-Memory Computer Conference, pages 1405–1410, 1990.
R. W. Hamming. Error detecting and correcting codes. The Bell System Technical Journal, XXVI(2): 147–160, April 1950.
John H. Hartman and John K. Ousterhout. The Zebra striped network file system. ACM Transactions on Computer Systems, 13(3):274–310, August 1995.
John P. Hayes, Trevor N. Mudge, Quentin F. Stout, Stephen Colley, and John Palmer. Architecture of a hypercube supercomputer. In Proceedings of the 1986 International Conference on Parallel Processing, pages 653–660, 1986.
W. Daniel Hillis and Lewis W. Tucker. The CM-5 connection machine: A scalable supercomputer. Communications of the ACM, 36(11):31–40, November 1993.
David Wayne Jensen. Disk I/O In High-Performance Computing Systems. PhD thesis, Univ. Illinois, Urbana-Champagne, 1993.
Randy H. Katz, Garth A. Gibson, and David A. Patterson. Disk system architectures for high performance computing. Proceedings of the IEEE, 77(12): 1842–1858, December 1989.
Michelle Y. Kim. Synchronized disk interleaving. IEEE Transactions on Computers, C-35(l l):978–988, November 1986.
David Kotz and Ting Cai. Exploring the use of I/O nodes for computation in a MIMD multiprocessor. In IPPS ’95 Workshop on Input/Output in Parallel and Distributed Systems, pages 78–89, April 1995.
David Kotz and Nils Nieuwejaar. File-system workload on a scientific multiprocessor. IEEE Parallel and Distributed Technology, pages 51–60, Spring 1995.
Kendall Square Research technical summary. Kendall Square Research, 1992.
Thomas T. Kwan and Daniel A. Reed. Performance of the CM-5 scalable file system. In Proceedings of the 8th ACM International Conference on Supercom-puting, pages 156–165, July 1994.
Charles E. Leiserson, Zahi S. Abuhamdeh, David C. Douglas, Carl R. Feyn-man, Mahesh N. Ganmukhi, Jeffrey V. Hill, Daniel Hillis, Bradley C. Kuszmaul, Margaret A. St. Pierre, David S. Wells, Monica C. Wong, Shaw-Wen Yang, and Robert Zak. The network architecture of the connection machine CM-5. In Proceedings of the Fourth Symposium on Parallel Algorithms and Architectures, pages 272–285, 1992.
Darrell D. E. Long and Bruce R. Montague. Swift/RAID: A distributed RAID system. Computing Systems, 7(3): 333–359, Summer 1994.
The design of the MasPar MP-2: A cost effective massively parallel multiprocessor. MasPar Computer Corporation report number MP/P-11.92, 1992.
NCR 3600 product description. Technical Report ST-2119–91, NCR, San Diego, September 1991.
John R. Nickolls. The MasPar scalable Unix I/O system. In Proceedings of the Eighth International Parallel Processing Symposium, pages 390–394, Cancun, Mexico, April 1994.
John R. Nickolls and Ernie Rael. Data parallel Unix input/output for a massively parallel processor. Technical Report MP/P-17.93, MasPar Computer Corporation, 1993.
Nils Nieuwejaar and David Kotz. Performance of the Galley parallel file system. In Fourth Workshop on Input/Output in Parallel and Distributed Systems, May 1996.
David Patterson, Garth Gibson, and Randy Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 109–116, June 1988.
David A. Patterson and John L. Hennessy. Computer Architecture: A Quantitative Approach. Morgan Kaufmann, 1990.
Paul Pierce. A concurrent file system for a highly parallel mass storage system. In Proceedings of the Fourth Conference on Hypercube Concurrent Computers and Applications, pages 155–160. Golden Gate Enterprises, Los Altos, CA, March 1989.
Terrence W. Pratt, James C. French, Phillip M. Dickens, and Stanley A. Janet, Jr. A comparison of the architecture and performance of two parallel file systems. In Proceedings of the Fourth Conference on Hypercube Concurrent Computers and Applications, pages 161–166. Golden Gate Enterprises, Los Altos, CA, 1989.
A. L. Reddy, P. Banerjee, and Santosh G. Abraham. I/O embedding in hypercubes. In Proceedings of the 1988 International Conference on Parallel Processing, volume 1, pages 331–338, 1988.
Andrew P. Russo. The AlphaServer 2100 I/O subsystem. Digital Technical Journal, 6(3):20–28, Summer 1994.
Kenneth Salem and Hector Garcia-Molina. Disk striping. In Proceedings of the IEEE 1986 Conference on Data Engineering, pages 336–342, 1986.
Mark Smotherman. A sequencing-based taxonomy of I/O systems and review of historical machines. Computer Architecture News, 17(5):5–15, September 1989.
Michael Stonebraker and Gerhard A. Schloss. Distributed RAID — A new multiple copy algorithm. In Proceedings of 6th International Data Engineering Conference, pages 430–437, 1990.
DBC/1012. Teradata Corporation Booklet, 1988.
Thinking Machines Corporation. Programming the CM I/O System, November 1990.
The Connection Machine CM-5 Technical Summary, Thinking Machines Corporation, October 1991.
The CM-5 I/O system. Thinking Machines Corporation glossy, 1993.
Thorsten von Eicken, Anindya Basu, Vineet Buch, and Werner Vogels. U-Net: A user-level network interface for parallel and distributed computing. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles, pages 40–53, December 1995.
John Wilkes. DataMesh, house-building, and distributed systems technology. ACM Operating Systems Review, 27(2): 104–108, April 1993.
John Wilkes, Richard Golding, Carl Staelin, and Tim Sullivan. The HP AutoRAID hierarchical storage system. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles, pages 96–108, December 1995.
Andrew Witkowski, Kumar Chandrakumar, and Greg Macchio. Concurrent I/O system for the hypercube multiprocessor. In Proceedings of the Third Conference on Hypercube Concurrent Computers and Applications, pages 1398–1407, 1988.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Kluwer Academic Publishers
About this chapter
Cite this chapter
Kotz, D. (1996). Introduction to Multiprocessor I/O Architecture. In: Jain, R., Werth, J., Browne, J.C. (eds) Input/Output in Parallel and Distributed Computer Systems. The Kluwer International Series in Engineering and Computer Science, vol 362. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1401-1_4
Download citation
DOI: https://doi.org/10.1007/978-1-4613-1401-1_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4612-8607-3
Online ISBN: 978-1-4613-1401-1
eBook Packages: Springer Book Archive