Limiting factors in high performance computing

Abstract

By examining the details of typical HPC computations, we have shown that data output rates represent the major obstacle to scaling HPC computations to the Tflops range. If past experience is to be a guide, we can safely conclude that manufacturers will concentrate on peak performance and internal I/O rates while largely ignoring the more significant external I/O issues. Unless pressure is put on the vendors, there is a real danger that Tflops machines will not deliver on expectations for this reason. High speed communication protocols and switching systems such as a ATM will likely play an increasingly important role in HPC in coming years.

Invited talk at the PARA94 Conference, Copenhagen, Denmark, June 21–24, 1994.

To appear in Proceedings of the PARA94 Conference, ed. J. Wazniewski, Lectures in Computer Science, Springer-Verlag, 1994.

Research supported in part by NSF Grand Challenges Application Group grant ASC-9217394 and by NASA HPCC Group grant NAG5-2218.