Scalability of parallel algorithm-machine combinations
- NASA Langley Research Center, Hampton, VA (United States); Louisiana State Univ., Baton Rouge, LA (United States)
- Michigan State Univ., East Lansing, MI (United States)
Scalability has become an important consideration in parallel algorithm and machine designs. The word scalable, or scalability, has been widely and often used in the parallel processing community. However, there is no adequate, commonly accepted definition of scalability available. Scalabilities of computer systems and programs are difficult to quantify, evaluate, and compare. In this paper, scalability is formally defined for algorithm-machine combinations. A practical method is proposed to provide a quantitative measurement of the scalability. The relation between the newly proposed scalability and other existing parallel performance metrics is studied. A harmony between speedup and scalability has been observed. Theoretical results show that a large class of algorithm-machine combinations is scalable and the scalability can be predicted through premeasured machine parameters. Two algorithms have been studied on an nCUBE 2 multicomputer and on a MasPar MP-1 computer. These case studies have shown how scalabilities can be measured, computed, and predicted. In addition, performance instrumentation and visualization tools also have been used and developed to understand the scalability related behavior.
- Research Organization:
- Ames Laboratory (AMES), Ames, IA (United States)
- Sponsoring Organization:
- USDOE
- Grant/Contract Number:
- W-7405-ENG-82
- OSTI ID:
- 6036379
- Report Number(s):
- IS-M-666; ON: DE91011902
- Journal Information:
- IEEE Transactions on Parallel and Distributed Systems, Vol. 5, Issue 6; ISSN 1045-9219
- Publisher:
- IEEECopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Scalability of parallel algorithm-machine combinations
Signal processing algorithms on parallel architectures: A performance update
Related Subjects
97 MATHEMATICS AND COMPUTING
Scalability
Parallel processing
Parallel algorithms
Sun
Algorithm design and analysis
High performance computing
Concurrent computing
Application software
Computer architecture
NASA
Array processors
Scaling laws
performance
Mathematical logic
Programming
990200* - Mathematics & Computers