McGAT: multicomputer granularity assessment tool
Article No.: 30, Page 1
Abstract
A multicomputer is a loosely coupled multiprocessor architecture, which is also called a cluster computer or just a cluster. It may be assembled from commercially available PCs and networking hardware as a low-cost alternative to rack mounted blades, interconnected through a high speed backplane, or to a high performance, tightly coupled, shared memory multiprocessor. Parallel software applications exploit parallelism in a cluster by distributing chunks of data among its remote nodes for simultaneous processing.
Each remote node processes its chunk of data in parallel with the others and returns its partial result back to the master node for combination into a final result. When the chunk size, or system granularity, is just right, there is a balance between the network-transit time and the remote-processing time of the data; the distributed application runs at maximum efficiency and the system granularity is said to be optimal. That said, one wonders why there are no tools explicitly designed to help parallel software designers and performance analysts determine the optimal granularity size of a given cluster!
We present a back-to-basics approach, application-level program named McGAT, for Multi-computer Granularity Assessment Tool. The user specifies a <u>range</u> of chunk sizes to analyze, along with a remote node's <u>processing time estimate</u> for a particular sized chunk. McGAT is not a simulation, but a parallel application that runs on the user's hardware, distributing chunks of data to each of the cluster's remote nodes. Each node responds after an amount of time necessary to process that data, based on the user's processing time estimates. McGAT reports <u>system throughput</u> for each chunk size over the user-specified range.
The chunk size with the maximum throughput indicates the optimal granularity of the system on which it is run, which is a key parallel software design component. The user may then choose a chunk size that provides maximum throughput within the requirements of his or her specific application.
Our presentation includes graphs comparing the results from runs on a 3-, 4-, and 5-node Linux-based PC cluster, interconnected through both 10 and 100 Mbps Ethernet. We plan to expand our knowledge base to include larger numbers of nodes, and a virtual ring to complement or virtual star communications protocol.
McGAT may be used to establish a performance baseline, and again later to quantify the effect of any subsequent changes to the cluster. McGAT is offered as open source software, and a beta release for Linux based platforms is available for download from the DSRLab website under the GNU General Public License.
Index Terms
- McGAT: multicomputer granularity assessment tool
Comments
Information & Contributors
Information
Published In
January 2008
178 pages
Copyright © 2008 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- National e-Science Institute (Edinburgh, UK)
- Louisiana State University (USA)
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 January 2008
Check for updates
Qualifiers
- Poster
Conference
Mardi Gras'08
Sponsor:
Mardi Gras'08: 15th Mardi Gras Conference on Distributed Applications
January 29 - February 3, 2008
Louisiana, Baton Rouge, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 66Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in