Abstract
The Genoa Active Message MAchine (GAMMA) is a lightweight communication system based on the Active Ports paradigm, originally designed for efficient implementation over low-cost Fast Ethernet interconnects. In this paper we report about the recently completed porting of GAMMA to the Packet Engines GNIC-II and the Netgear GA620 Gigabit Ethernet adapters, and provide a comparison among GAMMA, MPI/GAMMA, TCP/IP, and MPICH, on such commodity interconnects, using different performance metrics. With a combination of low end-to-end latency (9.5 μs with GNIC-II, 32 μs with GA620) and high transmission throughput (almost 97 MByte/s with GNIC-II and 125 MByte/s with GA620, the latter obtained without changing the firmware of the adapter), GAMMA demonstrates the potential for Gigabit Ethernet lightweight protocols to yield messaging performance comparable to the best Myrinet-based messaging systems. This result is of interest, given the envisaged drop in cost of Gigabit Ethernet due to the transition from fiber optic to UTP cabling and ever increasing mass market production of such standard interconnect. We also reports about a technique for message fragmentation that is commonly exploited to increase the throughput with short message. When a different, though more widely used, performance metrics is considered, such a technique results into a performance loss rather than improvement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
M. Boosten, R.W. Dobinson and P.D.V. van der Stok, MESH: MEssaging and ScHeduling for fine-grain parallel processing on commodity platforms, in: Proc. 1999 International Conference on Parallel and Distributed Processing, Techniques and Applications (PDPTA'99), Las Vegas, Nevada, June 1999.
P. Buonadonna, A. Geweke and D. Culler, An implementation and analysis of the virtual interface architecture, in: Proc. SC98, Orlando, FL, November 1998.
G. Chiola and G. Ciaccio, Efficient parallel processing on low-cost clusters with GAMMA active ports, Parallel Computing 26 (2000) 333–354.
G. Chiola and G. Ciaccio, GAMMA home page, http://www. disi.unige.it/project/gamma/.
G. Chiola and G. Ciaccio, GAMMA: A low cost network of workstations based on active messages, in: Proc. Euromicro PDP'97, London, UK, January 1997 (IEEE Computer Society, 1997).
G. Chiola and G. Ciaccio, Porting MPICH ADI on GAMMA with flow control, in: Proc. IEEE-ACM 1999 Midwest Workshop on Parallel Processing (MWPP1999), Kent, OH, August 1999.
G. Ciaccio, A communication system for efficient parallel processing on clusters of personal computers, Ph.D. thesis, DISI, Università di Genova (1999).
G. Ciaccio, MPI/GAMMA home page, http://www.disi. unige.it/project/gamma/mpigamma/.
A. Gallatin, J. Chase and K. Yocum, Trapeze/IP: TCP/IP at near-gigabit speeds, in: 1999 USENIX Technical Conference (Freenix Track), June 1999.
P. Gilfeather and T. Underwood, Fragmentation and high-performance IP, in: Proc. IPDPS 2001, Workshop CAC'01, San Francisco Bay Area, California, April 2001 (IEEE, 2001).
H. Hellwagner, M. Lachowitz and M. Ohlenroth, Exploring the performance of VI architecture communication features in the giganet cluster LAN, in: Proc. 2000 International Workshop on Cluster Computing–Technologies, Environments, and Applications (CC-TEA 2000), Las Vegas, Nevada, June 2000 (IEEE, 2000).
M. Lauria, S. Pakin and A. Chien, Efficient layering for high speed communication: The MPI over fast messages (FM) experience, Cluster Computing 2 (1999) 107–116.
M-VIA Home Page, http://www.nersc.gov/research/ FTG/via/ (1998).
Myricom, GMperformance, http://www.myri.com/myrinet/ performance/ (2000).
P. Pietikainen, Schedules transfer protocol in linux, in: Proc. Linux Symposium 2001, Ottawa, Canada, July 2001.
I. Pratt and K. Fraser, Arsenic: A user-accessible Gigabit Ethernet interface, in: Proc. Infocom 2001, Anchorage, Alaska, April 2001 (IEEE, 2001).
L. Prylli and B. Tourancheau, BIP: A new protocol designed for high performance networking on Myrinet, in: Proc. Workshop PC-NOW, IPPS/SPDP'98, Orlando, FL, April 1998, Lecture Notes in Computer Science, Vol. 1388 (Springer, 1998) pp. 472–485.
P. Shivam, P. Wyckoff and D. Panda, EMP: Zero-copy OS-bypass NICdriven Gigabit Ethernet Message Passing, in: Proc. 2001 International Conference on Supercomputing (SC01), Denver, Colorado, November 2001.
S. Sumimoto, H. Tezuka, A. Hori, H. Harada, T. Taka-hashi and Y. Ishikawa, The design and evaluation of high performance communication using a Gigabit Ethernet, in: ICS-99, Rhodes, Greece, June 1999.
H. Tezuka, A. Hori, Y. Ishikawa and M. Sato, PM: An operating system coordinated high performance communication library, in: Proc. of High Performance Computing and Networking (HPCN'97), April 1997, Lecture Notes in Computer Science, Vol. 1225 (Springer, 1997) pp. 708–717.
H. Tezuka, F. O'Carrol, A. Hori and Y. Ishikawa, Pin-down cache: A virtual memory management technique for zero-copy communication, in: Proc. IPPS/SPDP'98 (IEEE, April 1998) pp. 308–314.
Virtual Interface Architecture Home Page, http://www.viarch.org/ (1998).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ciaccio, G. Messaging on Gigabit Ethernet: Some Experiments with GAMMA and Other Systems. Cluster Computing 6, 143–151 (2003). https://doi.org/10.1023/A:1022804622471
Issue Date:
DOI: https://doi.org/10.1023/A:1022804622471