Abstract
This paper examines synchronization support of two generations of SCI adapters from Dolphin Interconnect Solutions and compares the functionality to similar support on Digital's Memory Channel. Memory Channel enforces sequential consistency across the interconnect, while SCI allows store reordering. This gives SCI a potential performance payoff by allowing more flexible pipelining of data through the interconnect. The lower number of ordering constraints also reduces hardware complexity, but moves the complexity to software. For a straightforward implementation of message passing this overhead is significant. A new software algorithm, the valid flag algorithm, is introduced to improve this situation. A new hardware lock support mechanism is proposed to facilitate efficient locks in absence of lock support on the I/O bus. Performance of the simple message passing protocol is compared to the suggested valid flag protocol. The valid flag protocol reduces latency of a small message by 50% and also increases throughput for pipelined, small messages significantly.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Gail Alverson, Brian Koblenz, Robert Alverson, Allan Porterfield, David Callahan, and Burton Smith. Exploiting Heterogeneous Parallelism on a Multithreaded Multiprocessor. Available at http://www.tera.com/tera/ftp.html.
Nanette J. Boden, Danny Cohen, Robert E. Felderman, Alan E. Kulawik, Charles E. Seitz, Jakov N. Seizovic, and Wen-King Su. Myrinet: A Gigabit-per-Second Local Area Network. IEEE Micro, pages 29–36, February 1996.
David R. Cheriton and Robert A. Kutter. Optimized Memory-Based Messaging: Leveraging the Memory System for High-Performance Communication. Technical Report CS-TR-94-1506, Stanford University, 1994.
E.W. Dijkstra. Solution to a Problem in Concurrent Programming Control. Communications of the ACM, 8(9):569, September 1965.
Dolphin Interconnect Solutions. SBus-to-SCI Adapter User's Guide, DIS303 SBus-2, 1995.
Kourosh Gharachorloo, Daniel Lenoski, James Laudon, Philip Gibbons, Anoop Gupta, and John Hennessy. Memory Consistency and Event Ordering in Scalable Shared-Memory Multiprocessors. In Proceedings of 17th International Symposium on Computer Architecture, pages 15–26, May 1990.
Richard B. Gillett. Memory Channel for PCI. IEEE Micro, pages 12–18, February 1996.
Richard B. Gillett and Richard Kaufmann. Experience Using the First-Generation Memory Channel for PCI Network. In Proceedings of Hot Interconnects IV, pages 205–214, August 1996.
Robert W. Horst. TNet: A Reliable System Area Network. IEEE Micro, February 1995.
Manolis Katevenis. Telegraphos: High-Speed Communication Architecture for Parallel and Distributed Computer Systems. Technical Report TR-123, FORTH-ICS, Crete, Greece, May 1994.
Leslie Lamport. The Mutual Exclusion Problem: Part I — A theory of Interprocess Communication. Journal of the ACM, 33(2):313–326, April 1986.
Leslie Lamport. The Mutual Exclusion Problem: Part II — Statement and Solutions. Journal of the ACM, 33(2):327–348, April 1986.
Leslie Lamport. A Fast Mutual Exclusion Algoritm. ACM Transactions on Computer Systems, 5(1):1–11, February 1987.
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. (draft obtainable by ftp from info.mcs.anl.gov, directory pub/mpi), May 1994. Version 1.0.
Sun Microsystems. UltraSparc Programmer Reference Manual. SPARC Technology Business, 1995. Part No.:STP1030-UG.
Knut Omang. Preliminary Performance results from SALMON, a Multiprocessing Environment based on Workstations Connected by SCI. Research Report 208, Department of Informatics, University of Oslo, Norway, November 1995. Available at http://www.ifi.uio.no/∼sci/papers.html.
Knut Omang and Bodo Parady. Performance of Low-Cost UltraSparc Multiprocessors Connected by SCI. In Proceedings of Communication Networks and Distributed Systems Modeling and Simulation, Phoenix Arizona, January 1997. Also available at http://www.ifi.uio.no/∼sci/papers.html.
Scott Pakin, Mario Lauria, and Andrew Chien. High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet. In Proceedings of Supercomputing '95, San Diego, 1995. Avaliable at http://www-csag.cs.uiuc.edu/papers/ index.html#communication.
Stein Jørgen Ryan, Stein Gjessing, and Marius Liaaen. Cluster Communication using a PCI to SCI interface. In Proceedings of IASTED Eighth International Conference on Parallel and Distributed Computing and Systems, Chicago, October 1996. Available at http://www.ifi.uio.no/∼sci/papers.html.
IEEE Standard for Scalable Coherent Interface (SCI), August 1993.
Thorsten von Eicken, Anindya Basu, Vneet Buch, and Werner Vogels. U-Net: A User-Level Network Interface for Parallel and Distributed Computing. In Proceedings of 15th ACM Symposium on Operating Systems Principles, December 1995.
Thorsten von Eicken, David E. Culler, Seth Copen Goldstein, and Klaus Erik Schauser. Active Messages: a Mechanism for Integrated Communication and Computation. In Proceedings of 19th International Symposium on Computer Architecture, pages 256–266, May 1992.
David L. Weaver and Tom Germond. The SPARC Architecture Manual, Version 9. Prentice-Hall, 1994.
Matt Welsh, Anindya Basu, and Thorsten von Eicken. ATM and Fast Ethernet Network Interfaces for User-level Communication. In Proceedings of 3rd International Symposium on High-Performance Computer Architecture, February 1997.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Omang, K. (1997). Synchronization support in I/O adapter based SCI clusters. In: Panda, D.K., Stunkel, C.B. (eds) Communication and Architectural Support for Network-Based Parallel Computing. CANPC 1997. Lecture Notes in Computer Science, vol 1199. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62573-9_12
Download citation
DOI: https://doi.org/10.1007/3-540-62573-9_12
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62573-5
Online ISBN: 978-3-540-68085-7
eBook Packages: Springer Book Archive