Skip to main content
SpringerLink
Log in

A High Performance Message-Passing System for Network of Workstations

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

With the proliferation of Network of Workstations (NOW) environment, there has been a great demand for a high performance message-passing system to implement High Performance Distributed Computing (HPDC) applications over NOW environment. NYNET (ATM wide area network testbed in New York state) Communication System (NCS) is a multithreaded message-passing system developed at Syracuse University that provides low-latency and high-throughput communication services over the Asynchronous Transfer Mode (ATM) based HPDC environment. NCS provides High Performmance Application Communication Interface (HPI) to support applications that demand high-throughput and low-latency communication services.

This paper outlines the general architecture of NCS and presents the implementation approach of NCS HPI over an ATM network. This interface has been developed by modifying Fore Systems' ATM Application Programming Interface (API) and its device driver. NCS HPI uses read/writetrap routines to bypass traditional operating system calls and kernel-level communication interface (e.g. UNIX System V Streams). It reduces latency, data transfer time, and avoid using traditional communication protocols (e.g., TCP/IP). This substantially improves the communication performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Y. Le Boudec, “The Asynchronous Transfer Mode: a tutorial”, Computer Networks and ISDN Systems, Vol. 24, No. 4, pp. 279-309, 1992.

    Google Scholar 

  2. N. J. Moden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, and W. Su, “Myrinet: A Gigabit-per-second Local Area Network”, IEEE Micro, Vol. 15, No. 1, pp. 29-36, February 1995.

    Google Scholar 

  3. M. Lin, J. Hsieh, D. Du, and J. Thomas, “Distributed Network Computing over Local ATM Networks”, IEEE Journal on Selected Areas in Communications, Vol. 13, No. 4, pp. 733-747, May 1995.

    Google Scholar 

  4. K. K. Keeton, T. E. Anderson, and D. A. Patterson, “LogP Quantified: The Case for Low-Overhead Local Area Networks”, Proc. of Hot Interconnects III, August 1995.

  5. E. Arnould, F. Bitz, E. Cooper, H. T. Kung, R. Sansom, and P. Steenkiste, “The Design of Nectar: A Network Backplane for Heterogeneous Multicomputers”, Proc. of the 3rd International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 205-216, April 1989.

  6. T. Muhammad, “Hardware Barrier Synchronization For A Cluster Of Personal Computers”, MS Thesis, School of Electrical Engineering, Purdue University, May 1995.

  7. E.W. Felton, R. D. Alpert, A. Bilas, M. A. Blumrich, D.W. Clark, S. N. Damianakis, C. Dubnicki, L. Iftode, and K. Li, “Early Experience with Message-Passing on the SHRIMP Multicomputer”, Proc. of the 23rd International Symposium on Computer Architecture, pp. 296-307, May 1996.

  8. T. M. Warschko, J. M. Blum, and W. F. Tichy, “The ParaStation Project: Using Workstations as Building Blocks for Parallel Computing”, Proc. of the International Conference on Parallel and Distributed Processing, Techniques and Applications (PDPTA'96), Vol. pp. 375-386, August 1996.

  9. J. V. Lawton, J. J. Bronsnan, M. P. Doyle, S. D. O Riordain, and T. G. Reddin, “Building a High-performance Message-passing System for MEMORY CHANNEL Clusters”, Digital Technical Journal, Vol. 8, No. 2, pp. 96-116, 1996.

    Google Scholar 

  10. R. Ahuja, S. Keshav, and H. Saran, “Design, Implementation, and Performance Measurement of a Native-Mode ATM Transport Layer (Extended Version)”, IEEE/ACM Transactions on Networking, Vol. 4, No. 4, pp. 502-515, August 1996.

    Google Scholar 

  11. C. Dalton, G. Watson, D. Banks, C. Calamvokis, A. Edwards, and J. Lumley, “Afterburner”, IEEE Network, Vol. 7, No. 4, pp. 36-43, July 1993.

    Google Scholar 

  12. Peter Druschel, Larry L. Peterson, and Bruce S. Davie, “Experiences with a High-Speed Network Adaptor: A Software Perspective”, SIGCOMM, 1994.

  13. T. von Eicken, D. Culler, S. Goldstein, and K. Schauser, “Active Messages: A Mechanism for Integrated Communication and Computation”, Proc. of the 19th International Symposium on Computer Architecture, pp. 256-266, May 1992.

  14. T. von Eicken, A. Basu, V. Buch, and W. Vogels, “U-Net: A User-Level Network Interface for Parallel and Distributed Computing”, Proc. of the 15th ACM Symposium on Operating Systems Principle, December 1995.

  15. R. Martin, “HPAM: An Active Message Layer for Network of HP Workstations”, Proc. of Hot Interconnects II, August 1994.

  16. G. Chiola, and G. Ciaccio, “GAMMA: a Low-cost Network of Workstations Based on Active Messages”, Proc. of the 5th EUROMICRO Workshop on Parallel and Distributed Processing, January 1997.

  17. S. Pakin, M. Lauria, and A. Chien, “High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet”, Proc. of Supercomputing '95, December 1995.

  18. M. Lauria, and A. Chien, “MPI-FM: High Performance MPI on Workstation Clusters”, Journal of Parallel and Distributed Computing, February 1997.

  19. S. H. Rodrigues, T. E. Anderson, and D. E. Culler, “High-Performance Local Area Communication With Fast Sockets”, Proc. of USENIX Conference '97, 1997.

  20. D. Kandlur, D. Saha, and M. Willebeek-LeMair, “Protocol Architecture for Multimedia Applications over ATM Networks”, IEEE Journal on Selected Areas in Communications, Vol. 14, No. 7, pp. 1349-1359, September 1996.

    Google Scholar 

  21. S. Y. Park, S. Hariri, Y. H. Kim, J. S. Harris and R. Yadav, “NYNET Communication System (NCS): A Multithreaded Message-Passing Tool over ATM Network”, Proc. of the 5th International Symposium on High Performance Distributed Computing, pp. 460-469, August 1996.

  22. S. Y. Park, I. K. Ra, M. Ng, S. M. Park, S. Hariri, “An Efficient Multithreaded Message-Passing Tool for ATM-based Distributed Computing Environments”, Proc. of the 9th International Conference on Parallel and Distributed Computing Systems, pp. 473-476, September 1996.

  23. F. Mueller, “A Library Implementation of POSIX Threads under UNIX”, Proc. of USENIX Conference Winter '93, pp. 29-41, January 1993.

  24. M. Haines, D. Cronk, and P. Mehrotra, “On the design of Chant: A Talking Threads Package”, Proc. of Supercomputing '94, pp. 350-359, November 1994.

  25. I. Foster, C. Kesselman, and S. Tuecke, “The Nexus Approach to Integrating Multithreading and Communication”, Journal of Parallel and Distributed Computing, 1996.

  26. I. Foster, J. Geisler, C. Kesselman, and S. Tuecke, “Managing Multiple Communication Methods in High-Performance Networked Computing Systems”, Journal of Parallel and Distributed Computing, to appear.

  27. R. Bhoedjang, T. Ruhl, R. Hofman, K. Langendoen, H. Bal, and F. Kaashoek, “Panda: A Portable Platform to Support Parallel Programming Languages”, Symposium on Experiences with Distributed and Microprocessor Systems IV, pp. 213-226, September 1993.

  28. T. Ruhl, H. Bal, and G. Benson, “Experience with a Portability Layer for Implementing Parallel Programming Systems”, Proc. of International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 1477-1488, 1996.

  29. C. G. Omidyar, and G. Pujolle, “Introduction to Flow and Congestion Control”, IEEE Communication Magazine, Vol. 34, No. 11, November 1996.

  30. R. Butler and E. Lusk, “Monitors, message, and clusters: The p4 parallel programming system”, Parallel Computing, Vol. 20, pp. 547-564, April 1994.

    Google Scholar 

  31. V. S. Sunderam, “PVM: A Framework for Parallel Distributed Computing”, Concurrency: Practice and Experience, Vol. 2, No. 4, pp. 315-340, December 1990.

    Google Scholar 

  32. MPI Forum, “MPI: A Message-Passing Interface”, Proc. of Supercomputing '93, pp. 878-883, November 1993.

  33. J. Flower, and A. Kolawa, “Express is not just a message-passing system. Current and future directions in Express”, Journal of Parallel Computing, Vol. 20, No. 4, pp. 597-614, April 1994.

    Google Scholar 

  34. S. Gillich, and B. Ries, “Flexible, portable performance analysis for PARMACS and MPI”, Proc. of High Performance Computing and Networking: International Conference and Exhibition, May, 1995.

  35. L. Dorrmann, and M. Herdieckerhoff, “Parallel Processing Performance in a Linda System”, International Conference on Parallel Processing, pp. 151-158, 1989.

  36. S. Chang, D. Du, J. Hsieh, M. Lin, and R. Tsang, “Enhanced PVM Communications over a High-Speed Local Area Network”, IEEE Parallel and Distributed Technology, Vol. 3, No. 3, pp. 20-32, 1995.

    Google Scholar 

  37. A. Ferrari, and V. Sunderam, “TPVM: Distributed Concurrent Computing with Lightweight Processes”, Proc. of the 4th IEEE International Symposium on High Performance Distributed Computing, pp. 211-218, August 1995.

  38. H. Zhou, and A. Geist, “LPVM: A Step Towards Multithread PVM”, http://www.epm.ornl.gov/ zhou/ltpvm/ltpvm.html.

  39. Werner Almesberger, “High-speed ATM networking on low-end computer systems”, IEEE International Phoenix Conference on Computers and Communications, March, 1996.

  40. “Windows Sockets 2 Specification”, 22 January, 1996.

  41. Sun Microsystems Inc., SunATM SBus Adapters Manual. 1996.

  42. Fore Systems Inc., Programmer's Reference Manual for AALI Interface. November, 1994.

  43. Fore Systems Inc., ForeRunner SBA-200 ATM Sbus Adapter User's Manual. 1993.

  44. S. Leffler, M. McKusick, and M. Karels, The Design and Implementation of the 4.3 BSD UNIX Operating System. Addison Wesley, 1989.

  45. Sun Microsystems Inc., STREAMS Programming. 1990.

  46. Sun Microsystems Inc., The SPARC Architecture Manual. Version 7, 1989.

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, 13244-4100

    Sung-Yong Park & Salim Hariri

Authors
  1. Sung-Yong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Salim Hariri
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, SY., Hariri, S. A High Performance Message-Passing System for Network of Workstations. The Journal of Supercomputing 11, 159–180 (1997). https://doi.org/10.1023/A:1007912007767

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007912007767

Search

Navigation