Skip to main content
Log in

Self-configuring communication middleware model for clusters with multiple interconnections

Modèle D’Intergiciel de Communication à Autoconfiguration pour Grappes à Interconnexions Multiples

  • Published:
Annales Des Télécommunications Aims and scope Submit manuscript

Abstract

Communication middleware such as MuniCluster provides high-level communication mechanisms for networked applications by hiding the low-level communication details from the applications. The MuniCluster model provides mechanisms to enhance the network performance properties through message separation and parallel transfer. However, the configurations of such services require various measurements and setups to efficiently utilize the availability of multiple network interfaces. In this paper we introduce and evaluate a self-configuring model that allows applications to transparently utilize the existence of multiple network interfaces and networks. Here we present enhancements to the MuniCluster model by adding the self-configuration mechanism. Using network resource discovery and deciding on how to efficiently utilize the multiple networks, the model enhances overall communications performance. The proposed techniques deal with the heterogeneity of interfaces and networks to enhance the communication performance transparent form the applications. The proposed techniques also deal with heterogeneity in the interfaces and networks in their numbers, latencies, and bandwidths.

Résumé

Les intergiciels de communication tels que MuniCluster fournissent des mécanismes de communication pour les applications en réseau qui permettent de cacher à ces applications les détails de réalisation de bas niveau. Le modèle MuniCluster fournit des mécanismes de séparation de message et de transfert en parallèle qui permettent d’améliorer les performances du réseau mais la configuration de ces services nécessite de nombreuses mesures et adaptations à chaque interface réseau. Dans cet article, on introduit et on évalue un modèle auto-configurable qui permet aux applications d’utiliser de façon transparente plusieurs réseaux et plusieurs interfaces. Nous montrons comment améliorer le modèle MuniCluster en le dotant de ce mécanisme d’auto-configuration. Les techniques proposées traitent des interfaces et des réseaux hétérogènes aussi bien du point de vue de leur latence que de leur largeur de bande.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Beowulf Ethernet Channel bonding web page at http://www.beowulf.org/software/bonding.html, June 2002.

  2. Brendan (C.), Traw (S.), Smith (J.), Striping Within the Network Subsystem,IEEE Network,9, no 4, pp. 22–29, July/August 1995.

    Article  Google Scholar 

  3. Buyya (R.), editor, High Performance Cluster Computing: Architectures and Systems,Prentice Hall, Inc., 1999.

  4. Coll (S.),Frachtenberg (E.),Petrini (F.),Hoisie (A.),Gurvits (L.), Using Multirail Networks in High-Performance Clusters, in proc.Ieee cluster’01, 2001.

  5. Dongarra (J.),Hey (T.),Strohmaier (E.), Selected results from the parkbench benchmark, in proc. of the 2nd European Conference on Parallel Processing (Euro-Par ’96), pp. 251–254, 1996.

  6. Figueira (S.), Berman (F.), A Slowdown Model for Applications Executing on Time-Shared Clusters of Workstations,ieee Transactions on Parallel and Distributed Systems,12, no 6, pp. 653–670, June 2001.

    Article  Google Scholar 

  7. Mohamed (N.),Al-Jaroodi (J.),Jiang (H.),Swanson (S.), A User-Level Socket Layer over Multiple Physical Network Interfaces, 14th International Conference on Parallel and Distributed Computing and Systems, pp. 810–815, November 2002.

  8. Mohamed (N.), Al-Jaroodi (J.), Jiang (H.), Swanson (D.), Scalable Bulk Data Transfer in Wide Area Networks,International Journal of High Performance Computing Applications — Special Issue on Grid Computing: Infrastructure and Applications,17, no 3, pp. 237–248, August 2003.

    Google Scholar 

  9. Mohamed (N.),Al-Jaroodi (J.),Jiang (H.), Flexible Mechanisms for Performance Enhancements of Cluster Networks, in proc. The 23rd IEEE International Performance, Computing, and Communications Conference (Ipccc 2004), pp. 359–366, April 2004.

  10. Mohamed (N.), Al-Jaroodi (J.), Jiang (H.), Configurable Communication Middleware for Clusters with Multiple Interconnections,Ieice Transactions of Information and Systems, Special Issue on Hardware/Software Support for High Performance Scientific and Engineering Computing,E87-D, no 7, pp. 1657–1665, July 2004.

    Google Scholar 

  11. Mohamed (N.), Al-Jaroodi (J.), Jiang (H.), Dependable User-Level Socket over Dual Networks, The special issue of Journal of Parallel and Distributed Computing (Jpdc) on the Design and Performance of Networks for Super-, Cluster, and Grid-Computing,65, no 10, pp. 1261–1270, October 2005.

    Google Scholar 

  12. Solaris, ip Network Multipathing (Ipmp) Product Document, Sun Microsystems, Inc., at http://docs.sun.com/db/doc/816-0850/6m7adiu4a?a=view.

  13. Song (S.),Huang (J.),Kappler (P.),Freimark (R.),Kozlik (T.), Fault-Tolerant Ethernet Middleware forIp-Based Process Control Networks, in proc. The 25th Annual IEEE conference on Local Computer Networks (Lcn’00), 2000.

  14. Stevens (W.), Unix Network Programming: NetworkingApis: Socket andXti,1. Prentice-HallPtr, Upper Saddle River, NJ 07458, USA, second edition, 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mohamed, N. Self-configuring communication middleware model for clusters with multiple interconnections. Ann. Télécommun. 61, 1083–1098 (2006). https://doi.org/10.1007/BF03219882

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03219882

Key words

Mots clés

Navigation