Abstract
It is usual that the applications executed in data centers require the distribution of the same data from one node to others at various execution points and that some of them require to cope with multiple of these diffusions in parallel. Multicast-based communications are an alternative solution to sending data efficiently to multiple nodes. This paper proposes a novel technique which offers reliability and congestion control in the multi-multicast transfers in data center networks. The proposal is based on: (1) a new congestion control mechanism, which monitors the control information of the receivers, reducing the server injection rate, (2) taking advantage of the switch diffusion hardware, and (3) using IGMP snooping, which allows a network switch to multicast a packet just to the output links with host receivers joined to a multicast group. The implementation is made at user level and uses the UDP interface. Evaluation tests are performed in a CentOS-based cluster composed of 12 servers in the presence of multiple diffusions at the same time. Test results show improvements in the global bandwidth, avoid network saturation, and reduce overhead included by unicast communications in data transmission.







Similar content being viewed by others
References
DRBD: Distributed replicated block device
Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST ’10, pp 1–10. IEEE Computer Society, Washington, DC, USA
Postel JB (1981) Transmission control protocol. Internet request for comments, September. RFC 793
Lane RG, Daniels S, Yuan X (2007) An empirical study of reliable multicast protocols over ethernet-connected networks. Perform Eval 64(3):210–228
Solensky F, Christensen M, Kimball K (2006) Rfc 4541: considerations for internet group management protocol (IGMP) and multicast listener discovery (MLD) snooping switches
McBride M, Lui H (2012) Multicast in the data center overview. IETF, Internet Draft
Atwood JW (2004) A classification of reliable multicast protocols. IEEE Netw 18(3):24–34
Obraczka K (1998) Multicast transport protocols: a survey and taxonomy. Commun Mag IEEE 36(1):94–102
Chowdhury S, Fatema K (2013) Analysing TCP performance when link experiencing packet loss. Master’s thesis, University of Gothenburg, Göteborg, Sweden (2013)
Yamamoto K, Sawa Y, Yamamoto M, Ikeda H (2000) Performance evaluation of ack-based and nak-based flow control schemes for reliable multicast. In: TENCON 2000. Proceedings, vol 1, pp 341–345
Li D, Xu M, Liu Y, Xie X, Cui Y, Wang J, Chen G (2014) Reliable multicast in data center networks. Comput, IEEE Trans 63(8):2011–2024. doi:10.1109/TC.2013.91
Miliotis V, Alonso L, Verikoukis C (2014) CooPNC: a cooperative multicast protocol exploiting physical layer network coding. Ad Hoc Netw 14:35–50. doi:10.1016/j.adhoc.2013.11.004
Adamson B, Macker J, Bormann C, Handley M (2009) Rfc 5740: Nack-oriented reliable multicast (NORM) transport protocol. In: Technical report
Kasera SK, Hjalmtusson G, Towsley DF, Kurose JF (2000) Scalable reliable multicast using multiple multicast channels. IEEE/ACM Trans Netw 8(3):294–310
Gemmell J, Montgomery T, Speakman T, Crowcroft J (2003) The PGM reliable multicast protocol. Netw IEEE 17(1):16–22
Li J, Veeraraghavan M. May
Paul S, Sabnani KK, Lin JC-H, Bhattacharyya S (1997) Reliable multicast transport protocol (RMTP). IEEE J Sel Areas Commun 15(3):407–421
Yavatkar R, Griffoen J, Sudan M (1995) A reliable dissemination protocol for interactive collaborative applications. In: Proceedings of the third ACM international conference on multimedia, MULTIMEDIA ’95, pp 333–344. ACM, New York, NY, USA
Holbrook HW, Singhal SK, Cheriton DR (1995) Log-based receiver-reliable multicast for distributed interactive simulation. SIGCOMM Comput Commun Rev 25(4):328–341
Sheu T-L, Lin S-T (2013) A multicast retransmission scheme using negative ack in wireless networks. In: 2013 IEEE 27th international conference on advanced information networking and applications (AINA), pp 1144–1149
Palacios RH, Díaz AF, Ortega J, Rodríguez-Quintana C, Anguita M (2015) Analyzing high-throughput multicast traffic in cluster computing. In: Proceedings of the 15th international conference on computational and mathematical methods in science and engineering, CMMSE 2015 6–10
Acknowledgments
This research has been supported by the European Union FEDER and the Spanish Ministry of Economy and Competitiveness under grants TIN2012-32039 and CAPAP-H5 network TIN2014-53522-REDT and PROMEP/103.5/13/6475 UAEH-146.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Palacios, R.H., Díaz, A.F., Anguita, M. et al. High-throughput multi-multicast transfers in data center networks. J Supercomput 73, 152–163 (2017). https://doi.org/10.1007/s11227-016-1664-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-016-1664-4