Skip to main content
Springer Nature Link
Log in

High-throughput multi-multicast transfers in data center networks

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

It is usual that the applications executed in data centers require the distribution of the same data from one node to others at various execution points and that some of them require to cope with multiple of these diffusions in parallel. Multicast-based communications are an alternative solution to sending data efficiently to multiple nodes. This paper proposes a novel technique which offers reliability and congestion control in the multi-multicast transfers in data center networks. The proposal is based on: (1) a new congestion control mechanism, which monitors the control information of the receivers, reducing the server injection rate, (2) taking advantage of the switch diffusion hardware, and (3) using IGMP snooping, which allows a network switch to multicast a packet just to the output links with host receivers joined to a multicast group. The implementation is made at user level and uses the UDP interface. Evaluation tests are performed in a CentOS-based cluster composed of 12 servers in the presence of multiple diffusions at the same time. Test results show improvements in the global bandwidth, avoid network saturation, and reduce overhead included by unicast communications in data transmission.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. DRBD: Distributed replicated block device

  2. Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST ’10, pp 1–10. IEEE Computer Society, Washington, DC, USA

  3. Postel JB (1981) Transmission control protocol. Internet request for comments, September. RFC 793

  4. Lane RG, Daniels S, Yuan X (2007) An empirical study of reliable multicast protocols over ethernet-connected networks. Perform Eval 64(3):210–228

    Article  Google Scholar 

  5. Solensky F, Christensen M, Kimball K (2006) Rfc 4541: considerations for internet group management protocol (IGMP) and multicast listener discovery (MLD) snooping switches

  6. McBride M, Lui H (2012) Multicast in the data center overview. IETF, Internet Draft

  7. Atwood JW (2004) A classification of reliable multicast protocols. IEEE Netw 18(3):24–34

    Article  Google Scholar 

  8. Obraczka K (1998) Multicast transport protocols: a survey and taxonomy. Commun Mag IEEE 36(1):94–102

    Article  Google Scholar 

  9. Chowdhury S, Fatema K (2013) Analysing TCP performance when link experiencing packet loss. Master’s thesis, University of Gothenburg, Göteborg, Sweden (2013)

  10. Yamamoto K, Sawa Y, Yamamoto M, Ikeda H (2000) Performance evaluation of ack-based and nak-based flow control schemes for reliable multicast. In: TENCON 2000. Proceedings, vol 1, pp 341–345

  11. Li D, Xu M, Liu Y, Xie X, Cui Y, Wang J, Chen G (2014) Reliable multicast in data center networks. Comput, IEEE Trans 63(8):2011–2024. doi:10.1109/TC.2013.91

    Article  MathSciNet  Google Scholar 

  12. Miliotis V, Alonso L, Verikoukis C (2014) CooPNC: a cooperative multicast protocol exploiting physical layer network coding. Ad Hoc Netw 14:35–50. doi:10.1016/j.adhoc.2013.11.004

    Article  Google Scholar 

  13. Adamson B, Macker J, Bormann C, Handley M (2009) Rfc 5740: Nack-oriented reliable multicast (NORM) transport protocol. In: Technical report

  14. Kasera SK, Hjalmtusson G, Towsley DF, Kurose JF (2000) Scalable reliable multicast using multiple multicast channels. IEEE/ACM Trans Netw 8(3):294–310

    Article  Google Scholar 

  15. Gemmell J, Montgomery T, Speakman T, Crowcroft J (2003) The PGM reliable multicast protocol. Netw IEEE 17(1):16–22

    Article  Google Scholar 

  16. Li J, Veeraraghavan M. May

  17. Paul S, Sabnani KK, Lin JC-H, Bhattacharyya S (1997) Reliable multicast transport protocol (RMTP). IEEE J Sel Areas Commun 15(3):407–421

    Article  Google Scholar 

  18. Yavatkar R, Griffoen J, Sudan M (1995) A reliable dissemination protocol for interactive collaborative applications. In: Proceedings of the third ACM international conference on multimedia, MULTIMEDIA ’95, pp 333–344. ACM, New York, NY, USA

  19. Holbrook HW, Singhal SK, Cheriton DR (1995) Log-based receiver-reliable multicast for distributed interactive simulation. SIGCOMM Comput Commun Rev 25(4):328–341

    Article  Google Scholar 

  20. Sheu T-L, Lin S-T (2013) A multicast retransmission scheme using negative ack in wireless networks. In: 2013 IEEE 27th international conference on advanced information networking and applications (AINA), pp 1144–1149

  21. Palacios RH, Díaz AF, Ortega J, Rodríguez-Quintana C, Anguita M (2015) Analyzing high-throughput multicast traffic in cluster computing. In: Proceedings of the 15th international conference on computational and mathematical methods in science and engineering, CMMSE 2015 6–10

Download references

Acknowledgments

This research has been supported by the European Union FEDER and the Spanish Ministry of Economy and Competitiveness under grants TIN2012-32039 and CAPAP-H5 network TIN2014-53522-REDT and PROMEP/103.5/13/6475 UAEH-146.

Author information

Authors and Affiliations

  1. Department of Computer Architecture and Technology, University of Granada, Granada, Spain

    Raúl H. Palacios, Antonio F. Díaz, Mancia Anguita, Julio Ortega & Cristina Rodríguez-Quintana

Authors
  1. Raúl H. Palacios
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Antonio F. Díaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mancia Anguita
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Julio Ortega
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Cristina Rodríguez-Quintana
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antonio F. Díaz.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Palacios, R.H., Díaz, A.F., Anguita, M. et al. High-throughput multi-multicast transfers in data center networks. J Supercomput 73, 152–163 (2017). https://doi.org/10.1007/s11227-016-1664-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-016-1664-4

Keywords

Search

Navigation