Skip to main content
SpringerLink
Log in

A flexible and high-performance data center network topology

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In order to meet the insatiable demands for cloud-based services, today’s data centers may have hundreds of thousands of servers. During the past decade, many topologies have been proposed to interconnect a large number of servers in a data center network. However, existing topologies face several challenges including the rigid structure, high network cost, and packet relay overheads on servers. In this paper, we propose a novel switch-centric network topology, called DCCube, which offers many desirable properties for data center networking. DCCube is a flexible structure because, given the switches degree and the network diameter, it is possible to construct different structures with different number of connected servers, bisection bandwidth and network cost. Furthermore, DCCube can accommodate a large number of servers with high bisection bandwidth, low cost, small diameter and desirable path diversity. By comparing with existing data center network topologies, we show that DCCube achieves both high performance and low network cost. We also design both minimal and non-minimal routing algorithms for the proposed topology. Simulation results reveal that non-minimal routing is preferred for unbalanced traffic patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Abts D, Marty MR, Wells PM, Klausler P, Liu H (2010) Energy proportional datacenter networks. In: Proceedings of international symposium on computer architecture (ISCA’10), ACM, vol 38, pp 338–347

  2. Ahn JH, Binkert N, Davis A, McLaren M, Schreiber RS (2009) Hyperx: topology, routing, and packaging of efficient large-scale networks. In: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, ACM, p 41

  3. Al-Fares M, Loukissas A, Vahdat A (2008) A scalable, commodity data center network architecture. In: ACM SIGCOMM Computer communication review, ACM, vol 38, pp 63–74

  4. Arabnia HR (1990) A parallel algorithm for the arbitrary rotation of digitized images using process-and-data-decomposition approach. J Parall Distrib Comput 10(2):188–192

    Article  Google Scholar 

  5. Arabnia HR, Oliver MA (1987) A transputer network for the arbitrary rotation of digitised images. Comput J 30(5):425–432

    Article  Google Scholar 

  6. Arabnia HR, Smith JW (1993) A reconfigurable interconnection network for imaging operations and its implementation using a multi-stage switching box. In: Proceedings of the 7th Annual International High Performance Computing Conference, pp 349–357

  7. Azizi S, Hashemi N, Khonsari A (2016) Hhs: an efficient network topology for large-scale data centers. J Supercomput 72(3):874–899

    Article  Google Scholar 

  8. Bhuyan LN, Agrawal DP (1984) Generalized hypercube and hyperbus structures for a computer network. Comput IEEE Trans 100(4):323–333

    Article  MATH  Google Scholar 

  9. Dally WJ, Towles BP (2004) Principles and practices of interconnection networks. Morgan Kaufmann, Burlington, MA

    Google Scholar 

  10. Dean J, Ghemawat S (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Article  Google Scholar 

  11. Greenberg A, Hamilton JR, Jain N, Kandula S, Kim C, Lahiri P, Maltz DA, Patel P, Sengupta S (2009) Vl2: a scalable and flexible data center network. In: ACM SIGCOMM computer communication review, ACM, vol 39, pp 51–62

  12. Guo C, Lu G, Li D, Wu H, Zhang X, Shi Y, Tian C, Zhang Y, Lu S (2009) Bcube: a high performance, server-centric network architecture for modular data centers. In: ACM SIGCOMM computer communication review, ACM, vol 39, pp 63–74

  13. Guo C, Wu H, Tan K, Shi L, Zhang Y, Lu S (2008) Dcell: a scalable and fault-tolerant network structure for data centers. In: ACM SIGCOMM computer communication review, ACM, vol 38, pp 75–86

  14. Guo D, Chen T, Li D, Li M, Liu Y, Chen G (2013) Expandable and cost-effective network structures for data centers using dual-port servers. Computers IEEE Trans 62(7):1303–1317

    Article  MathSciNet  Google Scholar 

  15. Han S, Jang K, Park K, Moon S (2011) Packetshader: a gpu-accelerated software router. ACM SIGCOMM Comput Commun Rev 41(4):195–206

    Google Scholar 

  16. Jantsch A, Tenhunen H et al (2003) Networks on chip, vol 396. Kluwer Academic, Berlin

    Book  MATH  Google Scholar 

  17. Kim J, Dally W, Dally J, Abts D (2006) Adaptive routing in high-radix clos network. In: International Conference for High Performance Computing, Networking, Storage, and Analysis (SC06), IEEE

  18. Kim J, Dally WJ, Abts D (2007) Flattened butterfly: a cost-efficient topology for high-radix networks. In: Proceedings of international symposium on computer architecture (ISCA’07), ACM, vol 35, pp 126–137

  19. Kim J, Dally WJ, Scott S, Abts D (2008) Technology-driven, highly-scalable dragonfly topology. In: ACM SIGARCH computer architecture news, IEEE computer society, vol 36, pp 77–88

  20. Kreutz D, Ramos FM, Verissimo PE, Rothenberg CE, Azodolmolky S, Uhlig S (2015) Software-defined networking: a comprehensive survey. In: Proceedings of the IEEE, vol 103, pp 14–76

  21. Leiserson CE (1985) Fat-trees: universal networks for hardware-efficient supercomputing. Comput IEEE Trans 100(10):892–901

    Article  Google Scholar 

  22. Li D, Guo C, Wu H, Tan K, Zhang Y, Lu S (2009) Ficonn: Using backup port for server interconnection in data centers. In: IEEE INFOCOM, pp 2276–2285

  23. Li D, Wu J (2014) On the design and analysis of data center network architectures for interconnecting dual-port servers. In: IEEE INFOCOM, pp 1851–1859

  24. Li D, Wu J, Liu Z, Zhang F (2015) Dual-centric data center network architectures. In: Proceedings of the 44th International Conference on Parallel Processing, IEEE

  25. Liao Y, Yin J, Yin D, Gao L (2012) Dpillar: dual-port server interconnection network for large scale data centers. Comput Netw 56(8):2132–2147

    Article  Google Scholar 

  26. Parhami B (2002) Introduction to parallel processing: algorithms and architectures. Kluwer Academic, Berlin

    Google Scholar 

  27. Popa L, Egi N, Ratnasamy S, Stoica I (2010) Building extensible networks with rule-based forwarding. In: OSDI, pp 379–392

  28. Popa L, Ratnasamy S, Iannaccone G, Krishnamurthy A, Stoica I (2010) A cost comparison of datacenter network architectures. In: CoNEXT, ACM

  29. Singla A, Hong CY, Popa L, Godfrey PB (2012) Jellyfish: networking data centers randomly. In: 9th USENIX symposium on networked systems design and implementation (NSDI), vol 12

  30. Wang T, Su Z, Xia Y, Hamdi M (2014) Rethinking the data center networking: architecture, network protocols, and resource sharing. In: IEEE Access, vol 2, pp 1481–1496

  31. Wang T, Su Z, Xia Y, Muppala J, Hamdi M (2015) Designing efficient high performance server-centric data center network architecture. Comput Netw 79:283–296

    Article  Google Scholar 

  32. Wani MA, Arabnia HR (2003) Parallel edge-region-based segmentation algorithm targeted at reconfigurable multiring network. J Supercomput 25(1):43–62

    Article  MATH  Google Scholar 

  33. Yuan X (2011) On nonblocking folded-clos networks in computer communication environments. In: International parallel and distributed processing symposium, IEEE, pp 188–196

  34. Zhang Y, Ansari N (2013) On architecture design, congestion notification, tcp incast and power consumption in data centers. Commun Surv Tutor IEEE 15(1):39–64

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran, Iran

    Sadoon Azizi & Naser Hashemi

  2. Department of Electrical and Computer Engineering, University of Tehran, Tehran, Iran

    Ahmad Khonsari

  3. School of Computer Science, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran

    Ahmad Khonsari

Authors
  1. Sadoon Azizi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Naser Hashemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ahmad Khonsari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Naser Hashemi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azizi, S., Hashemi, N. & Khonsari, A. A flexible and high-performance data center network topology. J Supercomput 73, 1484–1503 (2017). https://doi.org/10.1007/s11227-016-1836-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-016-1836-2

Keywords

Search

Navigation