Skip to main content
Log in

Scalable crossbar network: a non-blocking interconnection network for large-scale systems

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Interconnection networks (INs) are used in wide applications of multi-processor systems in order to set up connections between various nodes such as processors and memory modules. However, there is a fundamental problem in INs that has always been considered as one of the most challenging issues in this area. Blocking problem in these networks degrades network performance and consequently the performance of the whole system. In the meantime, the main option for dealing with this problem is the use of non-blocking crossbar networks. However, there are engineering and scaling difficulties when using these networks in large-scale systems. The number of pins on a VLSI chip cannot exceed a few hundreds, which restricts the size of the largest crossbar that should be integrated into a single VLSI chip. Using the idea of multistage implementation of crossbar network can resolve the problem. However, the next problem that arises with this idea is high hardware cost. Therefore, in this paper, a new implementation of crossbar network named scalable crossbar network (SCN) that is a non-blocking network is presented to cope with the aforementioned scaling problems. In addition, performance analysis results show that SCN outperforms multistage crossbar networks and multistage interconnection networks in terms of terminal reliability, mean time to failure, and system failure rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Jadhav SS (2009) Advanced computer architecture and computing. Technical publications, India

    Google Scholar 

  2. El-Rewini H, Abd-El-Barr M (2005) Advanced computer architecture and parallel processing. Wiley, Hoboken

    Google Scholar 

  3. Dubois M, Annavaram M, Stenström P (2012) Parallel computer organization and design. Cambridge University Press, New York

    Book  Google Scholar 

  4. Bistouni F, Jahanshahi M (2014) Pars network: a multistage interconnection network with fault-tolerance capability. J Parallel Distrib Comput (2014). http://dx.doi.org/10.1016/j.jpdc.2014.08.005

  5. Arabnia HR (2008) A scalable network topology for medical imaging. In: 10th IEEE international conference on high performance computing and communications 2008 (HPCC’08). IEEE

  6. Arabnia HR, Smith JW (1993) A reconfigurable interconnection network for imaging operations and its implementation using a multi-stage switching box. In: Proceedings of the 7th annual international high performance computing conference

  7. Arabnia HR, Oliver MA (1987) A transputer network for the arbitrary rotation of digitised images. Comput J 30(5):425–432

    Article  Google Scholar 

  8. Bhandarkar SM, Arabnia HR (1995) The REFINE multiprocessor—theoretical properties and algorithms. Parallel Comput 21(11):1783–1805

    Article  Google Scholar 

  9. Bhandarkar SM, Arabnia HR (1995) The Hough transform on a reconfigurable multi-ring network. J Parallel Distrib Comput 24(1):107–114

    Article  Google Scholar 

  10. Duato J, Yalamanchili S (2003) Interconnection networks: an engineering approach. Morgan Kaufmann, San Francisco

    Google Scholar 

  11. Navaridas J et al (2011) Simulating and evaluating interconnection networks with INSEE. Simul Model Pract Theory 19(1):494–515

    Article  Google Scholar 

  12. Li Y, Peng S, Chu W (2010) Metacube—a versatile family of interconnection networks for extremely large-scale supercomputers. J Supercomput 53(2):329–351

    Article  Google Scholar 

  13. Lüdtke D, Tutsch D (2009) The modeling power of CINSim: performance evaluation of interconnection networks. Comput Netw 53(8):1274–1288

  14. Dally WJ, Towles BP (2004) Principles and practices of interconnection networks. Morgan Kaufmann, San Francisco

  15. Wang X, Xiang D (2013) TM: a new and simple topology for interconnection networks. J Supercomput 66(1):514–538

    Article  MathSciNet  Google Scholar 

  16. Luo W, Xiang D (2012) An efficient adaptive deadlock-free routing algorithm for torus networks. IEEE Trans Parallel Distrib Syst 23(5):800–808

  17. Garofalakis J, Stergiou E (2013) An analytical model for the performance evaluation of multistage interconnection networks with two class priorities. Future Gener Comput Syst 29(1):114–129

  18. Escudero-Sahuquillo J et al (2013) An effective and feasible congestion management technique for high-performance MINs with tag-based distributed routing. IEEE Trans Parallel Distrib Syst 24(10):1918–1929

    Article  Google Scholar 

  19. Swaminathan K, Lakshminarayanan G, Ko S-B (2014) Design and verification of an efficient WISHBONE-based network interface for network on chip. Comput Electr Eng 40(6):1838–1857

  20. Bistouni F, Jahanshahi M (2014) Improved extra group network: a new fault-tolerant multistage interconnection network. J Supercomput 69(1):161–199

  21. Villar JA et al (2013) An integrated solution for QoS provision and congestion management in high-performance interconnection networks using deterministic source-based routing. J Supercomput 66(1):284–304

    Article  Google Scholar 

  22. Hur JY et al (2007) Systematic customization of on-chip crossbar interconnects. In: Diniz PC, Marques E, Bertels K, Fernandes MM, Cardoso JMP (eds) Reconfigurable computing: architectures, tools and applications. Springer, Berlin, Heidelberg, pp 61–72

  23. Parker DS, Raghavendra CS (1984) The gamma network. IEEE Trans Comput 100(4):367–373

    Article  Google Scholar 

  24. Rajkumar S, Goyal NK (2014) Design of 4-disjoint gamma interconnection network layouts and reliability analysis of gamma interconnection networks. J Supercomput 69(1): 468–491

  25. Chen C-W, Chung C-P (2005) Designing a disjoint paths interconnection network with fault tolerance and collision solving. J Supercomput 34(1):63–80

  26. Garhwal NS, Srivastava N (2011) Designing a fault-tolerant fully-chained combining switches multi-stage interconnection network with disjoint paths. J Supercomput 55(3): 400–431

  27. Wei S, Lee G (1988) Extra group network: a cost-effective fault-tolerant multistage interconnection network. ACM SIGARCH computer architecture news, vol 16. no. 2. IEEE Computer Society Press

  28. Matos D et al (2013) Hierarchical and multiple switching NoC with floorplan based adaptability. In: Brisk P, Coutinho JGF, Diniz PC (eds) Reconfigurable computing: architectures, tools and applications. Springer, Berlin, Heidelberg, pp 179–184

  29. Kumar VP, Reddy SM (1987) Augmented shuffle-exchange multistage interconnection networks. Computer 20(6):30–40

    Article  Google Scholar 

  30. Vasiliadis DC, Rizos GE, Vassilakis C (2013) Modelling and performance study of finite-buffered blocking multistage interconnection networks supporting natively 2-class priority routing traffic. J Netw Comput Appl 36(2):723–737

    Article  Google Scholar 

  31. Gunawan I (2008) Reliability analysis of shuffle-exchange network systems. Reliab Eng Syst Saf 93(2):271–276

    Article  MathSciNet  Google Scholar 

  32. Blake JT, Trivedi KS (1989) Reliability analysis of interconnection networks using hierarchical composition. IEEE Trans Reliab 38(1):111–120

    Article  Google Scholar 

  33. Bansal PK, Joshi RC, Singh K (1994) On a fault-tolerant multistage interconnection network. Comput Electr Eng 20(4): 335–345

  34. Bistouni F, Jahanshahi M (2014) Analyzing the reliability of shuffle-exchange networks using reliability block diagrams. Reliab Eng Syst Saf 132:97–106

    Article  Google Scholar 

  35. Blake JT, Trivedi KS (1989) Multistage interconnection network reliability. IEEE Trans Comput 38(11):1600–1604

    Article  Google Scholar 

  36. Nitin, Subramanian A (2008) Efficient algorithms and methods to solve dynamic MINs stability problem using stable matching with complete ties. J Discret Algorithms 6(3):353–380

  37. Fan CC, Bruck J (2000) Tolerating multiple faults in multistage interconnection networks with minimal extra stages. IEEE Trans Comput 49(9):998–1004

  38. Adams GB, Siegel HJ (1982) The extra stage cube: a fault-tolerant interconnection network for supersystems. IEEE Trans Comput 100(5):443–454

    Article  Google Scholar 

  39. Tutsch D, Hommel G (2008) MLMIN: a multicore processor and parallel computer network topology for multicast. Comput Oper Res 35(12):3807–3821

  40. Çam H (2001) Analysis of shuffle-exchange networks under permutation trafic. In: Du DZ, Ngo HQ (eds) Switching networks: recent advances. Springer, US, pp 215–256

  41. Çam H (2003) Rearrangeability of \((2n-1)\)-stage shuffle-exchange networks. SIAM J Comput 32(3):557–585

    Article  MATH  MathSciNet  Google Scholar 

  42. Dai H, Shen X (2008) Rearrangeability of 7-stage 16\(\times \) 16 shuffle exchange networks. Front Electr Electron Eng China 3(4):440–458

  43. Beneš VE (1965) Mathematical theory of connecting networks and telephone traffic, vol. 17. Academic Press, New York

  44. Clos C (1953) A study of non-blocking switching networks. Bell Syst Tech J 32(2):406–424

    Article  Google Scholar 

  45. Kolias C, Tomkos I (2005) Switch fabrics. IEEE Circuits Devices Mag 21(5):12–17

  46. Fey D et al (2012) Optical multiplexing techniques for photonic Clos networks in high performance computing architectures. J Supercomput 62(2):620–632

    Article  MathSciNet  Google Scholar 

  47. Cuda D, Giaccone P, Montalto M (2012) Design and control of next generation distribution frames. Comput Netw 56(13):3110–3122

    Article  Google Scholar 

  48. Sibai FN (2011) Design and evaluation of low latency interconnection networks for real-time many-core embedded systems. Comput Electr Eng 37(6):958–972

    Article  Google Scholar 

  49. Das N, Mukhopadhyaya K, Dattagupta J (2000) O (n) routing in rearrangeable networks. J Syst Archit 46(6):529–542

    Article  Google Scholar 

  50. Newman P (1989) Fast packet switching for integrated services. University of Cambridge, Computer Laboratory

  51. Bauer E (2010) Design for reliability: information and computer-based systems. Wiley, Hoboken

    Book  Google Scholar 

  52. Veglis A, Pomportsis A (2001) Dependability evaluation of interconnection networks. Comput Electr Eng 27(3):239–263

    Article  MATH  Google Scholar 

  53. Dash RK et al (2012) Network reliability optimization problem of interconnection network under node-edge failure model. Appl Soft Comput 12(8):2322–2328

    Article  MathSciNet  Google Scholar 

  54. Fard NS, Gunawan I (2002) Reliability bounds for large multistage interconnection networks. In: Fagerholm J, Haataja J, Järvinen J, Lyly M, Råback P, Savolainen V (eds) Applied parallel computing. Springer, Berlin, Heidelberg, pp 507–514

  55. Zhu Q, Wang X-K, Cheng G (2013) Reliability evaluation of BC networks. IEEE Trans Comput 62(11):2337–2340

    Article  MathSciNet  Google Scholar 

  56. Lee SE (2013) Adaptive error correction in Orthogonal Latin Square Codes for low-power, resilient on-chip interconnection network. Microelectron Reliab 53(3):509–511

  57. Zarezadeh S, Asadi M (2013) Network reliability modeling under stochastic process of component failures. IEEE Trans Reliab 62(4):917–929

  58. Li Y-F, Sansavini G, Zio E (2013) Non-dominated sorting binary differential evolution for the multi-objective optimization of cascading failures protection in complex networks. Reliab Eng Syst Saf 111:195–205

    Article  Google Scholar 

  59. Kang W-H, Kliese A (2014) A rapid reliability estimation method for directed acyclic lifeline networks with statistically dependent components. Reliab Eng Syst Saf 124:81–91

    Article  Google Scholar 

  60. Kim Y, Kang W-H (2013) Network reliability analysis of complex systems using a non-simulation-based method. Reliab Eng Syst Saf 110:80–88

    Article  Google Scholar 

  61. Blake JT, Trivedi KS (1988) Reliability of the shuffle-exchange network and its variants. In: System sciences, vol I. Proceedings of the twenty-first annual Hawaii international conference on architecture track, vol 1. IEEE

  62. Kang W-H, Song J, Gardoni P (2008) Matrix-based system reliability method and applications to bridge networks. Reliab Eng Syst Saf 93(11):1584–1593

    Article  Google Scholar 

  63. Shuang Q, Zhang M, Yuan Y (2014) Node vulnerability of water distribution networks under cascading failures. Reliab Eng Syst Saf 124:132–141

    Article  Google Scholar 

  64. Padmavathy N, Chaturvedi SK (2013) Evaluation of mobile ad hoc network reliability using propagation-based link reliability model. Reliab Eng Syst Saf 115:1–9

    Article  Google Scholar 

  65. Jahanshahi M, Dehghan M, Meybodi MR (2013) LAMR: learning automata based multicast routing protocol for multi-channel multi-radio wireless mesh networks. Appl Intell 38(1): 58–77

  66. Jahanshahi M, Dehghan M, Meybodi MR (2013) On channel assignment and multicast routing in multi-channel multi-radio wireless mesh networks. Int J Ad Hoc Ubiquitous Comput 12(4): 225–244

  67. Jahanshahi M, Dehghan M, Meybodi MR (2011) A mathematical formulation for joint channel assignment and multicast routing in multi-channel multi-radio wireless mesh networks. J Netw Comput Appl 34(6): 1869–1882

  68. Jahanshahi M, Barmi AT (2014) Multicast routing protocols in wireless mesh networks: a survey. Computing 1–29

  69. Jahanshahi M, Maddah M, Najafizadegan N (2013) Energy aware distributed partitioning detection and connectivity restoration algorithm in wireless sensor networks. Int J Math Model Comput 3(1): 71–82

  70. Jahanshahi M, Rahmani S, Ghaderi S (2013) An efficient cluster head selection algorithm for wireless sensor networks using fuzzy inference systems. Int J Smart Electr Eng 2(2): 121–125

  71. Ebrahimi N, McCullough K, Xiao Z (2013) Reliability of sensors based on nanowire networks operating in a dynamic environment. IEEE Trans Reliab 62(4):908–916

    Article  Google Scholar 

  72. Schneider K et al (2013) Social network analysis via multi-state reliability and conditional influence models. Reliab Eng Syst Saf 109:99–109

    Article  Google Scholar 

  73. Lin Y-K, Chang P-C (2013) A novel reliability evaluation technique for stochastic-flow manufacturing networks with multiple production lines. IEEE Trans Reliab 62(1):92–104

  74. Gunawan I (2008) Redundant paths and reliability bounds in gamma networks. Appl Math Model 32(4):588–594

    Article  MATH  Google Scholar 

  75. Birolini A (2014) Reliability engineering: theory and practice. Springer, Berlin

    Book  Google Scholar 

  76. Koren I, Krishna CM (2007) Fault-tolerant systems. Morgan Kaufmann, San Francisco

  77. Mettas A, Savva M (2001) System reliability analysis: the advantages of using analytical methods to analyze non-repairable systems. In: Proceedings on annual reliability and maintainability symposium. IEEE

  78. Stapelberg RF (2009) Handbook of reliability, availability, maintainability and safety in engineering design. Springer, London

  79. McCool JI (2012) Using the Weibull distribution: reliability, modeling and inference. Wiley, Hoboken

    Book  Google Scholar 

  80. Online reliability engineering e-textbook. http://www.engineeredsoftware.com/nasa/weibull.htm

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohsen Jahanshahi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bistouni, F., Jahanshahi, M. Scalable crossbar network: a non-blocking interconnection network for large-scale systems. J Supercomput 71, 697–728 (2015). https://doi.org/10.1007/s11227-014-1319-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-014-1319-2

Keywords

Navigation