Skip to main content
Springer Nature Link
Log in

A decentralized clustering scheme for transparent mode devices

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Clustering multiple devices to form a single powerful device is a common method for improving performance. Most designs of the clustering schemes in the current literature are deploying a traffic splitter in front of devices in the cluster which acts as a centralized job dispatcher splitting workloads to backend devices. In this paper, we propose a decentralized clustering scheme, with no traffic splitter deployed, as an alternative solution on building a cluster system for those devices configured in transparent mode, such as bandwidth controllers, NIPSs, and traffic monitors. Devices in the cluster process the network traffic in parallel in a decentralized manner to scale the throughput. A device can also migrate its workload to others for the purpose of load balance or fault tolerance. Experiment results suggest that the proposed scheme can effectively improve performance of transparent mode devices in terms of throughput, load balance, and fault tolerance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Aversa, L., Bestavros, A.: Load balancing a cluster of web servers: using distributed packet rewriting. In: Proc. IEEE Int’l Conf. Performance, Computing, and Communications, pp. 24–29 (2000)

    Google Scholar 

  2. CAIDA: The Cooperative Association for Internet Data Analysis (2012). http://www.caida.org

  3. CAIDA trace statistics for passive monitor: Chicago A (2012). http://www.caida.org/data/passive/trace_stats/chicago-A/2011/?monitor=20110413-130000.UTC

  4. Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.S.: The state of the art in locally distributed web-server systems. ACM Comput. Surv. 34(2), 263–311 (2002)

    Article  Google Scholar 

  5. Devlin, B., Gray, J., Laing, B., Spix, G.: Scalability terminology: farms, clones, partitions, and packs: RACS and RAPS. Technical Report MS-TR-99-85, Microsoft Research (1999)

  6. Intel Corporation: Intel IXP425 Network Processor (2012). http://www.intel.com/design/network/products/npfamily/ixp425.htm

  7. Jo, J.-Y., Kim, Y., Chao, H.J., Merat, F.: Internet traffic load balancing using dynamic hashing with flow volumes. In: Internet Performance and Control of Network Systems III at SPIE ITCOM, pp. 154–165 (2002)

    Google Scholar 

  8. Jung, Y.C., Un, C.K., Ryu, S.M., Lee, S.C.: Analysis of out-of-sequence problem and preventative schemes in parallel switch architecture for high-speed ATM network. IEE Proc., Commun. 141(1), 29–38 (1994)

    Article  Google Scholar 

  9. Liu, J.-F., Dong, F.-M.: A dynamic adaptive load balance algorithm in parallel intrusion detection system. In: Int’l Symp. Computer Science and Computational Technology, pp. 180–183 (2008)

    Chapter  Google Scholar 

  10. Paxson, V., Asanovic, K., Dharmapurikar, S., Lockwood, J., Pang, R., Sommer, R., Weaver, N.: Rethinking hardware support for network analysis and intrusion prevention. In: Proc. USENIX Hot Security (2006)

    Google Scholar 

  11. Plotkin, N.T., Varaiya, P.P.: Performance analysis of parallel ATM connections for gigabit speed applications. In: Proc. INFOCOM, pp. 1186–1193 (1993)

    Google Scholar 

  12. Plummer, D.C.: An Ethernet address resolution. RFC 826 (1982)

  13. Saitoh, A., Masuda, H.: A transparent session migration and transparent fail-over protocol for PPPoE server cluster. In: IEEE Symp. Applications and Internet, pp. 255–261 (2004)

    Google Scholar 

  14. Seifert, R.: The Switch Book: The Complete Guide to LAN Switching Technology, pp. 68–70. ISBN:0-471-34586-5. Wiley, New York (2000)

    Google Scholar 

  15. Sharifian, S., Motamedi, S.A., Akbari, M.K.: Estimation-based load-balancing with admission control for cluster web servers. ETRI J. 31(2), 173–181 (2009)

    Article  Google Scholar 

  16. Spirent Federal Systems: Highest port density performance analysis system—SmartBits 6000C (2004). http://spcprev.spirent-com.com/documents/1050.pdf

  17. Tsai, P.-L., Huang, C.-Y., Huang, Y.-Y., Hsu, C.-C., Lei, C.-L.: A clustering and traffic-redistribution scheme for high-performance IPSec VPNs. In: Proc. IEEE Conf. High Performance Computing. LNCS, vol. 3769, pp. 432–443 (2005)

    Google Scholar 

  18. Vallentin, M., Sommer, R., Lee, J., Leres, C., Paxson, V., Tierney, B.: The NIDS cluster: scalable, stateful network intrusion detection on commodity hardware. In: Proc. Int’l Symp. Recent Advanced in Intrusion Detection (2007)

    Google Scholar 

  19. Wikipedia: MAC address (2012). http://en.wikipedia.org/wiki/MAC_address

  20. Wikipedia: Edge device (2012). http://en.wikipedia.org/wiki/Edge_device

  21. Xinidis, K., Charitakis, I., Antonatos, S., Anagnostakis, K.G., Markatos, E.P.: An active splitter architecture for intrusion detection and prevention. IEEE Trans. Dependable Secure Comput. 3(1), 31–44 (2006)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the National Science Council under the Grant NSC 99-2628-E-002-023-MY3.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Rd., Taipei, 106, Taiwan

    Chien-Hua Chiu & Chin-Laung Lei

Authors
  1. Chien-Hua Chiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chin-Laung Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chien-Hua Chiu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chiu, CH., Lei, CL. A decentralized clustering scheme for transparent mode devices. Cluster Comput 15, 265–279 (2012). https://doi.org/10.1007/s10586-012-0218-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-012-0218-7

Keywords

Search

Navigation