Skip to main content
SpringerLink
Log in

Consistent hashing with bounded loads and virtual nodes-based load balancing strategy for proxy cache cluster

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Response time and bandwidth occupancy of backbone network are greatly affected by load balancing and cache hit ratio in proxy cache cluster (PCC). A novel load balancing strategy is proposed to improve the homogeneous and heterogeneous PCC performance. By combining with the different performance parameters, performance ratio can be formulated with independent information data fluctuation weighting method, and the virtual nodes (VNs) attached to every cache node (CN) can be generated by a random function. The greatest common divisor m of the number of VNs attached to every CN can be calculated and the hash ring is cut into m arcs, and the VNs are mapped proportionally to arcs of the hash ring by the MD5 function. Requests are assigned to VNs based on the forwarding rule of consistent hashing with bounded loads, and the CN in correspondence with the VNs will be selected to provide services. Simulation results show that the strategy can significantly improve the load balancing in homogeneous and heterogeneous PCC, effectively reduce bandwidth occupancy of backbone network and PCC response time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  1. Kumar, C.A., Vimala, R., Britto, K.R.A., Devi, S.S.: FDLA: fractional dragonfly based load balancing algorithm in cluster cloud model. J. Clust. Comput. 22, 1401–1414 (2019). https://doi.org/10.1007/s10586-018-1977-6

    Article  Google Scholar 

  2. Tamilvizhi, T., Parvathavarthini, B.: A novel method for adaptive fault tolerance during load balancing in cloud computing. J. Clust. Comput. (2017). https://doi.org/10.1007/s10586-017-1038-6

    Article  Google Scholar 

  3. Mazhar, M.H., Shafiq, Z.: Real-time video quality of experience monitoring for https and quic. In: Proceedings of IEEE Conference on Computer Communications, Honolulu, HI, USA, pp. 1331–1339 (2018). https://doi.org/10.1109/INFOCOM.2018.8486321

  4. Zhang, K.Y., Gui, X.L., Ren, D.W., Li, J., Wu, J., Ren, D.S.: Survey on computation offloading and content caching in mobile edge networks. J. Ruan Jian Xue Bao/J. Softw. 30(8), 2491–2516 (2019). https://doi.org/10.13328/j.cnki.jos.005861

    Article  Google Scholar 

  5. Chavan, S., Lodha, N., Rautela, A., Gupta, K.: Enhancing performance of proxy cache servers using daemon process. J. Adv. Data Inf. Sci. 39, 247–257 (2018). https://doi.org/10.1007/978-981-13-0277-0_20

    Article  Google Scholar 

  6. Guo, C.C., Yan, P.L.: A dynamic load balancing algorithm for heterogeneous web server cluster. J. Ji Suan Ji Xue Bao/Chin. J. Comput. 28(2), 179–184 (2005)

    Google Scholar 

  7. Liu, W.Y., Lin, F., Ma, X.T.: Bike-sharing data visualization system based on cluster architecture. J. Transducer Microsyst. Technol. 38(2), 80–82 (2019). https://doi.org/10.13873/j.1000-9787(2019)02-0080-03

    Article  Google Scholar 

  8. Lee, D., Kim, K.J.: Improving web cache server performance through arbitral thread and delayed caching. J. Clust. Comput. 15, 17–25 (2012). https://doi.org/10.1007/s10586-010-0143-6

    Article  Google Scholar 

  9. Pernabas, J.B., Fidele, S.F., Vaithinathan, K.K.: Enhancing greedy web proxy caching using weighted random indexing based data mining classifier. J. Egypt. Inform. J. 20(2), 117–130 (2019). https://doi.org/10.1016/j.eij.2019.01.001

    Article  Google Scholar 

  10. Zhao, J., Yang, K., Wei, X.H., Ding, Y., Hu, L., Xu, G.C.: A heuristic clustering-based task deployment approach for load balancing using Bayes theorem in cloud environment. J. Parallel Distrib. Syst. 27(2), 305–316 (2015). https://doi.org/10.1109/TPDS.2015.2402655

    Article  Google Scholar 

  11. Lu, S.L., Fang, H., Wei, Y.: Distributed clustering algorithm for energy efficiency and load-balance in large-scale multi-agent systems. J. Syst. Sci. Complex. 31, 234–243 (2018). https://doi.org/10.1007/s11424-018-7369-4

    Article  MATH  Google Scholar 

  12. Li, Z., Simon, G.: Cooperative caching in a content centric network for video stream delivery. J. Netw. Syst. Manag. 23(3), 445–473 (2015). https://doi.org/10.1007/s10922-014-9300-1

    Article  Google Scholar 

  13. Yu, A., Yang, S.: Research on web server cluster load balancing algorithm in web education system. J. Supercomput. (2018). https://doi.org/10.1007/s11227-018-2573-5

    Article  Google Scholar 

  14. Pak, I., Qiao, B.Y., Shen, M.C., Zhu, J.H., Chen, D.H.: An efficient load balancing approach for N-hierarchical web server cluster. Wuhan Univ. J. Nat. Sci. 20(6), 537–542 (2015). https://doi.org/10.1007/s11859-015-1130-9

    Article  MathSciNet  Google Scholar 

  15. Milani, A.S., Navimipour, N.J.: Load balancing mechanisms and techniques in the cloud environments: systematic literature review and future trends. J. Netw. Comput. Appl. 71, 86–98 (2016). https://doi.org/10.1016/j.jnca.2016.06.003

    Article  Google Scholar 

  16. Stoica, I., Morris, R., Liben-Nowell, D., Karger, D.R., Kaashoek, M.F., Dabek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Trans. Netw. (TON) 11(1), 17–32 (2003). https://doi.org/10.1109/TNET.2002.808407

    Article  Google Scholar 

  17. Qiu, N.J., Hu, X.J., Wang, P., Yang, H.M.: Research on optimization strategy for data clustered storage using a consistent hash algorithm. J. Inf. Control. 45(6), 747–752 (2016). https://doi.org/10.13976/j.cnki.xk.2016.0747

    Article  Google Scholar 

  18. Ba, Z.Y., Wu, J., Ma, Y.: The optimization for consistent hash based on virtual node. J. Softw. 35(12), 26–29 (2014). https://doi.org/10.3969/j.issn.1003-6970.2014.12.006

    Article  Google Scholar 

  19. Yao, J.G., Guan, H.B., Luo, J.Y., Lei, R., Liu, X.: Adaptive power management through thermal aware workload balancing in internet data centers. J. Parallel Distrib. Syst. 26(9), 2400–2409 (2014). https://doi.org/10.1109/TPDS.2014.2353051

    Article  Google Scholar 

  20. Takatsu, F., Hiraga, K., Tatebe, O.: PPFS: A scale-out distributed file system for post-petascale systems. J. Inf. Process. 25, 438–447 (2017). https://doi.org/10.2197/ipsjjip.25.438

    Article  Google Scholar 

  21. Xu, Z.M., Sun, A.D., Han, Z.M., Yu, X.Y., Zhang, Y.: Improvement of particle deposition model using random function method. J. Build. Environ. 158, 192–204 (2019). https://doi.org/10.1016/j.buildenv.2019.05.021

    Article  Google Scholar 

  22. Nie, S.Q., Wu, W.G., Zhang, X.J., Cai, Y., Xu, Z.W.: Object placement algorithm based on jump hash. J. Ruan Jian Xue Bao/J. Softw. 28(8), 1929–1939 (2017)

    MathSciNet  Google Scholar 

  23. Archer, A., Aydin, K., Bateni, M.H., Mirrokni, V., Schild, A., Yang, R., Zhuang, R.: Cache-aware load balancing of data center applications. J. Proc. VLDB Endow. 12(6), 709–723 (2019). https://doi.org/10.14778/3311880.3311887

    Article  Google Scholar 

  24. Dasgupta, K., Mandal, B., Dutta, P., Mandal, J.K., Dam, S.: A genetic algorithm (ga) based load balancing strategy for cloud computing. J. Procedia Technol. 10, 340–347 (2013). https://doi.org/10.1016/j.protcy.2013.12.369

    Article  Google Scholar 

  25. Gutierrez-Garcia, J.O., Ramirez-Nafarrate, A.: Agent-based load balancing in cloud data centers. J. Clust. Comput. 18(3), 1041–1062 (2015). https://doi.org/10.1007/s10586-015-0460-x

    Article  Google Scholar 

  26. Gao, Z.B., Pan, Y.C., Hua, Z., Duan, X.H., Zhao, D.: Improved load balancing algorithm based on weighted minimum connection number. J. Sci. Technol. Eng. 16(6), 81–85 (2016)

    Google Scholar 

  27. Yu, Y.H., Wang, W., Huang, R.F., Zhang, J., Letaief, K.: Achieving load-balanced, redundancy-free cluster caching with selective partition. J. Parallel Distrib. Syst. (2019). https://doi.org/10.1109/TPDS.2019.2931004

    Article  Google Scholar 

  28. Zhang, X.W., Wu, G., Wang, S.: Prefetching strategy of streaming data based on correlation in interactive behavior. J. Chin. Comput. Syst. 35(8), 1738–1742 (2014)

    Google Scholar 

  29. Yu, M.J., Li, R.: A caching decision and replacement strategy based on dynamic content popularity for NDN. J. Comput. Eng. Sci. 41(2), 275–280 (2019)

    Google Scholar 

  30. Sun, Y., Liu, J., Ye, D., Zhong, H.: Load balancing framework for metadata service of distributed file systems. J. Ruan Jian Xue Bao/J. Softw. 27(12), 3192–3207 (2016). https://doi.org/10.13328/j.cnki.jos.004930

    Article  Google Scholar 

  31. He, H., Cui, L.J., Zhou, F.L., Wang, D.: Distributed proxy cache technology based on autonomic computing in smart cities. J. Future Gener. Comput. Syst. 76, 370–383 (2017). https://doi.org/10.1016/j.future.2016.03.015

    Article  Google Scholar 

  32. Hu, Y.Q., Li, X.N.: A new cache replacement mechanism for streaming media proxy based on recommendation. J. Yanshan Univ. 39(2), 139–144+151 (2015)

  33. Wen, Z.P., Li, G.L., Yang, G.H.: Research and realization of Nginx-based dynamic feedback load balancing algorithm. In: Proceedings of 3rd Advanced Information Technology on Electronic and Automation Control (IAEAC), Chongqing, China, pp. 2541–2546 (2018). https://doi.org/10.1109/IAEAC.2018.8577911

  34. Li, W., Liang, J.W., Ma, X., Qin, B., Liu, B.: A dynamic load balancing strategy based on HAProxy and tcp long connection multiplexing technology. In: Proceedings of the Fifth Euro-China Conference on Intelligent Data Analysis and Applications, Xian, China, pp. 36–43 (2018). https://doi.org/10.1007/978-3-030-03766-6_5

  35. Wang, J., Berg, B., Berger, D.S., Sen, S.: Maximizing page-level cache hit ratios in large web services. J. ACM SIGMETRICS Perform. Eval. Rev. 46(2), 91–92 (2019). https://doi.org/10.1145/3305218.3305253

    Article  Google Scholar 

  36. Memon, P., Hafiz, T., Bhatti, S., Qureshi, S.S.: Comparative study of testing tools Blazemeter and Apache JMeter. J. Sukkur IBA J. Comput. Math. Sci. 2(1), 70–76 (2018). https://doi.org/10.30537/sjcms.v2i1.66

    Article  Google Scholar 

  37. Mirrokni, V., Thorup, M., Zadimoghaddam, M.: Consistent hashing with bounded loads. J. Soc. Ind. Appl. Math. (2018). https://doi.org/10.1137/1.9781611975031.39

    Article  MATH  Google Scholar 

  38. Teh, J.S., Tan, K.J., Alawida, M.: A chaos-based keyed hash function based on fixed point representation. J. Clust. Comput. 22(2), 649–660 (2019). https://doi.org/10.1007/s10586-018-2870-z

    Article  Google Scholar 

  39. Chen, P.Y., Yu, H.M., Liu, Y., Li, C., Peng, Z.W.: Evaluation of debris flow risk based on independent information data fluctuation weighting method. J. Rock Soil Mech. 34(2), 449–454 (2013). https://doi.org/10.16285/j.rsm.2013.02.020

    Article  Google Scholar 

  40. Yu, L.P., Pan, Y.T., Wu, Y.S.: A new objective weighting method of sci-tech evaluation—independent information data fluctuation weighting method DIDF. J. Soft Sci. 24(11), 32–37 (2010)

    Google Scholar 

  41. Shen, D.D.: Regression analysis and prediction of highway passenger volume. J. Adv. Soc. Sci. 6(2), 151–160 (2017). https://doi.org/10.12677/ass.2017.62020

    Article  Google Scholar 

  42. Oliveira, G., Magalhães, F., Cunha, Á., Caetano, E.: Continuous dynamic monitoring of an onshore wind turbine. J. Eng. Struct. 164, 22–39 (2018). https://doi.org/10.1016/j.engstruct.2018.02.030

    Article  Google Scholar 

  43. Rosas, E., Hidalgo, N., Marin, M., Gil-Costa, V.: Web search results caching service for structured P2P networks. J. Future Gener. Comput. Syst. 30, 254–264 (2014). https://doi.org/10.1016/j.future.2013.06.018

    Article  Google Scholar 

Download references

Funding

This work is supported by the National Key R&D Program of China through the Framework of International Science and Technology Innovation Cooperation Program (China-Korea) (Grant No. 2017YFE0123000).

Author information

Authors and Affiliations

  1. Key Laboratory of Industrial Internet of Things & Networked Control, Ministry of Education, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China

    Min Xiang, Yuzhou Jiang, Zhong Xia & Chunmei Huang

Authors
  1. Min Xiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuzhou Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhong Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chunmei Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Min Xiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Abbreviations query table

Symbols

Full name

Description

PCC

Proxy cache cluster

A group of proxy servers which implements the cache mechanism and provides services for clients by deploying cache nodes on the edge of the backbone network

VNs

Virtual nodes

Numerous virtual cache nodes which are randomly distributed on the hash ring, and there is a corresponding relationship between them and real cache nodes

CN

Cache node

A node that cache data

CNs

Cache nodes

Nodes that cache data

BOBN

Bandwidth Occupancy of Backbone Network

A index which reflects data transmission in public network

LBD

Load balance degree

A index which shows load-balancing effect of proxy cache cluster

CHR

Cache hit ratio

A index which shows the cache hits of proxy cache cluster

CHWBL

Consistent hashing with bounded loads

The original strategy

CHWBLVN

Consistent hashing with bounded loads and virtual nodes

The strategy that we proposed based on consistent hashing with bounded loads

PQV

Performance quantified value

A index which reflects the performance of a cache node

IIDFW

Independent information data fluctuation weighting

A method which can receive node performance parameters and calculate the performance quantified value of the node

MS

Memory size

A node performance parameter

CCN

CPU core number

A node performance parameter

DS

Disk size

A node performance parameter

GCD

Greatest common divisor

The largest common divisor of multiple integers

WS

Web server

The source server for storage resource, which can only be accessed through public network

LB

Load balancer

A node which determines load distribution

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiang, M., Jiang, Y., Xia, Z. et al. Consistent hashing with bounded loads and virtual nodes-based load balancing strategy for proxy cache cluster. Cluster Comput 23, 3139–3155 (2020). https://doi.org/10.1007/s10586-020-03076-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03076-4

Keywords

Search

Navigation