Skip to main content
SpringerLink
Log in

Swarm optimization algorithms applied to multi-resource fair allocation in heterogeneous cloud computing systems

  • Published:
Computing Aims and scope Submit manuscript

Abstract

Resource fair allocation is a challenging problem in heterogeneous cloud computing systems, both in real-life problems and for scientific research purposes. However, it is an NP-hard problem and solutions obtained by existing heuristic algorithms have a significant gap up to the optimal solutions. Motivated by this fact, we propose three swarm optimization algorithms: discrete artificial bee colony, discrete artificial fish swarm, and discrete shuffled frog leaping. In addition, we investigate how to utilize the impact of search behavior to improve the performance of the algorithm, and we design the self-adaptive parameter settings to balance between the exploitation and exploration of the algorithm. Furthermore, we propose a heuristic algorithm to generate a good initial solution. Compared with some algorithms from the literature, the simulation results show that our proposed algorithms can maximize the global dominant share fairly and increase the resource utilization, and they are highly adaptable to different situations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Wang L, Liang B, Li B (2015) Multi-resource fair allocation in heterogeneous cloud computing systems. IEEE Trans Parallel Distrib Syst 26(10):2822–2835

    Article  Google Scholar 

  2. Zhu Q, Oh JC (2015) An approach to dominant resource fairness in distributed environment. In: Proceedings of the 28th international conference on industrial, engineering and other applications of applied intelligent systems, pp 141–150

  3. Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans Evol Comput 18(4):577–601

    Article  Google Scholar 

  4. Jain H, Deb K (2014) An evolutionary many-objective optimization algorithm using reference-point based nondominated sorting approach, part II: handling constraints and extending to an adaptive approach. IEEE Trans Evol Comput 18(4):602–622

    Article  Google Scholar 

  5. Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471

    Article  MATH  MathSciNet  Google Scholar 

  6. Shen W, Guo X, Wu C, Wu D (2011) Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm. Knowl-Based Syst 24(3):378–385

    Article  Google Scholar 

  7. Eusuff M, Lansey K, Pasha F (2007) Shuffled frog-leaping algorithm: a memetic meta-heuristic for discrete optimization. Eng Optim 38(2):129–154

    Article  MathSciNet  Google Scholar 

  8. Ghodsi A, Zaharia M, Hindman B, Konwinski A, Shenker S, Stoica I (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX conference on networked systems design and implementation, pp 323–336

  9. Dolev D, Feitelson DG, Halpern JY, Kupferman R, Linial N (2011) No justified complaints: on fair sharing of multiple resources. In: Proceedings of the 3rd innovations in theoretical computer science conference, pp 68–75

  10. Gutman A, Nisan N (2012) Fair allocation without trade. In: Proceedings of the 11th international conference on autonomous agents and multiagent systems, AAMAS’12, pp 719–728

  11. Liu H, He B (2014) Reciprocal resource fairness: towards cooperative multiple-resource fair sharing in IaaS clouds. In: International conference for high PERFORMANCE computing, networking, storage and analysis, pp 970–981

  12. Liu H, He B (2015) F2C: enabling fair and fine-grained resource sharing in multi-tenant IaaS clouds. IEEE Trans Parallel Distrib Syst 27(9):2589–2602

    Article  Google Scholar 

  13. Wong CJ, Sen S, Lan T, Chiang M (2013) Multi-resource allocation: fairness-efficiency tradeoffs in a unifying framework. IEEE/ACM Trans Netw 21(6):1785–1798

    Article  Google Scholar 

  14. Kash I, Procaccia A, Shah N (2014) No agent left behind: dynamic fair division of multiple resources. J Artif Intell Res 51:351–358

    MATH  MathSciNet  Google Scholar 

  15. Zarchy D, Hay D, Schapira M (2015) Capturing resource tradeoffs in fair multi-resource allocation. In: IEEE conference on computer communications (INFOCOM), pp 1062–1070

  16. Parkes DC, Procaccia AD, Shan N (2015) Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans Econ Comput 3(1):3

    Article  MathSciNet  Google Scholar 

  17. Li W, Liu X, Zhang X, Zhang X (2015) Dynamic fair allocation of multiple resources with bounded number of tasks in cloud computing systems. Multiagent Grid Syst 11(4):245–257

    Article  Google Scholar 

  18. Li W, Liu X, Zhang X, Zhang X (2014) Multi-resource fair allocation with bounded number of tasks in cloud computing systems. Preprint arXiv:1410.1255

  19. Psomas C-A, Schwartz J (2013) Beyond beyond dominant resource fairness: indivisible resource allocation in clusters. Tech Report Berkeley

  20. Friedman E, Ghodsi A, Psomas C-A (2014) Strategyproof allocation of discrete jobs on multiple machines. In: Proceedings of the 15th ACM conference on economics and computation, pp 529–546

  21. Eusuff MM, Lansey KE (2003) Optimization of water distribution network design using the shuffled frog leaping algorithm. J Water Resour Plan Manag 129(3):210–225

    Article  Google Scholar 

  22. Vahed AR, Mirzaei AH (2007) A hybrid multi-objective shuffled frog-leaping algorithm for a mixed-model assembly line sequencing problem. Comput Ind Eng 53(4):642–666

    Article  Google Scholar 

  23. Rocha AM, Costa MF, Fernandes EM (2014) A filter-based artificial fish swarm algorithm for constrained global optimization: theoretical and practical issues. J Global Optim 60(2):239–263

    Article  MATH  MathSciNet  Google Scholar 

  24. Wang HB, Fan CC, Tu XY (2016) AFSAOCP: a novel artificial fish swarm optimization algorithm aided by ocean current power. Appl Intell 45:1–16

    Article  Google Scholar 

  25. Akay B, Karaboga D (2012) A modified artificial bee colony algorithm for real-parameter optimization. Inf Sci Int J 192:120–142

    Google Scholar 

  26. Huo Y, Yi Z, Gu J, Ni S, Xue Y (2015) Discrete gbest-guided artificial bee colony algorithm for cloud service composition. Appl Intell 42(4):661–678

    Article  Google Scholar 

  27. Luo JP, Li X, Chen MR (2014) Hybrid shuffled frog leaping algorithm for energy-efficient dynamic consolidation of virtual machines in cloud data centers. Expert Syst Appl 41(13):5804–5816

    Article  Google Scholar 

  28. Chen Y, Zhu Q, Xu H (2015) Finding rough set reducts with fish swarm algorithm. Knowl-Based Syst 81(C):22–29

    Article  Google Scholar 

  29. Wilkes J, Reiss C, Google ClusterData2011_2. https://code.google.com/p/googleclusterdata/

  30. IBM ILOG CPLEX Optimizer (2015). http://www-01.ibm.com/software/commerce/optimization/cplex-optimizer/index.html

Download references

Acknowledgements

The work is supported in part by the National Natural Science Foundation of China (Nos. 61662088, 11301466, 11361048), and the Natural Science Foundation of Yunnan Province of China (No. 2014FB114).

Author information

Authors and Affiliations

  1. Yunnan University, Kunming, 650091, People’s Republic of China

    Xi Liu, Xiaolu Zhang, Weidong Li & Xuejie Zhang

Authors
  1. Xi Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaolu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weidong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xuejie Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xuejie Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, X., Zhang, X., Li, W. et al. Swarm optimization algorithms applied to multi-resource fair allocation in heterogeneous cloud computing systems. Computing 99, 1231–1255 (2017). https://doi.org/10.1007/s00607-017-0561-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-017-0561-x

Keywords

Mathematics Subject Classification

Search

Navigation