Skip to main content
SpringerLink
Log in

A multi-objective load balancing algorithm for virtual machine placement in cloud data centers based on machine learning

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

Cloud computing provides utility computing in which clients pay the cost according to their demands and service use. There are some challenges to this technology. One of these issues in data centers is virtual machine (VM) placement so that mapping of these VMs to hosts is executed for a variety of objectives such as load balancing, reducing energy consumption, increasing resource utilization, shortening response time, etc. In this paper, a strategy is presented based on machine learning for VM replacement which aims to balance the load in host machines (HM). In this proposed strategy, the learning agent, in each learning episode by selecting an action from among the permissible actions and executing it on the environment receives a reward according to the desirability of the solution obtained by doing that action in the environment. Receiving a reward from the environment and updating the action value table enable the learner agent to learn in the following episodes that in each environment state, selecting and executing which action is better in the environment and this leads to further enhancement. Our proposed algorithm has, on average, improved the inter-HM load balance in terms of processor, memory, and bandwidth by 25%, 34%, and 32%, respectively, prior to the implementation of the algorithm. Our strategy was compared from diffrent aspects in three scenarios to the MOVMrB strategy. Finally, it was concluded that our proposed algorithm can be more effective in load balancing by having much less runtime and turning off more HMs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Li Y, Li W, Jiang C (2010) In: 2010 Third international symposium on electronic commerce and security, pp 332–336. https://doi.org/10.1109/ISECS.2010.80

  2. Li R, Zheng Q, Li X, Yan Z (2017) Multi-objective optimization for rebalancing virtual machine placement. Future Gener Comput Syst. https://doi.org/10.1016/j.future.2017.08.027. http://www.sciencedirect.com/science/article/pii/S0167739X1731840X

  3. Zheng Q, Li R, Li X, Shah N, Zhang J, Tian F, Chao KM, Li J (2016) Virtual machine consolidated placement based on multi-objective biogeography-based optimization. Future Gener Comput Syst 54:95. https://doi.org/10.1016/j.future.2015.02.010. http://www.sciencedirect.com/science/article/pii/S0167739X15000564

  4. Masdari M, Nabavi SS, Ahmadi V (2016) An overview of virtual machine placement schemes in cloud computing. J Netw Comput Appl 66:106. https://doi.org/10.1016/j.jnca.2016.01.011. http://www.sciencedirect.com/science/article/pii/S1084804516000291

  5. Sayeedkhan PN, Balaji S (2014) Virtual machine placement based on disk I/O load in cloud. (IJCSIT) Int J Comput Sci Inf Technol 5:5477

    Google Scholar 

  6. Wang S-H, Huang PP, Wen CH, Wang L (2014) In: The international conference on information networking 2014 (ICOIN2014), pp 220–225. https://doi.org/10.1109/ICOIN.2014.6799695

  7. Fang W, Liang X, Li S, Chiaraviglio L, Xiong N (2013) VMPlanner: optimizing virtual machine placement and traffic flow routing to reduce network power costs in cloud data centers. Comput Netw 57(1):179. https://doi.org/10.1016/j.comnet.2012.09.008. http://www.sciencedirect.com/science/article/pii/S1389128612003301

  8. Li X, Qian Z, Lu S, Wu J (2013) Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center. Math Comput Modell 58(5):1222. https://doi.org/10.1016/j.mcm.2013.02.003. http://www.sciencedirect.com/science/article/pii/S0895717713000319. The measurement of undesirable outputs: models development and empirical analyses and advances in mobile, ubiquitous and cognitive computing

  9. Yapicioglu T, Oktug S, In: Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing (IEEE Computer Society, Washington, DC, USA, 2013), UCC ’13, pp 299–301. https://doi.org/10.1109/UCC.2013.62

  10. Pires L, Barán B (2017) Many-objective virtual machine placement. J Grid Comput 15:161–176. https://doi.org/10.1007/s10723-017-9399-x

    Article  Google Scholar 

  11. Fu X, Zhou C (2017) Predicted affinity based virtual machine placement in cloud computing environments. IEEE Trans Cloud Comput. https://doi.org/10.1109/TCC.2017.2737624

    Article  Google Scholar 

  12. Gao Y, Guan H, Qi Z, Hou Y, Liu L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230. https://doi.org/10.1016/j.jcss.2013.02.004. http://www.sciencedirect.com/science/article/pii/S0022000013000627

  13. Kang DJ, Hong-bo WANG, Yang-yang L, Shi-duan C (2013) Virtual machine placement optimizing to improve network performance in cloud data centers. J China Univ Posts Telecommun 21:62. https://doi.org/10.1016/S1005-8885(14)60302-2. www.sciencedirect.com/science/journal/10058885

  14. Thiruvenkadam T, Teklu T (2018) In: International conference on intelligent data communication technologies and Internet of Things (ICICI) 2018, vol 26, pp 1391–1399. https://doi.org/10.1007/978-3-030-03146-6_163

  15. Yang T, Lee YC, Zomaya AY (2014) In: 2014 IEEE 6th international conference on cloud computing technology and science, pp 284–291. https://doi.org/10.1109/CloudCom.2014.135

  16. Wang S, Gu H, Wu G (2013) A new approach to multi-objective virtual machine placement in virtualized data center. In: 2013 IEEE eighth international conference on networking, architecture and storage, Xi’an, pp 331–335

  17. Jamali S, Malektaji S (2014) In: 2014 4th international conference on computer and knowledge engineering (ICCKE), pp 328–333. https://doi.org/10.1109/ICCKE.2014.6993461

  18. Prodan R, Torre E, Durillo JJ, Aujla GS, Kummar N, Fard HM, Benedikt S (2019) In: 2019 45th Euromicro conference on software engineering and advanced applications (SEAA), pp 92–99. https://doi.org/10.1109/SEAA.2019.00023

  19. Dai X, Wang JM, Bensaou B (2014) In: 2014 IEEE 3rd international conference on cloud networking (CloudNet), pp 161–166. https://doi.org/10.1109/CloudNet.2014.6968986

  20. Kanagavelu R, Lee BS, Le NTD, Mingjie LN, Aung KMM (2014) Virtual machine placement with two-path traffic routing for reduced congestion in data center networks. Comput Commun 53:1. https://doi.org/10.1016/j.comcom.2014.07.009. http://www.sciencedirect.com/science/article/pii/S0140366414002746

  21. Zhou X, Wang K, Jia W, Guo M (2017) In: 2017 IEEE/ACM 25th international symposium on quality of service (IWQoS), pp 1–6. https://doi.org/10.1109/IWQoS.2017.7969161

  22. Liu N, Li Z, Xu J, Xu Z, Lin S, Qiu Q, Tang J, Wang Y (2017) In: 2017 IEEE 37th international conference on distributed computing systems (ICDCS), pp 372–382. https://doi.org/10.1109/ICDCS.2017.123

  23. Tong Z, Chen H, Deng X, Li K, Li K (2020) A scheduling scheme in the cloud computing environment using deep Q-learning. Inf Sci 512:1170. https://doi.org/10.1016/j.ins.2019.10.035. http://www.sciencedirect.com/science/article/pii/S0020025519309971

  24. Tong Z, Deng X, Chen H, Mei J, Liu H (2019) QL-HEFT: a novel machine learning scheduling scheme base on cloud computing environment. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04118-8. https://link.springer.com/article/10.1007/s00521-019-04118-8#citeas

  25. Rasouli N, Meybodi MR, Morshedlou H (2013) In: 2013 13th Iranian conference on fuzzy systems (IFSC), pp 1–5. https://doi.org/10.1109/IFSC.2013.6675616

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Technology Engineering, Qazvin Branch, Islamic Azad University, Qazvin, Iran

    Arezoo Ghasemi & Abolfazl Toroghi Haghighat

Authors
  1. Arezoo Ghasemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abolfazl Toroghi Haghighat
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abolfazl Toroghi Haghighat.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghasemi, A., Toroghi Haghighat, A. A multi-objective load balancing algorithm for virtual machine placement in cloud data centers based on machine learning. Computing 102, 2049–2072 (2020). https://doi.org/10.1007/s00607-020-00813-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-020-00813-w

Keywords

Mathematics Subject Classification

Search

Navigation