Skip to main content
SpringerLink
Log in

Improving Resource Utilization via Virtual Machine Placement in Data Center Networks

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

The resource utilization of servers (such as CPU, memory) is an important performance metric in data center networks (DCNs). The cloud platform supported by DCNs aims to achieve high average resource utilization while guaranteeing the quality of cloud services. Previous papers designed various efficient virtual machine placement schemes to increase the average resource utilization and decrease the server overload ratio. Unfortunately, most of virtual machine placement schemes did not contain the service level agreements (SLAs) and statistical methods. In this paper, we propose a correlation-aware virtual machine placement scheme that effectively places virtual machines on physical machines. First, we employ neural networks model and factor model to forecast the resource utilization trend data according to the historical resource utilization data. Second, we design three correlation-aware virtual machine placement algorithms to enhance resource utilization while meeting the user-defined SLAs. The simulation results show that the efficiency of our virtual machine placement algorithms outperforms the generic algorithm and constant variance algorithm by about 15%-30%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Al-Fares M, Loukissas A, Vahdat A (2008) A scalable, commodity data center network architecture. Acm Sigcomm Comput Commun Rev 38(4):63–74

    Article  Google Scholar 

  2. Ajiro Y, Tanaka A (2007) Improving packing algorithms for server consolidation. In: International CMG Conference, vol 253

  3. Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Generation Comput Syst 25 (6):599–616

    Article  Google Scholar 

  4. Bobroff N, Kochut A, Beaty K (2007) Dynamic placement of virtual machines for managing sla violations. In: IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 119–128

  5. Cao B, Gao X, Chen G, Jin Y (2014) NICE: Network-Aware VM consolidation scheme for energy conservation in data centers. In: IEEE International Conference on Parallel and Distributed Systems (ICPADS), pp 166–173

  6. Chen K, Singlay A, Singhz A, Ramachandranz K, Xuz L, Zhangz Y et al (2014) OSA: An optical switching architecture for data center networks with unprecedented flexibility. IEEE/ACM Trans Netw 22 (2):498–511

    Article  Google Scholar 

  7. Chen T, Gao X, Chen G (2016) The features, hardware, and architectures of data center networks: a survey. J Parallel Distributed Comput 96:45–74

    Article  Google Scholar 

  8. Chen T, Zhu Y, Gao X, Kong L, Chen G, Wang Y (2016) Correlation-aware virtual machine placement in data center networks. In: 7th EAI International Conference on Cloud Computing (Cloudcomp), pp 1–10

  9. Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Warfield A (2005) Live migration of virtual machines. In: USENIX Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation (NSDI), pp 273–286

  10. Ghorbani S, Schlesinger C, Monaco M, Keller E, Caesar M, Rexford J, Walker D (2014) Transparent, live migration of a software-defined network. In: ACM Symposium on Cloud Computing (SOCC), pp 1–14

  11. Gong Z, Gu X, Wilkes J (2010) Press: predictive elastic resource scaling for cloud systems. In: International Conference on Network and Service Management (CNSM), pp 9–16

  12. Greenberg A, Hamilton JR, Jain N, Kandula S, Kim C, Lahiri P et al (2009) Vl2: a scalable and flexible data center network. Acm Sigcomm Comput Commun Rev 39(4):51–62

    Article  Google Scholar 

  13. Guo C, Wu H, Tan K, Shi L, Zhang Y, Lu S (2008) Dcell: a scalable and fault-tolerant network structure for data centers. Acm Sigcomm Comput Commun Rev 38(4):75–86

    Article  Google Scholar 

  14. Guo C, Lu G, Li D, Wu H, Zhang X, Shi Y et al (2009) Bcube: a high performance, server-centric network architecture for modular data centers. Acm Sigcomm Comput Commun Rev 39(4):63–74

    Article  Google Scholar 

  15. Gupta JND, Ho JC (1999) A new heuristic algorithm for the one-dimensional bin-packing problem. Prod Plan Control 10(6):598–603

    Article  Google Scholar 

  16. Han Z, Tan H, Chen G, Wang R, Chen Y, Lau F (2016) Dynamic virtual machine management via approximate markov decision process. In: IEEE International Conference on Computer Communications (INFOCOM), pp 1–9

  17. Iima H, Yakawa T (2003) A new design of genetic algorithm for bin packing. Congress Evol Comput 2:1044–1049

    Google Scholar 

  18. Kai H, Bai X, Shi Y, Li M (2016) Cloud performance modeling with benchmark evaluation of elastic scaling strategies. IEEE Trans Parallel Distributed Syst 27(1):130–143

    Article  Google Scholar 

  19. Kim J, Ruggiero M, Atienza D, Lederberger M (2013) Correlation-aware virtual machine allocation for energy-efficient datacenters. In: Proceedings of the Conference on Design, Automation and Test in Europe, pp 1345–1350

  20. Khalilzad N, Faragardi HR, Nolte T (2015) Towards energy-aware placement of real-time virtual machines in a cloud data center. In: IEEE High Performance Computing and Communications (HPCC), pp 1657–1662

  21. Lin H, Qi X, Yang S, Midkiff S (2015) Workload-driven VM Consolidation in cloud data centers. In: Parallel and Distributed Processing Symposium (IPDPS), pp 207–216

  22. Meng X, Isci C, Kephart J, Zhang L, Bouillet E, Pendarakis D (2010) Efficient resource provisioning in compute clouds via vm multiplexing. In: International Conference on Autonomic Computing, pp 11–20

  23. Nelson M, Lim BH, Hutchins G (2005) Fast transparent migration for virtual machines. In: Usenix Technical Conference, pp 391– 394

  24. Niu D, Feng C, Li B (2012) Pricing cloud bandwidth reservations under demand uncertainty. In: ACM Sigmetrics/performance Joint International Conference on Measurement and Modeling of Computer Systems, pp 151–162

  25. Qiu C, Shen H, Chen L (2016) Probabilistic demand allocation for cloud service brokerage. In: IEEE International Conference on Computer Communications (INFOCOM), pp 1–9

  26. Song W, Xiao Z, Chen Q, Luo H (2014) Adaptive resource provisioning for the cloud using online bin packing. IEEE Trans Comput 63(11):2647–2660

    Article  MathSciNet  MATH  Google Scholar 

  27. Wang S, Liu Z, Zheng Z, Sun Q, Yang F (2013) Particle swarm optimization for energy-aware virtual machine placement optimization in virtualized data centers. In: Parallel and Distributed Systems (ICPADS), pp 102–109

  28. Wei W, Wei X, Chen T, Gao X, Chen G (2013) Dynamic correlative VM placement for quality-assured cloud service. In: IEEE International Conference on Communications (ICC), pp 2573–2577

  29. Wood T, Shenoy P, Venkataramani A, Yousif M (2007) Black-box and gray-box strategies for virtual machine migration. In: Proceedings of the 4th USENIX conference on Networked systems design & implementation (NSDI). USENIX Association, pp 17–17

  30. Wood T, Ramakrishnan KK, Shenoy P, Van der Merwe J, Hwang J, Liu G, Chaufournier L (2015) Cloudnet: dynamic pooling of cloud resources by live WAN migration of virtual machines. IEEE/ACM Transactions on Networking (TON) 23(5):1568– 1583

    Article  Google Scholar 

  31. Xu F, Liu F, Liu L, Jin H, Li B, Li B (2014) iAware: making live migration of virtual machines interference-aware in the cloud. IEEE Transactions on Computers (TOC) 63(12):3012–3025

    Article  MathSciNet  MATH  Google Scholar 

  32. Ye K, Jiang X, Huang D, Chen J, Wang B (2011) Live migration of multiple virtual machines with resource reservation in cloud computing environments. In: IEEE International Conference on Cloud Computing (CLOUD), pp 267–274

  33. Yu L, Cai Z (2016) Dynamic scaling of virtual clusters with bandwidth guarantee in cloud datacenters. In: IEEE International Conference on Computer Communications (INFOCOM), pp 1–9

  34. Yu L, Chen L, Cai Z, Shen H, Liang L, Pan Y (2016) Stochastic load balancing for virtual resource management in datacenters. IEEE Trans Cloud Comput:1–14. https://doi.org/10.1109/TCC.2016.2525984

  35. Yu L, Shen H, Karan S, Ye L, Cai Z (2017) CoRE: cooperative end-to-end traffic redundancy elimination for reducing cloud bandwidth cost. IEEE Trans Parallel Distributed Syst 28(2):446–461

    Google Scholar 

  36. Zhou X, Zhang Z, Zhu Y, Li Y, Kumar S, Vahdat A et al (2012) Mirror mirror on the ceiling: flexible wireless links for data centers. ACM SIGCOMM Comput Commun Rev 42(4):443–454

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported in part by Program of International S&T Cooperation (2016YFE0100300), China 973 project (2014CB340303), the National Natural Science Foundation of China (Grant number 61472252, 61672353, 61672349), and CCF-Tencent Open Research Fund. The authors also would like to thank Wei Wei for his contribution on the early versions of this paper.

Author information

Authors and Affiliations

  1. Shanghai Key Laboratory of Scalable Computing and Systems, Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China

    Tao Chen, Yaoming Zhu, Xiaofeng Gao, Linghe Kong & Guihai Chen

  2. Key Laboratory of Information Network Security of Ministry of Public Security, The Third Research Institute of Ministry of Public Security, Shanghai, China

    Yongjian Wang

Authors
  1. Tao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yaoming Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaofeng Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Linghe Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guihai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yongjian Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaofeng Gao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, T., Zhu, Y., Gao, X. et al. Improving Resource Utilization via Virtual Machine Placement in Data Center Networks. Mobile Netw Appl 23, 227–238 (2018). https://doi.org/10.1007/s11036-017-0925-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-017-0925-7

Keywords

Search

Navigation