Skip to main content

Advertisement

Log in

Multidimensional hierarchical VM migration management for HPC cloud environments

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Efficient resource management is crucial for balancing performance and energy consumption in large-scale data centres. In the case of additional requirements such as guaranteed resources and low communication latency, it is of great importance to implement not only an efficient initial placement algorithm, but also maximise consolidation by migration techniques, making sure that network performance is not sacrificed. In this paper, we introduce a hierarchical approach to migrations based on a combination of efficient packing algorithms and network communities. Results analysis shows the benefits of using a two-level approach where the combination of localised consolidation and network awareness improves both performance and energy efficiency, while maintaining low network hop distance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Garg SK, Yeo CS, Anandasivam A, Buyya R (2009) Energy-efficient scheduling of HPC applications in cloud computing environments. CoRR arXiv:0909.1146

  2. Sotomayor B (2010) Provisioning computational resources using virtual machines and leases. Ph.D. thesis, University of Chicago

  3. Mauch V, Kunze M, Hillenbrand M (2013) High performance cloud computing. Future Gener Comput Syst 29(6):1408–1416

    Article  Google Scholar 

  4. Zakarya M, Lee G (2017) Energy efficient computing, clusters, grids and clouds: a taxonomy and survey. Sustain Comput Inform Syst 14:13–33

    Google Scholar 

  5. Chaabouni T, Khemakhem M (2018) Energy management strategy in cloud computing: a perspective study. J Supercomput 74(12):6569–6597

    Article  Google Scholar 

  6. Vinothina V, Sridaran R (2012) A survey on resource allocation strategies in cloud computing. Int J Adv Comput Sci Appl 1(3):97–104

    Google Scholar 

  7. Thakur S, Chaurasia A (2016) Towards green cloud computing: impact of carbon footprint on environment. In: 2016 6th International Conference Cloud System and Big Data Engineering (Confluence). IEEE, pp 209–213

  8. Beloglazov A, Jemal A, Rajkumar B (2012) Energy-aware resource allocation heuristics for efficient management of data centres for cloud computing. Future Gener Comput Syst 28(5):755–768

    Article  Google Scholar 

  9. Chekuri C, Sanjeev K (1999) On multi-dimensional packing problems. In: Proceedings of the 1999 10th annual ACM-SIAM symposium on discrete algorithms. Baltimore, MD, USA, pp 185–194

  10. Panigrahy R, Panigrahy R, Talwar K, Uyeda L, Wieder U (2011) Heuristics for vector bin packing. research.microsoft.com

  11. Hamdi K, Kefi M (2016) Network-aware virtual machine placement in cloud data centers: an overview. In: 2016 International Conference on Industrial Informatics and Computer Systems (CIICS), Sharjah, pp 1–6

  12. Filiposka S, Mishev A, Juiz C (2015) Community-based VM placement framework. J Supercomput 71(12):4504–4528

    Article  Google Scholar 

  13. Filiposka S, Juiz C (2015) Community-based complex cloud data center. Physica A 419:356–372

    Article  Google Scholar 

  14. Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794

    Article  Google Scholar 

  15. Mahadevan P, Banerjee S, Sharma P (2010) Energy proportionality of an enterprise network. In: Proceedings of the First ACM SIGCOMM Workshop on Green Networking, pp 53–60

  16. Choi K, Ramakrishna S, Massoud P (2005) Fine-grained dynamic voltage and frequency scaling for precise energy and performance tradeoff based on the ratio of off-chip access to on-chip computation times. IEEE Trans Comput Aided Des Integr Circuits Syst 24(1):18–28

    Article  Google Scholar 

  17. Le Sueur E, Heiser G (2010) Dynamic voltage and frequency scaling: The laws of diminishing returns. In: Proceedings of the 2010 International Conference on Power Aware Computing and Systems

  18. Von Laszewski G, Wang L, Younge AJ, He X (2009) Power-aware scheduling of virtual machines in DVFS-enabled clusters. In: IEEE International Conference on Cluster Computing and Workshops, 2009. CLUSTER’09. IEEE

  19. Carli T, Henriot S, Cohen J, Tomasik J (2016) A packing problem approach to energy-aware load distribution in Clouds. Sustain Comput Inform Syst 9:20–32

    Google Scholar 

  20. Orgerie AC, Assuncao MDD, Lefevre L (2014) A survey on techniques for improving the energy efficiency of large-scale distributed systems. ACM Comput Surv (CSUR) 46(4):47

    Article  Google Scholar 

  21. Sotiriadis S, Bessis N, Buyya R (2018) Self managed virtual machine scheduling in cloud systems. Inf Sci 433:381–400

    Article  Google Scholar 

  22. Beloglazov A, Rajkumar B (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centres. Concurr Comput Pract Exp 24(13):1397–1420

    Article  Google Scholar 

  23. Kansal NJ, Chana I (2016) Energy-aware virtual machine migration for cloud computing—a firefly optimization approach. J Grid Comput 14(2):327–345

    Article  Google Scholar 

  24. Mishra M, Sahoo A (2011) On theory of VM placement: anomalies in existing methodologies and their mitigation using a novel vector based approach. In: 2011 IEEE 4th International Conference on Cloud Computing, USA, pp 275–282

  25. Liu H, Xu CZ, Huazhong HJ, Gong J, Liao X (2013) Performance and energy modeling for live migration of virtual machines. Cluster Comput 16(2):249–264

    Article  Google Scholar 

  26. Gupta A, Kalé LV, Milojicic D, Faraboschi P, Balle SM (2013) HPC-aware VM placement in infrastructure clouds. In: 2013 IEEE International Conference on Cloud Engineering (IC2E), Redwood City, CA, pp 11–20

  27. Prisacari B, Rodriguez G, Minkenberg C, Hoefler T (2013) Bandwidth-optimal all-to-all exchanges in fat tree networks. In: Proceedings of the 27th International ACM Conference on International Conference on Supercomputing, pp 139–148

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katja Gilly.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Filiposka, S., Mishev, A. & Gilly, K. Multidimensional hierarchical VM migration management for HPC cloud environments. J Supercomput 75, 5324–5346 (2019). https://doi.org/10.1007/s11227-019-02799-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-019-02799-5

Keywords

Navigation