Abstract
Efficient resource management is crucial for balancing performance and energy consumption in large-scale data centres. In the case of additional requirements such as guaranteed resources and low communication latency, it is of great importance to implement not only an efficient initial placement algorithm, but also maximise consolidation by migration techniques, making sure that network performance is not sacrificed. In this paper, we introduce a hierarchical approach to migrations based on a combination of efficient packing algorithms and network communities. Results analysis shows the benefits of using a two-level approach where the combination of localised consolidation and network awareness improves both performance and energy efficiency, while maintaining low network hop distance.
Similar content being viewed by others
References
Garg SK, Yeo CS, Anandasivam A, Buyya R (2009) Energy-efficient scheduling of HPC applications in cloud computing environments. CoRR arXiv:0909.1146
Sotomayor B (2010) Provisioning computational resources using virtual machines and leases. Ph.D. thesis, University of Chicago
Mauch V, Kunze M, Hillenbrand M (2013) High performance cloud computing. Future Gener Comput Syst 29(6):1408–1416
Zakarya M, Lee G (2017) Energy efficient computing, clusters, grids and clouds: a taxonomy and survey. Sustain Comput Inform Syst 14:13–33
Chaabouni T, Khemakhem M (2018) Energy management strategy in cloud computing: a perspective study. J Supercomput 74(12):6569–6597
Vinothina V, Sridaran R (2012) A survey on resource allocation strategies in cloud computing. Int J Adv Comput Sci Appl 1(3):97–104
Thakur S, Chaurasia A (2016) Towards green cloud computing: impact of carbon footprint on environment. In: 2016 6th International Conference Cloud System and Big Data Engineering (Confluence). IEEE, pp 209–213
Beloglazov A, Jemal A, Rajkumar B (2012) Energy-aware resource allocation heuristics for efficient management of data centres for cloud computing. Future Gener Comput Syst 28(5):755–768
Chekuri C, Sanjeev K (1999) On multi-dimensional packing problems. In: Proceedings of the 1999 10th annual ACM-SIAM symposium on discrete algorithms. Baltimore, MD, USA, pp 185–194
Panigrahy R, Panigrahy R, Talwar K, Uyeda L, Wieder U (2011) Heuristics for vector bin packing. research.microsoft.com
Hamdi K, Kefi M (2016) Network-aware virtual machine placement in cloud data centers: an overview. In: 2016 International Conference on Industrial Informatics and Computer Systems (CIICS), Sharjah, pp 1–6
Filiposka S, Mishev A, Juiz C (2015) Community-based VM placement framework. J Supercomput 71(12):4504–4528
Filiposka S, Juiz C (2015) Community-based complex cloud data center. Physica A 419:356–372
Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794
Mahadevan P, Banerjee S, Sharma P (2010) Energy proportionality of an enterprise network. In: Proceedings of the First ACM SIGCOMM Workshop on Green Networking, pp 53–60
Choi K, Ramakrishna S, Massoud P (2005) Fine-grained dynamic voltage and frequency scaling for precise energy and performance tradeoff based on the ratio of off-chip access to on-chip computation times. IEEE Trans Comput Aided Des Integr Circuits Syst 24(1):18–28
Le Sueur E, Heiser G (2010) Dynamic voltage and frequency scaling: The laws of diminishing returns. In: Proceedings of the 2010 International Conference on Power Aware Computing and Systems
Von Laszewski G, Wang L, Younge AJ, He X (2009) Power-aware scheduling of virtual machines in DVFS-enabled clusters. In: IEEE International Conference on Cluster Computing and Workshops, 2009. CLUSTER’09. IEEE
Carli T, Henriot S, Cohen J, Tomasik J (2016) A packing problem approach to energy-aware load distribution in Clouds. Sustain Comput Inform Syst 9:20–32
Orgerie AC, Assuncao MDD, Lefevre L (2014) A survey on techniques for improving the energy efficiency of large-scale distributed systems. ACM Comput Surv (CSUR) 46(4):47
Sotiriadis S, Bessis N, Buyya R (2018) Self managed virtual machine scheduling in cloud systems. Inf Sci 433:381–400
Beloglazov A, Rajkumar B (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centres. Concurr Comput Pract Exp 24(13):1397–1420
Kansal NJ, Chana I (2016) Energy-aware virtual machine migration for cloud computing—a firefly optimization approach. J Grid Comput 14(2):327–345
Mishra M, Sahoo A (2011) On theory of VM placement: anomalies in existing methodologies and their mitigation using a novel vector based approach. In: 2011 IEEE 4th International Conference on Cloud Computing, USA, pp 275–282
Liu H, Xu CZ, Huazhong HJ, Gong J, Liao X (2013) Performance and energy modeling for live migration of virtual machines. Cluster Comput 16(2):249–264
Gupta A, Kalé LV, Milojicic D, Faraboschi P, Balle SM (2013) HPC-aware VM placement in infrastructure clouds. In: 2013 IEEE International Conference on Cloud Engineering (IC2E), Redwood City, CA, pp 11–20
Prisacari B, Rodriguez G, Minkenberg C, Hoefler T (2013) Bandwidth-optimal all-to-all exchanges in fat tree networks. In: Proceedings of the 27th International ACM Conference on International Conference on Supercomputing, pp 139–148
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Filiposka, S., Mishev, A. & Gilly, K. Multidimensional hierarchical VM migration management for HPC cloud environments. J Supercomput 75, 5324–5346 (2019). https://doi.org/10.1007/s11227-019-02799-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-019-02799-5