Skip to main content

Advertisement

Log in

An energy-efficient cloud system with novel dynamic resource allocation methods

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In the last decade, cloud computing has brought enormous changes to people’s lives. Cloud computing gives a client-driven computational model. In this case, the pay-per-use model enables a flexible method of deploying and sharing distributed services and resources. Furthermore, computational resources are progressively reassembled and insulated to give various types of services. Current solutions on how to efficiently utilize energy consumption are inadequate. Thus, we propose two methods to tackle the problem, which are the dynamic resource allocation method and the energy saving method, respectively. In this work, we firstly deployed an infrastructure platform based on OpenStack to actualize the proposed approach with live migration of virtual machines (VMs). Secondly, we allocated the dynamic resources and proposed the energy saving algorithm. Thirdly, we monitor the power distribution unit status to record the energy consumption of the system. Finally, in the experiments, we found that the proposed algorithms cannot just accomplish the proficient use of VMs’ resources but also thrift the energy usage of physical machines. Our experimental results demonstrate about 39.89% of energy is saved from 20 VCPUs of 20 GB memory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Atif M, Strazdins P (2014) Adaptive parallel application resource remapping through the live migration of virtual machines. Future Gener Comput Syst 37:148–161

    Article  Google Scholar 

  2. Babu S, Hareesh M, Martin J, Cherian S, Sastri Y (2014) System performance evaluation of para virtualization, container virtualization, and full virtualization using xen, openvz, and xenserver. In: 2014 Fourth International Conference on Advances in Computing and Communications (ICACC), pp 247–250

  3. Basu D, Wang X, Hong Y, Chen H, Bressan S (2017) Learn-as-you-go with megh: efficient live migration of virtual machines. In: 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), pp 2608–2609

  4. Beloglazov A, Abawajy J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener Comput Syst 28:755–768

    Article  Google Scholar 

  5. Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines. In: Proceedings of the 2nd Conference on Symposium on Networked Systems Design and Implementation, pp 273–286

  6. Dong Y, Zhang X, Dai J, Guan H (2014) Hyvi: a hybrid virtualization solution balancing performance and manageability. Parallel Distrib Syst 25:2332–2341

    Article  Google Scholar 

  7. Ficco M, Esposito C, Palmieri F, Castiglione A (2018) A coral-reefs and game theory-based approach for optimizing elastic cloud resource allocation. Future Gener Comput Syst 78:343–352

    Article  Google Scholar 

  8. Forsman M, Glad A, Lundberg L, Ilie D (2015) Algorithms for automated live migration of virtual machines. J Syst Softw 101:110–126

    Article  Google Scholar 

  9. Ha N, Kim N (2018) Efficient flow table management scheme in SDN-based cloud computing networks. J Inf Process Syst 14:228–238. https://doi.org/10.3745/JIPS.01.0023

    Google Scholar 

  10. Jin H, Gao W, Wu S, Shi X, Wu X, Zhou F (2011) Optimizing the live migration of virtual machine by CPU scheduling. J Netw Comput Appl 34:1088–1096

    Article  Google Scholar 

  11. Jin H, Deng L, Wua S, Shia X, Chena H, Panc X (2014) MECOM: live migration of virtual machines by adaptively compressing memory pages. Future Gener Comput Syst 38:23–25

    Article  Google Scholar 

  12. Jo C, Cho Y, Egger B (2017) A machine learning approach to live migration modeling. In: Proceedings of 2017 ACM Symposium on Cloud Computing (SoCC’17)

  13. Keegan N, Ji SY, Chaudhary A, Concolato C, Yu B, Jeong DH (2016) A survey of cloud-based network intrusion detection analysis. Human-centric Comput Inf Sci 6(1):1–16

    Article  Google Scholar 

  14. Kim I, Kim T, Eom YI (2010) NHVM: design and implementation of linux server virtual machine using hybrid virtualization technology. In: 2010 International Conference on Computational Science and Its Applications (ICCSA), pp 171–175

  15. Krakow LW, Rabiet L, Zou Y, Iooss G, Edwin KP, Chong SR (2014) Optimizing dynamic resource allocation. Procedia Comput Sci 29:1277–1288

    Article  Google Scholar 

  16. Li C, Feng D, Hua Y, Xia W, Qin L, Huang Y, Zhou Y (2017) BAC: bandwidth-aware compression for efficient live migration of virtual machines. In: IEEE INFOCOM 2017—IEEE Conference on Computer Communications, pp 1–9

  17. Liao X, Jin H, Yu S, Zhang Y (2015) A novel memory allocation scheme for memory energy reduction in virtualization environment. J Comput Syst Sci 81:3–15

    Article  MathSciNet  MATH  Google Scholar 

  18. Mell P, Grance T et al (2009) The NIST definition of cloud computing. Natl Inst Stand Technol 53(6):50

    Google Scholar 

  19. Nagpure M, Dahiwale P, Marbate P (2015) An efficient dynamic resource allocation strategy for VM environment in cloud. In: 2015 International Conference on Pervasive Computing (ICPC), pp 1–5

  20. Thomas G, Chandrasekar K, Akesson B, Juurlink B (2012) A predictor-based power-saving policy for dram memories. In: 2012 15th Euromicro Conference on Digital System Design (DSD), pp 882–889

  21. Wang N, Fu P, Yang Y, Zhu L, Wu D (2014) Spatial-temporal energy-saving effect for the diagnosis of energy-consumption benchmark state of thermal power units. Energy Procedia 61:1848–1851

    Article  Google Scholar 

  22. Wolke A, Tsend-Ayush B, Pfeiffer C, Bichler M (2015) More than bin packing: dynamic resource allocation strategies in cloud data centers. Inf Syst 52:83–95

    Article  Google Scholar 

  23. Yang CT, Huang KL, Liu JC, Su YW, Chu WC (2013) Implementation of a power saving method for virtual machine management in cloud. In: 2013 International Conference on Cloud Computing and Big Data (CloudCom-Asia), pp 283–290

  24. Yang CT, Chuang CL, Liu JC, Chen CC, Chu W (2015) Implementation of cloud infrastructure monitor platform with power saving method. In: 2015 IEEE 29th International Conference on Advanced Information Networking and Applications Workshops (WAINA), pp 223–228

  25. Yang CT, Shih WC, Chen LT, Kuo CT, Jiang FC, Leu FY (2015b) Accessing medical image file with co-allocation HDFS in cloud. Future Gener Comput Syst 43–44:61–73

    Article  Google Scholar 

  26. Yang CT, Chan YW, Liu JC, Lou BS (2017) An implementation of cloud-based platform with R packages for spatiotemporal analysis of air pollution. J Supercomput. https://doi.org/10.1007/s11227-017-2189-1

    Google Scholar 

  27. Yang CT, Chen ST, Yan YZ (2017b) The implementation of a cloud city traffic state assessment system using a novel big data architecture. Clust Comput 20(2):1101–1121

    Article  Google Scholar 

  28. Yang CT, Liu JC, Chen ST, Huang KL (2017c) Virtual machine management system based on the power saving algorithm in cloud. J Netw Comput Appl 80:165–180

    Article  Google Scholar 

  29. Yang CT, Liu JC, Chen ST, Lu HW (2017) Implementation of a big data accessing and processing platform for medical records in cloud. J Med Syst 41(10):149

    Article  Google Scholar 

  30. Yang CT, Chen ST, Chang CH, Den W, Wu CC (2018a) Implementation of an environmental quality and harmful gases monitoring system in cloud. J Med Biol Eng. https://doi.org/10.1007/s40846-018-0383-0

    Google Scholar 

  31. Yang CT, Chen ST, Den W, Wang YT, Kristiani E (2018) Implementation of an intelligent indoor environmental monitoring and management system in cloud. Future Gener Comput Syst. https://doi.org/10.1016/j.future.2018.02.041

    Google Scholar 

  32. Yang CT, Liu JC, Huang KL, Jiang F (2014) A method for managing green power of a virtual machine cluster in cloud. Future Gener Comput Syst 37:26–36

    Article  Google Scholar 

  33. Ye K, Jiang X, Ma R, Yan F (2012) Vc-migration: live migration of virtual clusters in the cloud. In: 2012 ACM/IEEE 13th International Conference on Grid Computing (GRID), pp 209–218

  34. Zaman FA, Jarray A, Karmouch A (2019) Software defined network-based edge cloud resource allocation framework. IEEE Access 7:10,672–10,690

    Article  Google Scholar 

  35. Zhou Z, Liu F, Jin H, Li B, Li B, Jiang H (2013) On arbitrating the power-performance tradeoff in SaaS clouds. In: 2013 Proceedings IEEE INFOCOM, pp 872–880

Download references

Acknowledgements

This work was supported in part by the Ministry of Science and Technology, Taiwan, under Grant MOST 104-2221-E-029-010-MY3 and MOST 106-3114-E-029-003.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yu-Wei Chan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, CT., Chen, ST., Liu, JC. et al. An energy-efficient cloud system with novel dynamic resource allocation methods. J Supercomput 75, 4408–4429 (2019). https://doi.org/10.1007/s11227-019-02794-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-019-02794-w

Keywords

Navigation