Skip to main content

Advertisement

Log in

CRFF.GP: cloud runtime formulation framework based on genetic programming

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The runtime environment of cloud computing requires a scheduler to be adapted with the current runtime conditions or make itself ready for the prospective events by predicting the future that requires adaptive scheduling algorithms. A description of the runtime environment based on a formula can help scheduler not only to control the current state of the runtime environment, but also to speculate about the future. In the previously published literature, static formulas were used to model the runtime, and dynamic runtime conditions are not considered. In this paper, cloud runtime formulation framework is introduced to create a formula based on the current runtime conditions. Then, using the genetic programming technique, the formula is evolved based on the feedback received from the runtime environment. This framework creates a suitable formula using length, deadline and priority features of the tasks, and frequency of virtual machines. Accordingly, the scheduler is able to (a) place the tasks in the virtual machines; and (b) set the processor frequency of the virtual machines, accordingly. The simulation of the presented idea compared to the baseline research works in this field, makes it possible to achieve a service level agreement (SLA)’s conformance 97% in average, with an increase of 19% compared to the baseline research works. In addition, the proposed algorithm, when it has 100% throughput, showed 10% improvement in SLA commitment in comparison with the fundamental algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Saraswathi AT, Kalaashri YRA, Padmavathi S (2015) Dynamic resource allocation scheme in cloud computing. Procedia Comput Sci 47:30–36

    Article  Google Scholar 

  2. Xu M, Tian W, Buyya R (2017) A survey on load balancing algorithms for virtual machines placement in cloud computing. Concurr Comput Pract Exp 29

  3. Sontakke V, Patil P , Waghamare S, Kulkarni R, Patil NS, Saravanapriya M, Scholar UG (2016) Dynamic resource allocation strategy for cloud computing using virtual machine environment. Int J Eng Sci Comput 6(5):4804–4806

    Google Scholar 

  4. Alnowiser A, Aldhahri E, Alahmadi A, Zhu MM (2014) Enhanced weighted round robin (EWRR) with DVFS technology in cloud energy-aware. In: 2014 International Conference on Computational Science And Computational Intelligence

  5. Mohan S, Mueller F, Root M, Hawkins W, Healy C, Whalley D, Vivancos E (2011) Parametric timing analysis and its application to dynamic voltage scaling. ACM Trans Embed Comput Syst 10(2):1–34

    Article  Google Scholar 

  6. Zhiyong Z, Peng L, Lei J, Zhiping J (2014) Energy efficient real-time task scheduling for embedded systems with hybrid main memory. In: 2014 IEEE 20th International Conference on Embedded and Real-Time Computing Systems and Applications

  7. Islam FMMU, Lin M (2014) Learning based power management for periodic real-time tasks. In: High Performance Computing and Communications, 2014 IEEE 6th International Symposium on Cyberspace Safety and Security, 2014 IEEE 11th International Conference on Embedded Software and Systems (HPCC, CSS, ICESS), 2014 IEEE International Conference on 2014. IEEE

  8. Chishiro H, Takasu M, Ueda R, Yamasaki N (2015) Optimal multiprocessor real-time scheduling based on RUN with voltage and frequency scaling. In: 2015 IEEE 18th International Symposium on Real-Time Distributed Computing (ISORC). IEEE

  9. Dai S, Hong M, Guo B, He Y, Zhang Q, Sun L, Du Y (2015) A formal approach for RT-DVS algorithms evaluation based on statistical model checking. Math Probl Eng 2015:1–12

    Google Scholar 

  10. Chishiro H, Takasu M, Ueda R, Yamasaki N (2016) Performance evaluation of RUNT algorithm. SIGBED Rev 13(1):15–21

    Article  Google Scholar 

  11. Saha S, Ravindran B (2012) An experimental evaluation of real-time DVFS scheduling algorithms. In: Proceedings of the 5th Annual International Systems and Storage Conference. ACM, Haifa, pp 1–12

  12. Koza JR (1993) Hierarchical automatic function definition in genetic programming. Found Genet Algorithms 2:297–318

    Google Scholar 

  13. Koza JR (1994) Genetic programming as a means for programming computers by natural selection. Stat Comput 4(2):87–112

    Article  Google Scholar 

  14. Koza JR (1995) Survey of genetic algorithms and genetic programming. In: WESCON/’95. Conference Record. Microelectronics Communications Technology Producing Quality Products Mobile and Portable Power Emerging Technologies. IEEE

  15. Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA, USA

    MATH  Google Scholar 

  16. Khu ST, Liong S-Y, Babovic V, Madsen H, Muttil N (2001) Genetic programming and its application in real-time runoff forecasting. J Am Water Resour Assoc 37(2):439–451

    Article  Google Scholar 

  17. Langdon WB, Poli R (2002) Foundations of genetic programming. Springer, Berlin, Heidelberg

    Book  MATH  Google Scholar 

  18. Koza JR, Poli R (2003) A genetic programming tutorial. Search methodologies: introductory tutorials in optimization, search and decision support

  19. Zhiguo B, Takahiro W (2008) A new approach for circuit design optimization using genetic algorithm. In: 2008 International SoC Design Conference

  20. Langdon WB, Poli R, McPhee NF, Koza JR (2008) Genetic programming: an introduction and tutorial, with a survey of techniques and applications. In: Fulcher J, Jain LC (eds) Computational intelligence: a compendium. Springer, Berlin, pp 927–1028

    Chapter  Google Scholar 

  21. Sagar K, Vathsal S (2013) Automated design and optimization of combinational circuits using genetic algorithms. In: Proceedings of the International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA). Springer

  22. Khandelwal M, Faradonbeh R, Monjezi M, Armaghani DJ, Majid MZBA, Yagiz S (2017) Function development for appraising brittleness of intact rocks using genetic programming and non-linear multiple regression models. Eng Comput 33(1):13–21

    Article  Google Scholar 

  23. Feller E, Ramakrishnan L, Morin C (2015) Performance and energy efficiency of big data applications in cloud environments: a Hadoop case study. J Parallel Distrib Comput 79:80–89

    Article  Google Scholar 

  24. Colin A, Kandhalu A, Rajkumar RR (2016) Energy-efficient allocation of real-time applications onto single-ISA heterogeneous multi-core processors. J Signal Process Syst 84(1):91–110

    Article  Google Scholar 

  25. Craciunas SS, Kirsch CM, Sokolova A (2010) Power-aware temporal isolation with variable-bandwidth servers. In: Proceedings of the Tenth ACM International Conference on Embedded Software. ACM, Scottsdale, pp 259–268

  26. Tanenbaum AS, Van Steen M (2007) Distributed systems: principles and paradigms. Prentice-Hall, Upper Saddle River

    MATH  Google Scholar 

  27. Pathan RM (2016) Design of an efficient ready queue for earliest-deadline-first (EDF) scheduler. In: Proceedings of the 2016 Conference on Design, Automation and Test in Europe. EDA Consortium

  28. Lee M-S, Lee C-H (2014) Enhanced cycle-conserving dynamic voltage scaling for low-power real-time operating systems. IEICE Trans Inf Syst 97(3):480–487

    Article  Google Scholar 

  29. Wu C-M, Chang R-S, Chan H-Y (2014) A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters. Future Gener Comput Syst 37:141–147

    Article  Google Scholar 

  30. Kimura H, Sato M, Hotta Y, Boku T, Takahashi D (2006) Empirical study on reducing energy of parallel programs using slack reclamation by DVFS in a power-scalable high performance cluster. In: 2006 IEEE International Conference on Cluster Computing

  31. Rizvandi NB, Taheri J, Zomaya AY, Lee YC (2010) Linear combinations of DVFS-enabled processor frequencies to modify the energy-aware scheduling algorithms. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid). IEEE

  32. Kimura H, Sato M, Imada T, Hotta Y (2008) Runtime DVFS control with instrumented code in power-scalable cluster system. In: 2008 IEEE International Conference on Cluster Computing. IEEE

  33. Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable cloud computing environments and the cloudsim toolkit: challenges and opportunities. In: High performance computing & simulation. HPCS'09. International Conference, pp 1–11. IEEE

  34. Calheiros NR, Ranjan R, Beloglazov A, De Rose C, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Experience 41:23–50

    Article  Google Scholar 

  35. Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers. J Concurr Comput Pract Exp 24(13):1397–1420

    Article  Google Scholar 

  36. Meffert K, Rotstan N (2018) JGAP-Java genetic algorithms package. Retrieved 10 Oct 2018. http://jgap.sourceforge.net/

  37. Momenzadeh Z, Safi-Esfahani F (2019) Workflow scheduling applying adaptable and dynamic fragmentation (WSADF) based on runtime conditions in cloud computing. Future Gener Comput Syst 90:327–346

    Article  Google Scholar 

  38. Haratian P, Safi-Esfahani F, Salimian L, Nabiollahi A (2017) An adaptive and fuzzy resource management approach in cloud computing. IEEE Transactions on Cloud Computing (in press)

  39. Shojaei K, Safi-Esfahani F (2018) VMDFS: virtual machine dynamic frequency scaling framework in cloud computing. J Supercomput 74(11):5944–5979

    Article  Google Scholar 

  40. Torabi S, Safi-Esfahani F (2018) A dynamic task scheduling framework based on chicken swarm and improved raven roosting optimization methods in cloud computing. J Supercomput 74(6):2581–2626

    Article  Google Scholar 

  41. Alaei N, Safi-Esfahani F (2018) RePro-Active: a reactive—proactive scheduling method based on simulation in cloud computing. J Supercomput 74(2):801–829

    Article  Google Scholar 

  42. Meshkati J, Safi-Esfahani F (2018) Energy-aware resource utilization based on particle swarm optimization and artificial bee colony algorithms in cloud computing. J Supercomputing. https://doi.org/10.1007/s11227-018-2626-9

    Article  Google Scholar 

  43. Khatibi N, Safi-Esfahani F (2018) Adaptable decentralized workflow execution framework in cloud computing (ADWEF.Cloud). Int J Cloud Appl Comput IJCAC 9(2)

  44. Khorsand R, Safi-Esfahani F, Nematbakhsh N, Mohsenzade M (2017) ATSDS: adaptive two-stage deadline-constrained workflow scheduling considering run-time circumstances in cloud computing environments. J Supercomput 73(6):2430–2455

    Article  Google Scholar 

  45. Fadaei Tehrani A, Safi-Esfahani F (2017) A threshold sensitive failure prediction method using support vector machine. Multiagent Grid Syst 13:97–111

    Article  Google Scholar 

  46. Salimian L, Safi-Esfahani F, Nadimi-Shahraki M-HJC (2016) An adaptive fuzzy threshold-based approach for energy and performance efficient consolidation of virtual machines. Computing 98(6):641–660

    Article  MathSciNet  Google Scholar 

  47. Motavaselalhagh F, Safi-Esfahani F, Arabnia HR, Sciences I (2015) Knowledge-based adaptable scheduler for SaaS providers in cloud computing. Human-centric Comput Inf Sci 5(1):16

    Article  Google Scholar 

  48. Donyadari E, Safi-Esfahani F, Nourafza N (2015) Scientific workflow scheduling based on deadline constraints in cloud environment. Int J Mechatron Electr Comput Technol (IJMEC) 5(16):1–15

    Google Scholar 

  49. Julien Y, Sobrino JA (2015) CloudSim: a fair benchmark for comparison of methods for times series reconstruction from cloud and atmospheric contamination. In 2015 8th International Workshop on the Analysis of Multitemporal Remote Sensing Images (Multi-Temp). IEEE

  50. Gupta K, Beri R, Behal V, Gupta K, Beri R, Behal V (2016) Cloud computing: a survey on cloud simulation tools. Int J Innov Res Sci Technol IJIRST 2(11)

  51. www.cloudbus.org (2018) The CLOUDS lab: flagship projects—gridbus and cloudbus. Retrieved 10 Oct 2018. http://www.cloudbus.org/workloads.html

  52. docs.oracle.com (2018) Random (Java Platform SE 8). Retrieved 10 Oct 2018. https://docs.oracle.com/javase/8/docs/api/java/util/Random.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Faramarz Safi-Esfahani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kamalinasab, S., Safi-Esfahani, F. & Shahbazi, M. CRFF.GP: cloud runtime formulation framework based on genetic programming. J Supercomput 75, 3882–3916 (2019). https://doi.org/10.1007/s11227-019-02750-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-019-02750-8

Keywords

Navigation