Skip to main content
Log in

A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Task scheduling is one of the most challenging aspects to improve the overall performance of cloud computing and optimize cloud utilization and Quality of Service (QoS). This paper focuses on Task Scheduling optimization using a novel approach based on Dynamic dispatch Queues (TSDQ) and hybrid meta-heuristic algorithms. We propose two hybrid meta-heuristic algorithms, the first one using Fuzzy Logic with Particle Swarm Optimization algorithm (TSDQ-FLPSO), the second one using Simulated Annealing with Particle Swarm Optimization algorithm (TSDQ-SAPSO). Several experiments have been carried out based on an open source simulator (CloudSim) using synthetic and real data sets from real systems. The experimental results demonstrate the effectiveness of the proposed approach and the optimal results is provided using TSDQ-FLPSO compared to TSDQ-SAPSO and other existing scheduling algorithms especially in a high dimensional problem. The TSDQ-FLPSO algorithm shows a great advantage in terms of waiting time, queue length, makespan, cost, resource utilization, degree of imbalance, and load balancing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Reproduced with permission from [17]

Fig. 12

Reproduced with permission from [17]

Fig. 13

Reproduced with permission from [13]

Fig. 14

Reproduced with permission from [13]

Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Mell, P., Grance, T.: The NIST Definition of Cloud Computing, p. 800. National Institute of Standards and Technology. The NIST Special Publication, Gaithersburg (2011)

    Google Scholar 

  2. Armbrust, M., Stoica, I., Zaharia, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A.: A view of cloud computing. Commun. ACM 53, 50 (2010)

    Article  Google Scholar 

  3. Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, pp. 1942–1948. IEEE Service Center, Piscataway (1995)

  4. Eglese, R.: Simulated annealing: a tool for operational research. Eur. J. Oper. Res. 46, 271–281 (1990)

    Article  MathSciNet  Google Scholar 

  5. Lee, C.: Fuzzy logic in control systems: fuzzy logic controller. I. IEEE Trans. Syst. Man Cybern. 20, 404–418 (1990)

    Article  MathSciNet  Google Scholar 

  6. Ben Alla, H., Ben Alla, S., Ezzati, A., Mouhsen, A.: A Novel Architecture with Dynamic Queues Based on Fuzzy Logic and Particle Swarm Optimization Algorithm for Task Scheduling in Cloud Computing. Lecture Notes in Electrical Engineering, pp. 205–217. Springer, New York (2016)

    Google Scholar 

  7. Parallel Workloads Archive, http://www.cs.huji.ac.il/labs/parallel/workload

  8. Sujan, S., Kanniga Devi, R.: An efficient task scheduling scheme in cloud computing using graph theory. Proceedings of the International Conference on Soft Computing Systems. pp. 655–662 (2015)

  9. Gupta, J., Azharuddin, M., Jana, P.: An effective task scheduling approach for cloud computing environment. Lecture Notes in Electrical Engineering. pp. 163–169 (2016)

    Google Scholar 

  10. Ma, J., Li, W., Fu, T., Yan, L., Hu, G.: A novel dynamic task scheduling algorithm based on improved genetic algorithm in cloud computing. In: Wireless Communications, Networking and Applications. pp. 829–835 (2015)

    Google Scholar 

  11. Guo, L., Zhao, S., Shen, S., Jiang, C.: Task scheduling optimization in cloud computing based on heuristic algorithm. J. Netw. 7, 547–553 (2012)

    Google Scholar 

  12. Wu, X., Deng, M., Zhang, R., Zeng, B., Zhou, S.: A task scheduling algorithm based on QoS-driven in cloud computing. Proc. Comput. Sci. 17, 1162–1169 (2013)

    Article  Google Scholar 

  13. Keshk, A., El-Sisi, A., Tawfeek, M.: Cloud task scheduling for load balancing based on intelligent strategy. Int. J. Intell. Syst. Appl. 6, 25–36 (2014)

    Google Scholar 

  14. Khalili, A., Babamir, S.M.: Makespan improvement of PSO-based dynamic scheduling in cloud environment. In: Proceedings of the 23rd Iranian Conference on Electrical Engineering, pp. 613–618 (2015)

  15. Zulkar Nine, M., Azad, M., Abdullah, S., Rahman, R.: Fuzzy logic based dynamic load balancing in virtualized data centers. In: Proceedings of the 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) (2013)

  16. Chen, Z., Zhu, Y., Di, Y., Feng, S.: A dynamic resource scheduling method based on fuzzy control theory in cloud environment. J. Cont. Sci. Eng. 2015, 1–10 (2015)

    Article  Google Scholar 

  17. Kaur, S., Verma, A.: An efficient approach to genetic algorithm for task scheduling in cloud computing environment. Int. J. Inf. Technol. Comput. Sci. 4, 74–79 (2012)

    Google Scholar 

  18. Al-Olimat, H., Alam, M., Green, R., Lee, J.: Cloudlet scheduling with particle swarm optimization. In: 2015 Fifth International Conference on Communication Systems and Network Technologies (2015)

  19. Gabi, D., Ismail, A., Zainal, A., Zakaria, Z.: Solving task scheduling problem in cloud computing environment using Orthogonal Taguchi-Cat Algorithm. Int. J. Electr. Comput. Eng. 7, 1489 (2017)

    Google Scholar 

  20. Komarasamy, D., Muthuswamy, V.: ScHeduling of jobs and adaptive resource provisioning (SHARP) approach in cloud computing. Clust Comput (2017). https://doi.org/10.1007/s10586-017-0976-3

    Article  Google Scholar 

  21. Zhang, P., Zhou, M.: Dynamic cloud task scheduling based on a two-stage strategy. IEEE Trans. Autom. Sci. Eng. 15, 1–12 (2017)

    Google Scholar 

  22. Zuo, L., Dong, S., Shu, L., Zhu, C., Han, G.: A Multiqueue interlacing peak scheduling method based on tasks’ classification in cloud computing. IEEE Syst. J. 6, 1–13 (2016)

    Google Scholar 

  23. Peng, Z., Cui, D., Zuo, J., Li, Q., Xu, B., Lin, W.: Random task scheduling scheme based on reinforcement learning in cloud computing. Clust. Comput. 18, 1595–1607 (2015)

    Article  Google Scholar 

  24. Karthick, A., Ramaraj, E., Subramanian, R.: An Efficient multi queue job scheduling for cloud computing. In: Proceedings of the 2014 World Congress on Computing and Communication Technologies. (2014)

  25. He, T., Cai, L., Deng, Z., Meng, T., Wang, X.: Queuing-Oriented Job Optimizing Scheduling In Cloud Mapreduce. In: Proceedings of the International Conference on Advances on P2P, Parallel, Grid, Cloud and Internet Computing. pp. 435–446 (2016)

    Google Scholar 

  26. The Apache Hadoop Project: http://hadoop.apache.org/

  27. Blondin, J.: Particle swarm optimization: a tutorial (2009). http://www.cs.armstrong.edu/saad/csci8100/pso_tutorial.pdf

  28. Clerc, M., Kennedy, J.: The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6, 58–73 (2002)

    Article  Google Scholar 

  29. Feng, Y., Teng, G., Wang, A., Yao, Y.: Chaotic Inertia Weight in Particle Swarm Optimization. In: Proceedings of the Second International Conference on Innovative Computing, Information and Control (ICICIC 2007). (2007)

  30. Xin, J., Chen, G., Hai, Y.: A Particle Swarm Optimizer with Multi-stage linearly-decreasing inertia weight. In: Proceedings of the 2009 International Joint Conference on Computational Sciences and Optimization. (2009)

  31. Yue-lin, G., Yu-hong, D.: A new particle swarm optimization algorithm with random inertia weight and evolution strategy. In: Proceedings of the 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007). (2007)

  32. Kumar, S., Chaturvedi, D.: Tuning of particle swarm optimization parameter using fuzzy logic. In: Proceedings of the 2011 International Conference on Communication Systems and Network Technologies. (2011)

  33. Kennedy, J., Eberhart, R.: A discrete binary version of the particle swarm algorithm. In: Proceedings of the 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation. (1997)

  34. Mendel, J.: Fuzzy logic systems for engineering: a tutorial. Proc. IEEE 83, 345–377 (1995)

    Article  Google Scholar 

  35. Kalra, M., Singh, S.: A review of metaheuristic scheduling techniques in cloud computing. Egypt. Inform. J. 16, 275–295 (2015)

    Article  Google Scholar 

  36. Li, K., Xu, G., Zhao, G., Dong, Y., Wang, D.: Cloud task scheduling based on load balancing ant colony optimization. 2011 In: Proceedings of the Sixth Annual Chinagrid Conference. (2011)

  37. Yin, P., Yu, S., Wang, P., Wang, Y.: Task allocation for maximizing reliability of a distributed system using hybrid particle swarm optimization. J. Syst. Softw. 80, 724–735 (2007)

    Article  Google Scholar 

  38. Mamdani, E.: Application of fuzzy algorithms for control of simple dynamic plant. Proc. Inst. Electr. Eng. 121, 1585 (1974)

    Article  Google Scholar 

  39. Cingolani, P., Alcalá-Fdez, J.: jFuzzyLogic: a Java library to design fuzzy logic controllers according to the standard for fuzzy control programming. Int. J. Comput. Intell. Syst. 6, 61–75 (2013)

    Article  Google Scholar 

  40. Cingolani, P., Alcala-Fdez, J.: jFuzzyLogic: a robust and flexible Fuzzy-Logic inference system language implementation. In: Proceedings of the 2012 IEEE International Conference on Fuzzy Systems. (2012)

  41. Calheiros, R., Ranjan, R., Beloglazov, A., De Rose, C., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software 41, 23–50 (2011)

    Google Scholar 

  42. The High-Performance Computing Center North (HPC2N) in Sweden, http://www.cs.huji.ac.il/labs/parallel/workload/l_hpc2n/

  43. Arumugam, M., Rao, M.: On the performance of the particle swarm optimization algorithm with various inertia weight variants for computing optimal control of a class of hybrid systems. Disc. Dyn. Nat. Soc. 2006, 1–17 (2006)

    Article  MathSciNet  Google Scholar 

  44. Umapathy, P., Venkataseshaiah, C., Arumugam, M.: Particle swarm optimization with various inertia weight variants for optimal power flow solution. Disc. Dyn. Nat. Soc. 2010, 1–15 (2010)

    Article  MathSciNet  Google Scholar 

  45. Parallel Workloads Archive: NASA Ames iPSC/860, http://www.cs.huji.ac.il/labs/parallel/workload/l_nasa_ipsc/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Said Ben Alla.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ben Alla, H., Ben Alla, S., Touhafi, A. et al. A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment. Cluster Comput 21, 1797–1820 (2018). https://doi.org/10.1007/s10586-018-2811-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-018-2811-x

Keywords

Navigation