Abstract
With the emergence of cloud computing paradigm, it provides a promising new solution for sophisticated instance intensive applications. However, the reliability and response speed begins to be suffered because of the limitation of the Hadoop’s FIFO scheduling model. It becomes unacceptable to execute the large scale instance intensive tasks under such conditions. In order to enhance the system resource utilization, we propose a solution in this paper. We use a delay scheduling algorithm to determine the scheduling opportunity and reduce the cost. Delay scheduling can ensure that the current scheduled tasks can make full use of the physical resources, raise resource utilization, and reduce the probability of failure scheduling. The experimental evaluation illustrates that the large scale instance intensive tasks can benefit from the Min-cost delay scheduling algorithm presented in the paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andrzejak, A., Kondo, D., Anderson, D.P.: Exploiting non-dedicated resources for Cloud computing. In: The 12th IEEE/IFIP (NOMS 2010), Osaka, Japan, 19–23 April 2010
Bowers, S., Ludäscher, B.: Actor-oriented design of scientific workflows. In: Delcambre, L.M.L., Kop, C., Mayr, H.C., Mylopoulos, J., Pastor, Ó. (eds.) ER 2005. LNCS, vol. 3716, pp. 369–384. Springer, Heidelberg (2005)
Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25 (6), 599–616 (2009)
Zhang, C., De Sterck, H.: CloudWF: a computational workflow system for clouds based on hadoop. In: Jaatun, M.G., Zhao, G., Rong, C. (eds.) Cloud Computing. LNCS, vol. 5931, pp. 393–404. Springer, Heidelberg (2009)
Yang, C., Wang, L., Yang, C., Liu, S., Meng, X.: The personalized service customization based on multimedia resources in digital museum grid. In: The 3rd International Conference on U-media, pp. 298–304. Zhejiang Normal University, China, June 2010
Zaharia, M., Borthakur, D., Sen Sarma, J.: Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In: EuroSys 2010 (2010)
Grounds, N.G., Antonio, J.K., Muehring, J.: Cost-minimizing scheduling of workflows on a cloud of memory managed multicore machines. In: Jaatun, M.G., Zhao, G., Rong, C. (eds.) Cloud Computing. LNCS, vol. 5931, pp. 435–450. Springer, Heidelberg (2009)
Pandey, S., Karunamoorthy, D., Buyya, R.: Workflow engine for clouds. In: Cloud Computing: Principles and Paradigms. Wiley, New York (2011)
Cunsolo, V.D., Distefano, S., Puliafito, A., Scarpa, M.: Cloud@home: bridging the gap between volunteer and cloud computing. In: Huang, D.-S., Jo, K.-H., Lee, H.-H., Kang, H.-J., Bevilacqua, V. (eds.) ICIC 2009. LNCS, vol. 5754, pp. 423–432. Springer, Heidelberg (2009)
Li, W.: Research on instance intensive workflow scheduling for community cloud. Shandong Univ. (2010)
Liu, X., Yuan, D., Zhang, G., Chen, J., Yang, Y.: SwinDeW-C: a peer-to-peer based cloud workflow system. In: Furht, B., Escalante, A. (eds.) Handbook of Cloud Computing, pp. 309–332. Springer, New York (2010)
Shang, L., Petiton, S., Emad, N., Yang, X.: YML-PC: a reference architecture based on workflow for building scientific private clouds. In: Antonopoulos, N., Gillam, L. (eds.) Cloud Computing, pp. 247–252. Springer, London (2010)
Yang, C., Guo, J.-D., Chi, J.: A dynamic delay optimization scheduling model. In: Luo, Y. (ed.) CDVE 2014. LNCS, vol. 8683, pp. 68–71. Springer, Heidelberg (2014)
Ju, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci. Program. 14 (3-4), 217–230 (2006)
Yan, J., Wu, G.: Scheduling algorithm for instance intensive workflow. Comput. Appl. 11 , 2864–2866 (2010)
Liu, K., Jin, H., Chen, J., Liu, X., Yuan, D., Yang, Y.: A compromised-time-cost scheduling algorithm in SwinDeW C for instance-intensive cost-constrained workflows on cloud computing platform. Int. J. High Perform. Comput. Appl. 24 , 445–456 (2010)
Acknowledgement
This paper is supported in part by Natural Science Foundation of China under Grant 61303088 and 61402261 and part by A Project of Shandong Province Higher Educational Science and Technology Program under Grant J14LN19, and part by the Natural Science Foundation of Shandong Province (Doctoral Foundation) under Grant BS2015DX013, and part by the Fundamental Research Funds for Shandong Provincial Key Laboratory of Software Engineering under Grant 2013SE05. The third author is the corresponding author, and his e-mail address is psm161913@sina.com.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, C., Peng, S. (2015). A Min-cost with Delay Scheduling Method for Large Scale Instance Intensive Tasks. In: Luo, Y. (eds) Cooperative Design, Visualization, and Engineering. CDVE 2015. Lecture Notes in Computer Science(), vol 9320. Springer, Cham. https://doi.org/10.1007/978-3-319-24132-6_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-24132-6_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24131-9
Online ISBN: 978-3-319-24132-6
eBook Packages: Computer ScienceComputer Science (R0)