Abstract
The response time starts to suffer due to the limitation of the Hadoop’s FIFO scheduler, and this is unacceptable to execute the large scale instance intensive tasks. To enhance the system resource utilization, we propose a new scheduling solution. To reduce the cost, we use a delay scheduling algorithm to determine the scheduling opportunity. Delay scheduling can ensure that the current service can make full use of the resources, improve resource utilization, and reduce the probability of failure scheduling. The initial experiments demonstrate that the large scale instances intensive workflow tasks will benefit from the Min-Cost delay scheduling algorithm that is proposed in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andrzejak, A., Kondo, D., Anderson, D.P.: Exploiting non-dedicated resources for Cloud computing. In: The 12th IEEE/IFIP (NOMS 2010), Osaka, Japan, April 19-23 (2010)
Bowers, S., Ludäscher, B.: Actor-Oriented Design of Scientific Workflows. In: Delcambre, L.M.L., Kop, C., Mayr, H.C., Mylopoulos, J., Pastor, Ó. (eds.) ER 2005. LNCS, vol. 3716, pp. 369–384. Springer, Heidelberg (2005)
Bowers, S., Ludäscher, B.: Actor-Oriented Design of Scientific Workflows. In: Delcambre, L.M.L., Kop, C., Mayr, H.C., Mylopoulos, J., Pastor, Ó. (eds.) ER 2005. LNCS, vol. 3716, pp. 369–384. Springer, Heidelberg (2005)
Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems 25(6), 599–616 (2009)
Zhang, C., De Sterck, H.: CloudWF: A Computational Workflow System for Clouds Based on Hadoop. In: Jaatun, M.G., Zhao, G., Rong, C. (eds.) Cloud Computing. LNCS, vol. 5931, pp. 393–404. Springer, Heidelberg (2009)
Yang, C., Wang, L., Yang, C., Liu, S., Meng, X.: The Personalized Service Customization Based on Multimedia Resources in Digital Museum Grid. In: The 3rd International Conference on U-media, Zhejiang Normal University, China, pp. 298–304 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, C., Guo, JD., Chi, J. (2014). A Dynamic Delay Optimization Scheduling Model. In: Luo, Y. (eds) Cooperative Design, Visualization, and Engineering. CDVE 2014. Lecture Notes in Computer Science, vol 8683. Springer, Cham. https://doi.org/10.1007/978-3-319-10831-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-10831-5_10
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10830-8
Online ISBN: 978-3-319-10831-5
eBook Packages: Computer ScienceComputer Science (R0)