skip to main content
10.1145/2557977.2558079acmconferencesArticle/Chapter ViewAbstractPublication PagesicuimcConference Proceedingsconference-collections
research-article

Cost adaptive workflow scheduling in cloud computing

Published: 09 January 2014 Publication History

Abstract

In cloud computing, it remains a challenge to allocate virtualized resource with financial cost minimization and acceptable Quality of Service assurance. In general, the VM instance is allocated to cloud service users based on not actual job processing time but the fixed resource allocation time predetermined by cloud pricing policy in contrast to grid environment. In this case, the unnecessary cost dissipation is occurred by the wasted partial instance hours of allocated resource. To address this problem, we propose the heuristic based workflow scheduling scheme considering cloud-pricing model in this paper. Our scheme is composed of two phases: VM packing and MRSR (Multi Requests to Single Resource) phases. In VM-packing phase, preassigned multi tasks are aggregated into the common VM instance sequentially, and these tasks are merged in parallel by MRSR phase. By using our proposed schemes, we are able to reduce the number of required VM instances and achieve the significant cost saving while we guarantee the user's SLA (Service Level Agreement) in terms of workflow deadline. Our proposed schemes cannot only reduce the cost by 30% compared to traditional workflow scheduling schemes but also assure user's SLA.

References

[1]
Q. Zhang, L. Cheng, and R. Boutaba, "Cloud Computing: State-of-the-art and research challenges," J. Internet Services and Applications, vol. 1, issue 1, pp. 7--18, 2010.
[2]
H. N. Van, and F. D. Tran, "Autonomic virtual resource management for service hosting platforms," Proc. Int'l Workshop. CLOUD, 2009.
[3]
M. Mao, J. Li, M. Humphrey, "Cloud Auto-scaling with Deadline and Budget Constraints," Proc. Int'l Conf. IEEE/ACM Grid Computing, 2010.
[4]
S. Son, and K. M. Sim "A Price- and-Time-Slot-Negotiation Mechanism for Cloud Service Reservations," IEEE Trans. Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 42, no. 3, June 2012.
[5]
Amazon EC2 (2013), http://aws.amazon.com/ec2/
[6]
https://cloud.google.com
[7]
GoGrid (2013), http://www.gogrid.com/
[8]
J. Yu, R. Buyya, and C. K. Tham, "Cost-based Scheduling of Scientific Workflow Applicationcs on Utility Grids," Proc. Int'l Conf. e-Science and Grid Computing, pp. 140--147, July 2005.
[9]
J. Yu, R. Buyya, and C. K. Tham, "Qos-based Scheduling of Workflow Applications on Service Grids," Proc. Int'l Conf. e-Science and Grid Computing, pp. 140--147, July 2005.
[10]
J. Yu, and R. Buyya, "A Taxonomy of Workflow Management Systems for Grid Computing," J. Grid Computing, vol. 3, issue 3--4, pp. 171--200, 2005
[11]
J. Tao, K. Furlinger, L. Wang, and H. Marten, "A Performance Study of Virtual Machines on Multicore Architectures," Proc. Int'l Euromicro Conf. Parallel, Distributed and Network-based Processing, 2012.
[12]
Openstack (2013) http://www.openstack.org/
[13]
http://montage.ipac.caltech.edu/
[14]
G. B. Berriman, E. Deelman, J. Good, J. Jacob, D. S. Katz, C. Kesselman, A. Laity, T. A. Prince, G. Singh, and M. H. Su, "Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand," Proc. SPIE5493, Optimizing Scientific Return Astronomy through Information Technologies, 2004.
[15]
E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good, "The cost of doing science on the cloud: the Montage example," Proc. Int'l Conf. ACM/IEEE supercomputing, 2008
[16]
H. Topcuoglu, S. Hariri, and M. Y. Wu, "Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing," IEEE Trans. Parallel and Distributed Systems, vol. 13, no. 3, pp. 260--274, Mar 2002.
[17]
R. Sakellariou, and H. Zhao, "A hybrid heuristic for DAG scheduling on heterogeneous systems," Proc. Int'l Conf. Parallel and Distributed Processing Symposium, 2004.
[18]
R. Sakellariou, and H. Zhao, "Scheduling workflows with budget constraints," Integrated Research in GRID Computing, CoreGRID Series, S. Gorlatch, and M. Danelutto, eds., pp. 189--202, Springer, 2007.
[19]
S. Abrishami, M. Naghibzadeh, and D. H. J. Epema, "Cost-Driven Scheduling of Grid Workflows Using Partial Critical Paths," IEEE Trans. Parallel and Distributed Systems, vol. 23, no. 8, pp. 1400--1414, Aug 2012.
[20]
M. Mao, and M. Humphrey, "Auto-Scaling to Minimize Cost and Meet Application Deadlines in Cloud Workflows," Proc. Int'l Conf. High Performance Computing, Networking, Storage and Analysis (SC), 2011.
[21]
M. Mao, and M. Humphrey, "Scaling and Scheduling to Maximize Application Performance within Budget Constraints in Cloud Workflows," Proc. Int'l Symp. Parallel and Distributed Processing, 2013.
[22]
D. K. Kang, S. H. Kim, Y. Ren, B. S. Kim, W. J. Kim, Y. S. Kim, C. H. Youn, and C. S. Jeong, "Enhancing a Strategy of Virtualized Resource Assignment in Adaptive Resource Cloud Framework," Proc. Int'l Conf. ACM ICUIMC, 2013.

Cited By

View all
  • (2025)Quality aware batch scheduling of containers in cloud computing environmentInternational Journal of Information Technology10.1007/s41870-024-02331-wOnline publication date: 4-Jan-2025
  • (2024)Scientific workflow scheduling algorithms in cloud environments: a comprehensive taxonomy, survey, and future directionsJournal of Scheduling10.1007/s10951-024-00820-1Online publication date: 28-Oct-2024
  • (2020)Instance Data Protection on Cloud Environment using Multi-Layered Approach based on Fog Computing2020 International Conference on Communication and Signal Processing (ICCSP)10.1109/ICCSP48568.2020.9182112(1619-1627)Online publication date: Jul-2020
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICUIMC '14: Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication
January 2014
757 pages
ISBN:9781450326445
DOI:10.1145/2557977
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 January 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cloud resource management
  2. virtual machine allocation
  3. workflow scheduling

Qualifiers

  • Research-article

Funding Sources

Conference

ICUIMC '14
Sponsor:

Acceptance Rates

ICUIMC '14 Paper Acceptance Rate 116 of 407 submissions, 29%;
Overall Acceptance Rate 251 of 941 submissions, 27%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 26 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Quality aware batch scheduling of containers in cloud computing environmentInternational Journal of Information Technology10.1007/s41870-024-02331-wOnline publication date: 4-Jan-2025
  • (2024)Scientific workflow scheduling algorithms in cloud environments: a comprehensive taxonomy, survey, and future directionsJournal of Scheduling10.1007/s10951-024-00820-1Online publication date: 28-Oct-2024
  • (2020)Instance Data Protection on Cloud Environment using Multi-Layered Approach based on Fog Computing2020 International Conference on Communication and Signal Processing (ICCSP)10.1109/ICCSP48568.2020.9182112(1619-1627)Online publication date: Jul-2020
  • (2020)Resource Scheduling for Tasks of a Workflow in Cloud EnvironmentDistributed Computing and Internet Technology10.1007/978-3-030-36987-3_13(214-226)Online publication date: 9-Jan-2020
  • (2020)Extensive review of cloud resource management techniques in industry 4.0: Issue and challengesSoftware: Practice and Experience10.1002/spe.281051:12(2373-2392)Online publication date: 21-Feb-2020
  • (2019)A Review of Cost and Makespan-Aware Workflow Scheduling in CloudsJournal of Circuits, Systems and Computers10.1142/S021812661930006X28:06(1930006)Online publication date: 12-Jun-2019
  • (2019)Cost-efficient parallel processing of irregularly structured problems in cloud computing environmentsCluster Computing10.1007/s10586-018-2879-322:3(887-909)Online publication date: 1-Sep-2019
  • (2019)New approach to allocation planning of many‐task workflows on cloudsConcurrency and Computation: Practice and Experience10.1002/cpe.540432:2Online publication date: 18-Jun-2019
  • (2018)Bargaining Game-Based Scheduling for Performance Guarantees in Cloud ComputingACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/31412333:1(1-25)Online publication date: 13-Feb-2018
  • (2018)A Critique of Algorithms in IaaS Cloud for Multi Criteria Task Scheduling2018 International Conference on Inventive Research in Computing Applications (ICIRCA)10.1109/ICIRCA.2018.8597258(775-781)Online publication date: Jul-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media