skip to main content
10.1145/2462326.2462339acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
research-article

A broker-based framework for multi-cloud workflows

Published: 22 April 2013 Publication History

Abstract

Computational science workflows have been successfully run on traditional HPC systems like clusters and Grids for many years. Today, users are interested to execute their workflow applications in the Cloud to exploit the economic and technical benefits of this new emerging technology. The deployment and management of workflows over the current existing heterogeneous and not yet interoperable Cloud providers, however, is still a challenging task for the workflow developers. In this paper, we present a broker-based framework for running workflows in a multi-Cloud environment. The framework allows an automatic selection of the target Clouds, a uniform access to the Clouds, and workflow data management with respect to user Service Level Agreement (SLA) requirements. Following a simulation approach, we evaluated the framework with a real scientific workflow application in different deployment scenarios. The results show that our framework offers benefits to users by executing workflows with the expected performance and service quality at lowest cost.

References

[1]
G. B. Berriman, E. Deelman, J. C. Good, J. C. Jacob, D. S. Katz, C. Kesselman, A. C. Laity, T. A. Prince, G. Singh, and M.-H. Su. Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand. In Proceedings of the Society of Photo-Optical Instrumentation Engineers Conference, volume 5493 of SPIE 04, pages 221--232, September 2004.
[2]
R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. D. Rose, and R. Buyya. CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms. Software: Practice and Experience, 41(1):23--50, January 2011.
[3]
R. N. Calheiros, C. Vecchiola, D. Karunamoorthy, and R. Buyya. The Aneka platform and QoS-driven resource provisioning for elastic applications on hybrid Clouds. Future Generation Computer Systems, 28(6):861--870, June 2012.
[4]
W. Chen and E. Deelman. WorkflowSim: A Toolkit for Simulating Scientific Workflows in Distributed Environments. In Proceedings of the 8th IEEE International Conference on eScience, Chicago, USA, October 2012.
[5]
D. de Oliveira, E. Ogasawara, F. Baiao, and M. Mattoso. SciCumulus: A Lightweight Cloud Middleware to Explore Many Task Computing Paradigm in Scientific Workflows. In Proceedings of the 3rd IEEE International Conference on Cloud Computing, CLOUD '10, pages 378--385, Washington, DC, USA, 2010.
[6]
E. Deelman, G. Juve, and G. B. Berriman. Using Clouds For Science, is it Just Kicking The Can Down the Road? In Proceedings of the International Conference on Cloud Computing and Services Science, CLOSER 2012, pages 127--133, Porto, Portugal, April 2012.
[7]
B. Demuth, S. Bernd, H. Sonja, M. D. Jason, G. André, H. Valentina, and S. Sulev. The UNICORE Rich Client: Facilitating the Automated Execution of Scientific Workflows. In Proceedings of 6th IEEE International Conference on eScience, pages 238--245, 2010.
[8]
J. O. Gutierrez-Garcia and K. M. Sim. Agent-based Cloud Workflow Execution. Integrated Computer-Aided Engineering, 19:39--56, 2012.
[9]
M. Hardt, T. Jejkal, I. Campos, E. Fernandez, A. Jackson, D. Nielsson, B. Palak, and M. Plociennik. Transparent Access to Scientific and Commercial Clouds from the Kepler Workflow Engine. Computing and Informatics, 31:1001--1015, 2012.
[10]
F. Jrad, J. Tao, R. Knapper, C. M. Flath, and A. Streit. A utility-based approach for customised cloud service selection. Int. J. Computational Science and Engineering, forthcoming.
[11]
F. Jrad, J. Tao, and A. Streit. SLA Based Service Brokering in Intercloud Environments. In Proceedings of the International Conference on Cloud Computing and Services Science, CLOSER 2012, pages 76--81, Porto, Portugal, April 2012.
[12]
G. Juve and E. Deelman. Scientific Workflows in the Cloud, pages 71--91. Computer Communications and Networks. Springer London, 2011.
[13]
G. Juve, E. Deelman, G. Berriman, B. P. Berman, and P. Maechling. An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2. Journal of Grid Computing, 10:5--21, 2012.
[14]
S. Pandey, D. Karunamoorthy, and R. Buyya. Workflow Engine for Clouds, pages 321--344. John Wiley, Inc, 2011.
[15]
I. Raicu, I. T. Foster, and Y. Zhao. Many-Task Computing for Grids and Supercomputers. In Proceedings of the IEEE Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS 08, pages 1--11, Austin, TX, USA, November 2008.
[16]
J. Tao, D. Franz, H. Marten, and A. Streit. An Implementation Approach for Inter-Cloud Service Combination. International Journal on Advances in Software, 5:65--75, 2012.
[17]
J. Yu and R. Buyya. A Taxonomy of Scientific Workflow Systems for Grid Computing. SIGMOD Rec., 34(3):44--49, September 2005.

Cited By

View all
  • (2023)An online service provisioning strategy for container-based cloud brokersJournal of Network and Computer Applications10.1016/j.jnca.2023.103618214:COnline publication date: 1-May-2023
  • (2020)AN EFFICIENT FAULT TOLERANT CLUSTERING FOR SCIENTIFIC WORKFLOWINTERNATIONAL JOURNAL OF ADVANCED INFORMATION AND COMMUNICATION TECHNOLOGY10.46532/ijaict-2020004(16-19)Online publication date: 1-May-2020
  • (2020)Multiple Workflows Scheduling in Multi-tenant Distributed SystemsACM Computing Surveys10.1145/336803653:1(1-39)Online publication date: 6-Feb-2020
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MultiCloud '13: Proceedings of the 2013 international workshop on Multi-cloud applications and federated clouds
April 2013
76 pages
ISBN:9781450320504
DOI:10.1145/2462326
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cloud broker
  2. cloud computing
  3. cloud workflow
  4. intercloud computing
  5. multi-cloud

Qualifiers

  • Research-article

Conference

ICPE'13
Sponsor:

Acceptance Rates

MultiCloud '13 Paper Acceptance Rate 9 of 18 submissions, 50%;
Overall Acceptance Rate 9 of 18 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)An online service provisioning strategy for container-based cloud brokersJournal of Network and Computer Applications10.1016/j.jnca.2023.103618214:COnline publication date: 1-May-2023
  • (2020)AN EFFICIENT FAULT TOLERANT CLUSTERING FOR SCIENTIFIC WORKFLOWINTERNATIONAL JOURNAL OF ADVANCED INFORMATION AND COMMUNICATION TECHNOLOGY10.46532/ijaict-2020004(16-19)Online publication date: 1-May-2020
  • (2020)Multiple Workflows Scheduling in Multi-tenant Distributed SystemsACM Computing Surveys10.1145/336803653:1(1-39)Online publication date: 6-Feb-2020
  • (2020)Multi-Cloud: A Comprehensive Review2020 IEEE 23rd International Multitopic Conference (INMIC)10.1109/INMIC50486.2020.9318176(1-5)Online publication date: 5-Nov-2020
  • (2020)Optimal Selection Techniques for Cloud Service ProvidersIEEE Access10.1109/ACCESS.2020.30358168(203591-203618)Online publication date: 2020
  • (2020)Optimizing computational resource management for the scientific gateways ecosystems based on the service‐oriented paradigmSoftware: Practice and Experience10.1002/spe.280850:6(899-924)Online publication date: 26-Feb-2020
  • (2019)Orchestrating Big Data Analysis Workflows in the CloudACM Computing Surveys10.1145/333230152:5(1-41)Online publication date: 13-Sep-2019
  • (2019)Cloud BrokerageACM Computing Surveys10.1145/327465751:6(1-28)Online publication date: 28-Jan-2019
  • (2019)Research challenges in nextgen service orchestrationFuture Generation Computer Systems10.1016/j.future.2018.07.03990(20-38)Online publication date: Jan-2019
  • (2019)Efficient task and workflow scheduling in inter-cloud environments: challenges and opportunitiesThe Journal of Supercomputing10.1007/s11227-019-03038-7Online publication date: 23-Oct-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media