research-article

Understanding scheduling implications for scientific applications in clouds

Authors:

G. Mc Evoy,

B. SchulzeAuthors Info & Claims

MGC '11: Proceedings of the 9th International Workshop on Middleware for Grids, Clouds and e-Science

Article No.: 3, Pages 1 - 6

https://doi.org/10.1145/2089002.2089005

Published: 12 December 2011 Publication History

Get Access

Abstract

This paper explores some of the effects that the paradigm of Cloud Computing has on schedulers when executing scientific applications. We present premises regarding to provisioning and architectural aspects of a Cloud infrastructure, that are not present in other environments, and which implications they may have on scheduling decisions in presence of relevant policies like improving performance. We also argue that using virtualization as a mechanism for workload consolidation in a multi-core environment has important performance consequences for e-science. We propose and test a preliminary workload classification, based on usage modes, that may improve early scheduling decisions as we research towards automatic deployment of scientific applications.

References

[1]

F. Dong and S. G. Akl. Scheduling algorithms for grid computing: state of the art and open problems. Technical report, Queen's University School of Computing, January 2006.

Google Scholar

[2]

J. Ekanayake and G. Fox. High Performance Paralllel Computing with Clouds and Cloud technologies. Technical report, Indiana University, August 2009.

Google Scholar

[3]

I. Foster, Y. Zhao, I. Raicu, and S. Lu. Cloud Computing and Grid Computing 360-Degree Compared. In Grid Computing Environments Workshop, 2008. GCE '08, pages 1--10, 2008.

Crossref

Google Scholar

[4]

R. Iakymchuk, J. Napper, and P. Bientinesi. Underutilizing Resources for HPC on Clouds. 2010.

Google Scholar

[5]

M. H. Jamal et al. Virtual machine scalability on multi-core processors based servers for cloud computing workloads. In NAS '09: Proceedings of the 2009 IEEE International Conference on Networking, Architecture, and Storage, pages 90--97, Washington, DC, USA, 2009. IEEE Computer Society.

Digital Library

Google Scholar

[6]

N. E. Jerger, D. Vantrease, and M. Lipasti. An evaluation of server consolidation workloads for multi-core designs. In in IEEE Proceedings of Symposium on Workload Characterization, 2007.

Digital Library

Google Scholar

[7]

S. Jha, A. Merzky, and G. Fox. Using clouds to provide grids with higher levels of abstraction and explicit support for usage modes. Concurr. Comput.: Pract. Exper., 21(8):1087--1108, 2009.

Digital Library

Google Scholar

[8]

N. Kiyanclar, G. A. Koenig, and W. Yurcik. Maestro-VC: A Paravirtualized Execution Environment for Secure On-Demand Cluster Computing. In CCGRID '06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, pages 28+, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

Google Scholar

[9]

A. Luckow, L. Lacinski, and S. Jha. Saga bigjob: An extensible and interoperable pilot-job abstraction for distributed applications and systems. Cluster Computing and the Grid, IEEE International Symposium on, 0:135--144, 2010.

Digital Library

Google Scholar

[10]

M. R. Marty and M. D. Hill. Virtual hierarchies to support server consolidation. SIGARCH Comput. Archit. News, 35:46--56, June 2007.

Digital Library

Google Scholar

[11]

G. V. Mc Evoy, B. Schulze, and E. L. M. Garcia. Performance and deployment evaluation of a parallel application on a private Cloud. Concurrency and Computation: Practice and Experience, pages n/a--n/a, 2011.

Digital Library

Google Scholar

[12]

P. Mell and T. Grance. The NIST definition of Cloud Computing (v15). Technical report, National Institute of Standards and Technology, 2009.

Google Scholar

[13]

L. Ramakrishnan, P. T. Zbiegel, S. Campbell, R. Bradshaw, R. S. Canon, S. Coghlan, I. Sakrejda, N. Desai, T. Declerck, and A. Liu. Magellan: experiences from a science cloud. In Proceedings of the 2nd international workshop on Scientific cloud computing, ScienceCloud '11, pages 49--58, New York, NY, USA, 2011. ACM.

Digital Library

Google Scholar

[14]

B. Sotomayor, R. S. Montero, I. M. Llorente, and I. Foster. Capacity Leasing in Cloud Systems using the OpenNebula Engine. Cloud Computing and Applications 2008 (CCA08), 2008.

Google Scholar

Cited By

View all

Liu CLi KTang ZLi K(2018)Bargaining Game-Based Scheduling for Performance Guarantees in Cloud ComputingACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/31412333:1(1-25)Online publication date: 13-Feb-2018
https://dl.acm.org/doi/10.1145/3141233
Simão JVeiga LShin SMaldonado J(2013)A progress and profile-driven cloud-VM for resource-efficiency and fairness in e-science environmentsProceedings of the 28th Annual ACM Symposium on Applied Computing10.1145/2480362.2480436(357-362)Online publication date: 18-Mar-2013
https://dl.acm.org/doi/10.1145/2480362.2480436
Manfroi LFerro MYokoyama AMury ASchulze B(2013)A Walking Dwarf on the CloudsProceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing10.1109/UCC.2013.80(399-404)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/UCC.2013.80
Show More Cited By

Index Terms

Understanding scheduling implications for scientific applications in clouds
1. Information systems
  1. Information systems applications

Recommendations

Harnessing Cloud Technologies for a Virtualized Distributed Computing Infrastructure

The InterGrid system aims to provide an execution environment for running applications on top of interconnected infrastructures. The system uses virtual machines as building blocks to construct execution environments that span multiple computing sites. ...
Deadline distribution strategies for scientific workflow scheduling in commercial clouds
UCC '16: Proceedings of the 9th International Conference on Utility and Cloud Computing

Commercial clouds have become a viable platform for performing a significant range of large scale scientific analyses - due to the offerings of elasticity, specialist hardware, software infrastructure and pay-as-you-go cost model. Such clouds represent ...
Scheduler vulnerabilities and coordinated attacks in cloud computing

In hardware virtualization a hypervisor provides multiple Virtual Machines VMs on a single physical system, each executing a separate operating system instance. The hypervisor schedules execution of these VMs much as the scheduler in an operating system ...

Comments

Information & Contributors

Information

Published In

MGC '11: Proceedings of the 9th International Workshop on Middleware for Grids, Clouds and e-Science

December 2011

38 pages

ISBN:9781450310680

DOI:10.1145/2089002

Editors:
Bruno Schulze
National Lab for Scientific Computing (LNCC), Brazil
,
Omer Rana
Cardiff University, UK
,
Edmundo Madeira
State University of Campinas (UNICAMP), Brazil

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Middleware '11

Sponsor:

ACM
USENIX Assoc

Middleware '11: 12th International Middleware Conference

December 12 - 16, 2011

Lisbon, Portugal

Acceptance Rates

MGC '11 Paper Acceptance Rate 5 of 13 submissions, 38%;

Overall Acceptance Rate 14 of 36 submissions, 39%

Upcoming Conference

MIDDLEWARE '25

26th International Middleware Conference

December 15 - 19, 2025

Nashville , TN , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
448
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liu CLi KTang ZLi K(2018)Bargaining Game-Based Scheduling for Performance Guarantees in Cloud ComputingACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/31412333:1(1-25)Online publication date: 13-Feb-2018
https://dl.acm.org/doi/10.1145/3141233
Simão JVeiga LShin SMaldonado J(2013)A progress and profile-driven cloud-VM for resource-efficiency and fairness in e-science environmentsProceedings of the 28th Annual ACM Symposium on Applied Computing10.1145/2480362.2480436(357-362)Online publication date: 18-Mar-2013
https://dl.acm.org/doi/10.1145/2480362.2480436
Manfroi LFerro MYokoyama AMury ASchulze B(2013)A Walking Dwarf on the CloudsProceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing10.1109/UCC.2013.80(399-404)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/UCC.2013.80
Simão JRameshan NVeiga L(2013)Resource-Aware Scaling of Multi-threaded Java Applications in Multi-tenancy ScenariosProceedings of the 2013 IEEE International Conference on Cloud Computing Technology and Science - Volume 0110.1109/CloudCom.2013.65(445-451)Online publication date: 2-Dec-2013
https://dl.acm.org/doi/10.1109/CloudCom.2013.65
McEvoy GPorto FSchulze B(2012)A Representation Model for Virtual Machine AllocationProceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing10.1109/UCC.2012.51(271-278)Online publication date: 5-Nov-2012
https://dl.acm.org/doi/10.1109/UCC.2012.51

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Harnessing Cloud Technologies for a Virtualized Distributed Computing Infrastructure

Deadline distribution strategies for scientific workflow scheduling in commercial clouds

Scheduler vulnerabilities and coordinated attacks in cloud computing

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations