skip to main content
10.1145/1341811.1341845acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesmardi-grasConference Proceedingsconference-collections
poster

Shrimp farming on the grid

Published: 29 January 2008 Publication History

Abstract

The concept of task farming provides a mechanism to mange the execution of multiple instances of a serial application on distributed computing resources. These type of jobs fall into the category of "embarrassingly parallel" applications, for which it is clear how to partition them on parallel programming environments. Many important problem-classes, like Monte-Carlo simulations and parameter-space-surveys fall into this category. Although it is common practice on clusters systems using shared filesystems and local batch queue systems, task farming on distributed Grid resources is still far away from being ubiquitous due to the heterogeneous, potentially unreliable, and not very well predictable nature of the Grid. Additionally, the vast amount of different Grid middleware, transport protocols, and programming interfaces makes it exceptionally difficult to transparently run a task farming job on the Grid. Confronted with the task to run a large parameter survey for a serial application (the Shrimp Model) on different Grid resources, we evaluated different Grid task farming tools (Condor-G, Nimrod/G, ...) for the following requirements:
Grid-enabled: The application MUST be Grid-enabled, i.e. able to submit jobs to different Grid resource managers.
Portable: All components of the task farming application should run on as many hardware/OS platforms as possible.
Lightweight: The implementation should be as simple and lightweight as possible and shouldn't be bloated with unnecessary features.
Middleware independent: The application MUST not be bound to a single Grid middleware and should ideally be able to run without any Grid middleware as well.
User friendly: Both, describing a task farming job as well as submitting and monitoring a task farming job should be as intuitive as possible.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MG '08: Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
January 2008
178 pages
ISBN:9781595938350
DOI:10.1145/1341811
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • National e-Science Institute (Edinburgh, UK)
  • Louisiana State University (USA)

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2008

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Poster

Conference

Mardi Gras'08
Sponsor:
Mardi Gras'08: 15th Mardi Gras Conference on Distributed Applications
January 29 - February 3, 2008
Louisiana, Baton Rouge, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 117
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media