Abstract
Grid systems offer high computing capabilities that are used in many scientific research fields and thus many applications are submitted to these powerful systems. Parallel applications and applications consisting of inter-dependent jobs may especially be characterized by a complex workflow. Therefore, Grid systems should be capable of executing and controlling workflow computations. This document sets out our approach to workflow management in a Grid environment. It introduces common steps on how to map an application workflow to the DAG structure, and how to carry out its execution and control. We present the Workflow Management Service (WFMS) implemented and integrated as a part of the CrossGrid project. The purpose of this service is to schedule workflow computations according to user-defined requirements, also providing a set of mechanisms to deal with failures in Grid.
This work has been partially supported by the European Union through the IST-2001-32243 project “CrossGrid” and partially supported by the Comisión Interministerial de Ciencia y Tecnologí a (CICYT) under contract TIC2001-2592.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Foster, I., Kesselman, C. (eds.): The GRID Blueprint for a New Computing Infrastructure. Morgan Kauffmann Publishers, San Francisco (1999)
GriPhyN: The Grid Physics Network, http://www.griphyn.org
The DataGrid Project, http://www.eu-datagrid.org
GridLab: A Grid Application Toolkit and Testbed, http://www.gridlab.org
The EU-Crossgrid project, http://www.eu-crossgrid.org
Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22(6), 789–828 (1996)
Karonis, N., Toonen, B., Foster, I.: MPICH-G2: A Gridenabled implementation of the message passing interface. Journal of Parallel and Distributed Computing (2003) (to appear)
Heymann, E., Senar, M.A., Fernandez, A., Salt, J.: The Eu-Crossgrid approach for Grid Application Scheduling. In: Fernández Rivera, F., Bubak, M., Gómez Tato, A., Doallo, R. (eds.) Across Grids 2003. LNCS, vol. 2970, pp. 17–24. Springer, Heidelberg (2004)
Barish, B., Weiss, R.: Ligo and detection of gravitational waves. Physics Today 52(10) (1999)
Hastings, S., Kurc, T., Langella, S., Catalyurek, U., Pan, T., Saltz, J.: Image processing on the Grid: a toolkit or building grid-enabled image processing applications. In: 3rd International Symposium on Cluster Computing and the Grid (2003)
Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Su, M.H., Vahi, K., Livny, M.: Pegasus: Mapping Scientific Workflows onto the Grid. In: Across Grids Conference, Nicosia, Cyprus (2004)
Shields, M.: Programming Scientific and Distributed Workflow with Triana Services. In: GGF10 Workflow Workshop, Berlin (March 2004)
UNICORE Plus - Final Report (2003), http://www.unicore.org
Cao, J., Jarvis, S.A., Saini, S., Nudd, G.R.: GridFlow: Workflow Management for Grid Computing. In: 3rd International Symposium on CCGrid, Japan (May 2003)
Pazini, F.: JDL Attributes - DataGrid-01-NOT-0101-0_4.pdf (December 2001), http://www.infn.it/workload-grid/docs/DataGrid-01-NOT-0101-0_4-Note.pdf
Frey, J., Tannenbaum, T., Foster, I., Livny, M., Tuecke, S.: Condor-G: A Computation Management Agent for Multi-Institutional Grids. Journal of Cluster Computing 5, 237–246 (2002)
Data grid: Definition of the architecture, technical plan and evaluation criteria for the resource coallocation framework and mechanisms for parallel job partitioning. WP1: Workload Management. DataGrid-01-D1.4-0127-1_0. Deliverable DataGrid-D1.4 (2002)
Guy, L., Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Replica Management in Data Grids. Technical report, GGF5 Working Draft (July 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Morajko, A., Fernández, E., Fernández, A., Heymann, E., Senar, M.Á. (2005). Workflow Management in the CrossGrid Project. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds) Advances in Grid Computing - EGC 2005. EGC 2005. Lecture Notes in Computer Science, vol 3470. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508380_44
Download citation
DOI: https://doi.org/10.1007/11508380_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26918-2
Online ISBN: 978-3-540-32036-4
eBook Packages: Computer ScienceComputer Science (R0)