Abstract
Workflow applications are frequently used in many production Grids. There is a natural need to run the same workflow with many different parameter sets. Unfortunately current Grid portals either do not support this kind of applications or give only specialized support and hence users are obliged to do all the tedious work needed to manage such parameter study applications. P-GRADE portal has been providing a high-level, graphical workflow development and execution environment for various Grids (EGEE, UK NGS, GIN VO, OSG, TeraGrid, etc.) built on second and third generation Grid technologies (GT2, LCG-2, GT4, gLite). Feedback from the user communities of the portal showed that parameter study support is highly needed and hence the recent release of the portal supports the workflow-level parameter study applications. The current paper describes the semantics and implementation principles of managing and executing workflows as parameter studies. Two algorithms are described in detail. The black box algorithm optimizes the usage of storage resources while the PS-labeling algorithm minimizes the load of Grid processing resources. Special emphasis is on the concurrent management of large number of files and jobs in the portal and in the Grids as well as providing a user-friendly, easy-to-use graphical environment to define the workflows and monitor their parametric study execution.
The work reported in this paper is partly supported by the European Commission under contract numbers LSHC-CT-2006-037559 (FP6 STREP, CancerGrid, www.cancergrid.eu) and 031775 (FP6 SEE-GRID EU project, www.see-grid.eu).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Thain, D., Tannenbaum, T., Livny, M.: Condor and the Grid. In: Berman, F., Hey, A.J.G., Fox, G. (eds.) Grid Computing: Making The Global Infrastructure a Reality, pp. 299–336. John Wiley, Chichester (2003)
Casanova, H., Obertelli, G., Berman, F., Wolski, R.: The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid. In: Proceedings of the Super Computing (SC 2002) Conference, Dallas / USA (2002)
Yarrow, M., McCann, K., Biswas, R., van der Wijngaart, R.: An Advanced User Interface Approach for Complex Parameter Study Process Specification on the Information Power Grid. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, Springer, Heidelberg (2002)
McCann, K.M., Yarrow, M., deVivo, A., Mehrotra P.: ScyFlow: An Environment for the Visual Specification and Execution of Scientific Workflows. In: GGF10 Workshop on Workflow in Grid Systems, Berlin (2004)
Currle-Linde, N., Boes, F., Lindner, P., Pleiss, J., Resch, M.M.: A Management System for Complex Parameter Studies and Experiments in Grid Computing. In: Gonzales, T. (ed.) Proc. of the 16th IASTED Intl. Conf. on PDCS, Acta Press (2004)
Casanova, H., Berman, F.: Parameter Sweeps on the Grid with APST. In: Berman, F., Hey, A.J.G., Fox, G. (eds.) Grid Computing: Making The Global Infrastructure a Reality, pp. 773–788. John Wiley, Chichester (2003)
Kacsuk, P., Sipos, G.: Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal. Journal of Grid. Computing 3(3-4), 221–238 (2005)
Kacsuk, P., Kiss, T., Sipos, G.: Solving the Grid Interoperability Problem by P-GRADE Portal at Workflow Level. In: Proc. of the Grid-Enabling Legacy Applications and Supporting End User Workshop, in conjunction with HPDC’06, Paris, pp. 3–7 (2005)
Delaitre, T., et al.: GEMLCA: Running Legacy Code Applications as Grid Services. Journal of Grid. Computing 3(1-2), 75–90 (2005)
Kertesz, A., Kacsuk, P.: Grid Meta-Broker Architecture: Towards an Interoperable Grid Resource Brokering Service. In: CoreGRID Workshop on Grid Middleware in Conjunction with EuroPar’06, Dresden (2006)
Yu, J., Buyya, R.: Taxanomy of Workflow Management Systems for Grid Computing. Journal of Grid. Computing 3(3-4), 171–200 (2005)
Deelman, E., Taylor, I.: Special Issue on Scientific Workflows in Grid Environments. Journal of Grid. Computing 3(3-4), 151–304 (2005)
Erwin, D. (ed.): Joint Project Report for the BMBF Project UNICORE Plus Grant Number: 01 IR 001 A-D, Duration (January 2000 to December 2002) ISBN 3-00-011592-7
Abramson, D, Lewis, A., Peachy, T.: Nimrod/O: A Tool for Automatic Design Optimization. In: The 4th International Conference on Algorithms & Architectures for Parallel Processing (ICA3PP 2000), Hong Kong (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kacsuk, P., Farkas, Z., Hermann, G. (2007). Workflow-Level Parameter Study Support for Production Grids. In: Gervasi, O., Gavrilova, M.L. (eds) Computational Science and Its Applications – ICCSA 2007. ICCSA 2007. Lecture Notes in Computer Science, vol 4707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74484-9_74
Download citation
DOI: https://doi.org/10.1007/978-3-540-74484-9_74
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74482-5
Online ISBN: 978-3-540-74484-9
eBook Packages: Computer ScienceComputer Science (R0)