Abstract
In this paper we describe the Pegasus system that can map complex workflows onto the Grid. Pegasus takes an abstract description of a workflow and finds the appropriate data and Grid resources to execute the workflow. Pegasus is being released as part of the GriPhyN Virtual Data Toolkit and has been used in a variety of applications ranging from astronomy, biology, gravitational-wave science, and high-energy physics. A deferred planning mode of Pegasus is also introduced.
This research was supported in part by the National Science Foundation under grants ITR-0086044(GriPhyN) and EAR-0122464 (SCEC/ITR).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abramovici, A., et al.: LIGO: The Laser Interferometer Gravitational-Wave Observatory (in Large Scale Measurements). Science 256(5055) (1992)
Akarsu, E., et al.: Webflow - high-level programming environment and visual authoring toolkit for high performance distributed computing. In: Sc 1998 (1998)
Allcock, B., et al.: Data management and transfer in high performance computational grid environments. Parallel Computing Journal 28(5), 749–771 (2002a)
Annis, J., and others: Applying Chimera Virtual Data Concepts to Cluster Finding in the Sloan Sky Survey. In: Supercomputing 2002, Baltimore, MD (2002)
Berriman, B., et al.: Montage: A grid-enabled image mosaic service for the nvo. In: Astronomical Data Analysis Software & Systems (ADASS) XIII (October 2003)
Buyya, R., et al.: Nimrod/G: An Architecture for a Resource Management and Scheduling System in a Global Computational Grid. In: HPC, Asia (2000)
Cao, J., et al.: Gridflow: Workflow management for grid computing. In: 3rd Int. Symposium on Cluster Computing and the Grid, pp. 198–205 (2003)
Chervenak, A., et al.: Giggle: A framework for constructing scalable replica location services. In: Proceedings of Supercomputing 2002 (SC 2002) (November 2002)
Czajkowski, K., et al.: A resource management architecture for metacom-puting systems. In: Workshop on Job Scheduling Strategies for Parallel Processing (1998)
Czajkowski, K., et al.: Grid information services for distributed resource sharing. In: HPDC (2001)
Deelman, E., et al.: Transformation catalog design for griphyn, prototype of transformation catalog schema. Technical Report 2001-17, GRIPHYN (2001)
Deelman, E., et al.: Grid-based galaxy morphology analysis for the national virtual observatory. In: SC 2003 (2003)
Deelman, E., et al.: Workflow Management in GriPhy. In: Kluwer, N., Jabrzyski, J., Schopf, J., Weglarz, J. (eds.) The Grid Resource Management (2003)
Deelman, E., et al.: Mapping abstract complex workflows onto grid environments. Journal of Grid Computing 1 (2003)
Foster, I., et al.: Chimera: A Virtual Data System for Representing, Querying, and Automating Data Derivation. In: SSDBM (2002)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. Journal of High Performance Computing Applications 15(3), 200–222 (2001), http://www.globus.org/-research/papers/anatomy.pdf
Frey, J., et al.: Condor-G: A Computation Managament Agent for Multi-Institutional Grids. In: Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing, HPDC10 (2001)
Condor Team. The directed acyclic graph manager (2002), http://www.cs.wisc.edu/condor/dagman
von Laszewski, G., et al.: Gridant-client-side management with ant. Whitepaper (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Deelman, E. et al. (2004). Pegasus: Mapping Scientific Workflows onto the Grid. In: Dikaiakos, M.D. (eds) Grid Computing. AxGrids 2004. Lecture Notes in Computer Science, vol 3165. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28642-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-28642-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22888-2
Online ISBN: 978-3-540-28642-4
eBook Packages: Springer Book Archive