Abstract
It is a complex task to design and implement a workflow management system that supports scalable executions of large-scale scientific workflows for dynamic and heterogeneous Grid environments. In this paper we describe the Distributed workflow Enactment Engine (DEE) of the ASKALON Grid application development environment for Grid computing. DEE proposes a de-centralized architecture that simplifies and reduces the overhead for managing large workflows through partitioning, improved data locality, and reduced workflow-level checkpointing overhead. We report experimental results for a real-world material science workflow application.
This research is partially supported by the Austrian Science Fund as part of the Aurora project under contract SFBF1104 and the Austrian Federal Ministry for Education, Science and Culture as part of the Austrian Grid project under contract GZ 4003/2-VI/4c/2004.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Berman, F., et al.: The GrADS Project: Software support for high-level Grid application development. The International Journal of High Performance Computing Applications 15(4), 327–344 (2001)
Blaha, P., Schwarz, K., Madsen, G., Kvasnicka, D., Luitz, J.: WIEN2k: An Augmented Plane Wave plus Local Orbitals Program for Calculating Crystal Properties, Institute of Physical and Theoretical Chemistry, Vienna University of Technology (2001)
Cao, J., et al.: GridFlow: Workflow Management for Grid Computing. In: Proceedings of the 3rd International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 2003. IEEE Computer Sociery Press, Los Alamitos (2003)
The Austrian Grid Consortium, http://www.austriangrid.at
Deelman, E., et al.: Mapping abstract complex workflows onto grid environments. Journal of Grid Computing 1(1), 9–23 (2003)
Erwin, D.W., Snelling, D.F.: UNICORE: A grid computing environment. In: Sakellariou, R., Keane, J.A., Gurd, J.R., Freeman, L. (eds.) Euro-Par 2001. LNCS, vol. 2150, p. 825. Springer, Heidelberg (2001)
Fahringer, T.: ASKALON - A Programming Environment and Tool Set for Cluster and Grid Computing. Institute for Computer Science, University of Innsbruck, http://dps.uibk.ac.at/askalon
IT Innovation. Workflow enactment engine (October 2002), http://www.it-innovation.soton.ac.uk/mygrid/workflow/
The Condor Team. Dagman (directed acyclic graph manager), http://www.cs.wisc.edu/condor/dagman/
Qin, J., Fahringer, T., Hainzer, S.: Specification of Grid Workflow Applications with AGWL: An Abstract Grid Workflow Language. In: Proceedings of IEEE International Symposium on Cluster Computing and the Grid 2005 (CCGrid 2005), Cardiff, UK, May 2005, IEEE Computer Society Press, Los Alamitos (2005)
von Laszewski, G., et al.: GridAnt-Client-side Workflow Management with Ant. Whitepaper, Argonne National Laboratory, 9700 S. Cass Avenue, Argonne, IL 60439, U.S.A. (July 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Duan, R., Prodan, R., Fahringer, T. (2005). DEE: A Distributed Fault Tolerant Workflow Enactment Engine for Grid Computing. In: Yang, L.T., Rana, O.F., Di Martino, B., Dongarra, J. (eds) High Performance Computing and Communications. HPCC 2005. Lecture Notes in Computer Science, vol 3726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557654_81
Download citation
DOI: https://doi.org/10.1007/11557654_81
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29031-5
Online ISBN: 978-3-540-32079-1
eBook Packages: Computer ScienceComputer Science (R0)