We propose a multi-tiered architecture for middleware-independent Grid job management. The architecture consists of a number of services for well-defined tasks in the job management process, offering complete user-level isolation of service capabilities, multiple layers of abstraction, control, and fault tolerance. The middleware abstraction layer comprises components for targeted job submission, job control and resource discovery. The brokered job submission layer offers a Grid view on resources, including functionality for resource brokering and submission of jobs to selected resources. The reliable job submission layer includes components for fault tolerant execution of individual jobs and groups of independent jobs, respectively. The architecture is proposed as a composable set of tools rather than a monolithic solution, allowing users to select the individual components of interest. The prototype presented is implemented using the Globus Toolkit 4, integrated with the Globus Toolkit 4 and NorduGrid/ARC middlewares and based on existing and emerging Grid standards. A performance evaluation reveals that the overhead for resource discovery, brokering, middleware-specific format conversions, job monitoring, fault tolerance, and management of individual and groups of jobs is sufficiently small to motivate the use of the framework.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
G. Allen, K. Davis, K. N. Dolkas, N. D. Doulamis, T. Goodale, T. Kielmann, A. Merzky, J. Nabrzyski, J. Pukacki, T. Radke, M. Russell, E. Seidel, J. Shalf, and I. Taylor. Enabling
S. Andreozzi, S. Burke, L. Field, S. Fisher, B. K ónya, M. Mambelli, J. M. Schopf, M. Viljoen, and A. Wilson. Glue schema specification version 1.2 draft 7. http://glueschema.forge.cnaf.infn.it/uploads/Spec/GLUEInfoModel 1 2 final.pdf, March 2007.
A. Anjomshoaa, F. Brisard, M. Drescher, D. Fellows, A. Ly, A. S. McGough, D. Pulsipher, and A. Savva. Job Submission Description Language (JSDL) specification, version 1.0. http://www.ogf.org/documents/GFD.56.pdf, March 2007.
T. Delaittre, T. Kiss, A. Goyeneche, G. Terstyanszky, S.Winter, and P. Kacsuk. GEMLCA: Running legacy code applications as Grid services. Journal of Grid Computing, 3(1 - 2):75 - 90, June 2005. ISSN: 1570-7873.
E. Elmroth and P. Gardfj äll. Design and evaluation of a decentralized system for Gridwide fairshare scheduling. In H. Stockinger, R. Buyya, and R. Perrott, editors, e-Science 2005, First International Conference on e-Science and Grid Computing, pages 221-229. IEEE CS Press, 2005.
E. Elmroth and J. Tordsson. An interoperable, standards-based Grid resource broker and job submission service. In H. Stockinger, R. Buyya, and R. Perrott, editors, e-Science 2005, First International Conference on e-Science and Grid Computing, pages 212-220. IEEE CS Press, 2005.
E. Elmroth and J. Tordsson. A standards-based Grid resource brokering service supporting advance reservations, coallocation and cross-Grid interoperability. Submitted to Concurrency and Computation: Practice and Experience, December 2006.
E. Elmroth and J. Tordsson. Grid resource brokering algorithms enabling advance reservations and resource selection based on performance predictions. Future Generation Computer Systems. The International Journal of Grid Computing: Theory, Methods and Applications, 2007, to appear.
I. Foster, H. Kishimoto, A. Savva, D. Berry, A. Grimshaw, B. Horn, F. Maciel, F. Siebenlist, R. Subramaniam, J. Treadwell, and J. Von Reich. The Open Grid Services Architecture, version 1.5. http://www.ogf.org/documents/GFD.80.pdf, March 2007.
P. Gardfj äll, E. Elmroth, L. Johnsson, O. Mulmo, and T. Sandholm. Scalable Grid-wide capacity allocation with the SweGrid Accounting System (SGAS). Submitted to Concurrency and Computation: Practice and Experience, October 2006.
Globus. An “Ecosystem” of Grid Components. http://www.globus.org/grid software/ecology.php. March 2007.
Grid Infrastructure Research & Development (GIRD). http://www.gird.se. March 2007.
E. Huedo, R.S. Montero, and I.M. Llorente. A framework for adaptive execution on Grids. Software - Practice and Experience, 34(7):631-651, 2004.
P. Kacsuk, G. Dózsa, J. Kovács, R. Lovas, N. Podhorszki, Z. Balaton, and G. Gombás. P-GRADE: a Grid programming environment. Journal of Grid Computing, 1(2):171-197, 2003.
W. Lee, A. S. McGough, and J. Darlington. Performance evaluation of the GridSAM job submission and monitoring system. In UK e-Science All Hands Meeting, Nottingham, UK, 2005.
S. Venugopal, R. Buyya, and L. Winton. A Grid service broker for scheduling e-Science applications on global data Grids. Concurrency Computat. Pract. Exper., 18(6):685-699, May 2006.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Science+Business Media, LLC
About this paper
Cite this paper
Elmroth, E., Gardfjäll, P., Norberg, A., Tordsson, J., Östberg, PO. (2007). Grid infrastructure tools for multi-level job management. In: Priol, T., Vanneschi, M. (eds) Towards Next Generation Grids. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-72498-0_16
Download citation
DOI: https://doi.org/10.1007/978-0-387-72498-0_16
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-72497-3
Online ISBN: 978-0-387-72498-0
eBook Packages: Computer ScienceComputer Science (R0)