Skip to main content

Advertisement

Log in

ZENTURIO: A Grid Service-Based Tool for Optimising Parallel and Grid Applications

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

ZENTURIO [R. Prodan and T. Fahringer, “ZENTURIO: A Grid Middleware-based Tool for Experiment Management of Parallel and Distributed Applications”, Journal of Parallel and Distributed Computing, 2003. http://authors.elsevier.com/sd/article/S0743731503001977 (to appear)] is a semi-automatic experiment management tool for performance and parameter studies of parallel and distributed applications on cluster and Grid architectures. ZENTURIO has been designed as an Open Grid Services Architecture (OGSA) – compliant Grid application built on top of standard Web and Grid services technologies. In this paper we first comparatively present various issues from our transition to an Open Grid Services Infrastructure (OGSI) – compliant prototype. Then we introduce a generic framework for solving NP-complete optimisation problems for parallel and Grid applications. We present a case study on high throughput scheduling for large sets of computational tasks on the Grid using genetic algorithms. Our algorithm has a complexity of \(\mathcal{O}(n^{2})\) and delivers a fivefold improvement in solution over 500 generations in a Grid with uniformly distributed computational resources.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. D. Abramson, R. Giddy and L. Kotler, “High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid?”, in Proceedings of the 14th International Conference on Parallel and Distributed Processing Symposium (IPDPS-00), Los Alamitos, 2000, pp. 520–528.

  2. D. Abramson, R. Sosic, R. Giddy and B. Hall, “Nimrod: A Tool for Performing Parameterised Simulations Using Distributed Workstations”, in Proceedings of the 4th IEEE Symposium on High Performance Distributed Computing (HPDC-95), Virginia, 1995, pp. 520–528.

  3. B. Allcock, J. Bester, J. Bresnahan, A.L. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel and S. Tuecke, “Data Management and Transfer in High-Performance Computational Grid Environments”, Parallel Computing, Vol. 28, No. 5, pp. 749–771, 2002.

    Google Scholar 

  4. K. Amin, M. Hategan, G. von Laszewski and N. Zaluzec, “Abstracting the Grid”, in 12th Euromicro Conference on Parallel Distributed and Network based Processing (PDP 2004), 2004.

  5. A. S. an Chee Shin Yeo and R. Buyya, “Visual Modeler for Grid Modelling and Simulation (GridSim) Toolkit”, in Innovative Grid Computing Workshop, Proceedings of the 3rd International Conference on Computational Science (ICCS 2003), Melbourne, Australia, 2003.

  6. S. Benkner, “VFC: The Vienna Fortran Compiler”, Scientific Programming, Vol. 7, No. 1, pp. 67–81, 1999.

    Google Scholar 

  7. D. Bunting, M. Chapman, O. Hurley, M. Little, J. Mischkinsky, E. Newcomer, J. Webber and K. Swenson, “Web Services Context (WS-Context)”, Specification, Arjuna Technologies Ltd., Fujitsu Limited, IONA Technologies Ltd., Oracle Corporation, and Sun Microsystems, Inc., 2003.

  8. F. Curbera, D. Ehnebuske and D. Rogers, “Using WSDL in a UDDI Registry 1.07”. UDDI best practice, UDDI Organisation, 2002. http://www.uddi.org/pubs/wsdlbestpractices-V1.07-Open-20020521.pdf

  9. K. Czajkowski, I. Foster, N. Karonis, S. Martin, W. Smith and S. Tuecke, “A Resource Management Architecture for Metacomputing Systems”, in D.G. Feitelson and L. Rudolph (eds), Job Scheduling Strategies for Parallel Processing, Springer Verlag, pp. 62–82, Lecture Notes in Comput. Sci., Vol. 1459, 1998.

  10. K. Czajkowski, I. Foster and C. Kesselman, “Co-allocation Services for Computational Grids”, in Proceedings of the 8th IEEE Symposium on High Performance Distributed Computing, 1999.

  11. J.J. Dongarra, H.W. Meuer and E. Strohmaier, “TOP500 Supercomputer Sites”, Supercomputer, Vol. 11, Nos. 2–3, pp. 133–163, 1995 (or 164–194??).

    Google Scholar 

  12. T. Fahringer, A. Jugravu, S. Pllana, R. Prodan, C. Seragiotto and H.-L. Truong, “ASKALON – A Programming Environment and Tool Set for Cluster and Grid Computing”, Institute for Software Science, University of Vienna. www.par.univie.ac.at/project/askalon

  13. I. Foster, J. Frey, S. Graham, S. Tuecke, K. Czajkowski, D. Ferguson, F. Leymann, M. Nally, T. Storey, W. Vambenepe and S. Weerawarana, “Modeling Stateful Resources with Web Services”, Specification, Globus Alliance, Argonne National Laboratory, IBM, USC ISI, Hewlett-Packard, 2004.

  14. I. Foster and C. Kesselman, “Globus: A Metacomputing Infrastructure Toolkit”, The International Journal of Supercomputer Applications and High Performance Computing, Vol. 11, No. 2, pp. 115–128, 1997.

    Google Scholar 

  15. I. Foster, C. Kesselman, J. Nick and S. Tuecke, “The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration”, The Globus Project and The Global Grid Forum, 2002. http://www.globus.org/research/papers/OGSA.pdf

  16. I. Foster, C. Kesselman, G. Tsudik and S. Tuecke, “A Security Architecture for Computational Grids”, in Proceedings of the 5th ACM Conference on Computer and Communications Security (CCS-98), New York, 1998, pp. 83–92.

  17. D.E. Goldberg, Genetic Algorithms in Search, Optimization 6 Machine Learning. Addison-Wesley: Reading, MA, 1989.

    Google Scholar 

  18. R. Herzog, “PostgreSQL – The Linux of Databases”, Linux Journal, Vol. 46, 1998.

  19. O.H. Ibarra and C.E. Kim, “Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors”, Journal of the ACM, Vol. 24, No. 2, pp. 280–289, 1977.

    Google Scholar 

  20. M.J. Litzkow, M. Livny and M.W. Mutka, “Condor: A Hunter of Idle Workstations”, in 8th International Conference on Distributed Computing Systems, Washington, DC, USA, 1988, pp. 104–111.

  21. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen and R.F. Freund, “Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems”, Journal of Parallel and Distributed Computing, Vol. 59, No. 2, pp. 107–131, 1999.

    Google Scholar 

  22. R. Prodan and T. Fahringer, “ZEN: A Directive-based Language for Automatic Experiment Management of Parallel and Distributed Programs”, in Proceedings of the 31st International Conference on Parallel Processing (ICPP 2002), 2002.

  23. R. Prodan and T. Fahringer, “ZENTURIO: A Grid Middleware-based Tool for Experiment Management of Parallel and Distributed Applications”, Journal of Parallel and Distributed Computing 2003 (to appear). http://authors.elsevier.com/sd/article/S0743731503001977

  24. R. Raman, M. Livny and M. Solomon, “Policy Driven Heterogeneous Resource Co-Allocation with Gangmatching”, in Proceedings of the 12th IEEE Symposium on High Performance Distributed Computing (HPDC12), 2003, pp. 80–89.

  25. H. Shan, L. Oliker and R. Biswas, “Job Superscheduler Architecture and Performance in Computational Grid Environments”, in SC2003: Igniting Innovation, ACM, Phoenix, AZ, November 15–21, 2003.

  26. Systinet, “Web Applications and Services Platform for Java”. http://www.systinet.com/doc/wasp_jserver/index0.html

  27. H.-L. Truong and T. Fahringer, “SCALEA: A Performance Analysis Tool for Parallel Programs”, Concurrency and Computation: Practice and Experience, Vol. 15, Nos. 11–12, pp. 1001–1025, 2003.

    Google Scholar 

  28. H.-L. Truong and T. Fahringer, “SCALEA-G: A Unified Monitoring and Performance Analysis System for the Grid”, in 2nd European Across Grid Conference (AxGrids 2004), Nicosia, Cyprus, 2004. To appear.

  29. S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham and C. Kesselman, “Grid Service Specification”, The Globus Project and The Global Grid Forum, 2002. http://www.globus.org/research/papers/gsspec.pdf

  30. F. Vraalsen, R.A. Aydt, C.L. Mendes and D.A. Reed, “Performance Contracts: Predicting and Monitoring Grid Application Behavior”, in Lecture Notes in Comput. Science, Vol. 2242, p. 154, 2001.

  31. M. Yarrow, K.M. McCann, R. Biswas and R.F.V. der Wijngaart, “ILab: An Advanced User Interface Approach for Complex Parameter Study Process Specification on the Information Power Grid”, in Proceedings of Grid 2000: International Workshop on Grid Computing, Bangalore, India, 2000.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Radu Prodan.

Additional information

This research is supported by the Austrian Science Fund as part of the Aurora project under contract SFBF1104.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Prodan, R., Fahringer, T. ZENTURIO: A Grid Service-Based Tool for Optimising Parallel and Grid Applications. J Grid Computing 2, 15–29 (2004). https://doi.org/10.1007/s10723-004-5850-x

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-004-5850-x

Keywords

Navigation