Skip to main content
SpringerLink
Log in
Book cover

International Conference on Grid and Pervasive Computing

GPC 2007: Advances in Grid and Pervasive Computing pp 204–217Cite as

Development of a GT4-Based Resource Broker Service: An Application to On-demand Weather and Marine Forecasting

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4459))

Abstract

The discovery and selection of needed resources, taking into account optimization criteria, local policies, computing and storage availability, resource reservations, and grid dynamics, is a technological challenge in the emerging technology of grid computing.

The Condor Project’s ClassAd language is commonly adopted as a “lingua franca” for describing grid resources, but Condor itself does not make extensive use of Web Services. In contrast, the strongly service-oriented Globus Toolkit is implemented using the web services resource framework, and offers basic services for job submission, data replica and location, reliable file transfers and resource indexing, but does not provide a resource broker and matchmaking service.

In this paper we describe the development of a Resource Broker Service based on the Web Services technology offered by the Globus Toolkit version 4 (GT4). We implement a fully configurable and customizable matchmaking algorithm within a framework that allows users to direct complex queries to the GT4 index service and thus discover any published resource. The matchmaking algorithm supports both the native simple query form and the Condor ClassAd notation. We achieve this flexibility via a matchmaking API java class framework implemented on the extensible GT4 index service, which maps queries over ClassAds in a customizable fashion.

We show an example of the proposed grid application, namely an on demand weather and marine forecasting system. This system implements a Job Flow Scheduler and a Job Flow Description Language in order to access and exploit shared and distributed observations, model software, and 2D/3D graphical rendering resources. The system combines GT4 components and our Job Flow Scheduler and Resource Broker services to provide a fully grid-aware system.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Foster, I.: Globus Toolkit Version 4: Software for Service-Oriented Systems. Journal of Computational Science and Technology 21(4), 523–530 (2006)

    Google Scholar 

  2. Allcock, W., et al.: The Globus Striped GridFTP Framework and Server. In: SC05 (November 2005)

    Google Scholar 

  3. The PSU/NCAR mesoscale model (MM5), Pennsylvania State University / National Center for Atmospheric Research, http://www.mmm.ucar.edu/mm5/mm5-home.html

  4. Foster, I., Kesselman, C.: The Grid 2: Blueprint for a new Computing Infrastructure. Morgan Kaufmann, San Francisco (2003)

    Google Scholar 

  5. Liu, C., Foster, I.: A Constraint Language Approach to Matchmaking. In: Proceedings of the 14th International Workshop on Research Issues on Data Engineering (RIDE 2004), Boston (2004)

    Google Scholar 

  6. Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. High Performance Computing Applications 15(3), 200–222 (2001)

    Article  Google Scholar 

  7. Schopf, J.M., et al.: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of the Globus Toolkit’s MDS4. Argonne National Laboratory Tech Report ANL/MCS-P1248-0405 (April 2005)

    Google Scholar 

  8. Thain, D., Tannenbaum, T., Livny, M.: Distributed Computing in Practice: The Condor Experience. Concurrency and Computation: Practice and Experience 17(2-4), 323–356 (2005)

    Article  Google Scholar 

  9. Raman, R.: Matchmaking Frameworks for Distributed Resource Management. Ph.D. Dissertation (October 2000)

    Google Scholar 

  10. Raman, R., Livny, M., Solomon, M.: Matchmaking: Distributed Resource Management for High Throughput Computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing, Chicago, IL, July 28-31 (1998)

    Google Scholar 

  11. Ascione, I., et al.: A Grid Computing Based Virtual Laboratory for Environmental Simulations. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  12. Sotomayor, B., Childers, L.: Globus Toolkit 4: Programming Java Services. Morgan Kaufmann, San Francisco (2005)

    Google Scholar 

  13. Massie, M.L., Chunm, B.N., Culler, D.E.: The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing (2004)

    Google Scholar 

  14. Andreozzi, S., et al.: Glue schema specification version 1.3 draft 1, INFN (2006)

    Google Scholar 

  15. Raman, R., Livny, M., Solomon, M.: Policy Driven Heterogeneous Resource Co-Allocation with Gangmatching. In: Proceedings of the Twelfth IEEE International Symposium on High-Performance Distributed Computing, Seattle, WA (2003)

    Google Scholar 

  16. Andreozzi, S., et al.: GLUE Schema v1.2 Mapping to Old ClassAd Format, INFN (July 2006)

    Google Scholar 

  17. Deerwester, S., et al.: Indexing by latent semantic analysis. Journal of the Society for Information Science 41(6), 391–407 (1990)

    Article  Google Scholar 

  18. Drineas, P., et al.: Clustering Large Graphs via the Singular Value Decomposition. Machine Learning 56, 9–33 (2004)

    Article  MATH  Google Scholar 

  19. Dumais, S.T.: Using LSI for Information Retrieval, Information Filtering, and Other Things. In: Cognitive Technology Workshop, April 4-5 (1997)

    Google Scholar 

  20. Condor High Throughput Computing. Classified Advertisements. Univeristy of Wisconsin, http://www.cs.wisc.edu/condor/classad

  21. Giunta, G., et al.: pPOM: A nested, scalable, parallel and Fortran 90 implementation of the Princeton Ocean Model. Envirnonmental Modelling & Software 22, 117–122 (2007)

    Article  Google Scholar 

  22. Barone, G., et al.: An Operational Mesoscale Air Quality Model for the Campania Region. In: Proc. 3th GLOREAM Workshop, Annali Istituto Universitario Navale (special issue), June 2000, pp. 179–189 (2000)

    Google Scholar 

  23. Barone, G., et al.: Parallel software for air quality simulation in Naples area. J. Eviron. Manag. and Health 10, 209–215 (2000)

    Google Scholar 

  24. Giunta, G., Montella, R., Riccio, A.: Globus GT4 based Job Flow Scheduler and Resource Broker development for a grid computing based environmental simulations laboratory. Technical Report,2006 /07 Dept. of Applied Sciences, University of Naples ”Parthenope” (2006)

    Google Scholar 

  25. Resource Specification Language (RSL), Globus Alliance, http://www-unix.globus.org/developer/rsl-schema.html

  26. Giunta, G., et al.: Modeling and computational issues for air/water quality problems. A grid computing approach. Il Nuovo Cimento 28C(2) (2005)

    Google Scholar 

  27. Andrews, T., et al.: IBM, Business Process Execution Language for Web Services Version 1.1 (2003), http://www.oasis-open.org

  28. Active BPEL Engine Site, http://www.activebpel.org

Download references

Author information

Authors and Affiliations

  1. Dept. of Applied Science, University of Naples “Parthenope”, Italy

    R. Montella

Authors
  1. R. Montella
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Christophe Cérin Kuan-Ching Li

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Montella, R. (2007). Development of a GT4-Based Resource Broker Service: An Application to On-demand Weather and Marine Forecasting. In: Cérin, C., Li, KC. (eds) Advances in Grid and Pervasive Computing. GPC 2007. Lecture Notes in Computer Science, vol 4459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72360-8_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-72360-8_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-72359-2

  • Online ISBN: 978-3-540-72360-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation