Skip to main content

Implementing Effective Data Management Policies in Distributed and Grid Computing Environments

  • Conference paper
Parallel Processing and Applied Mathematics (PPAM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4967))

  • 860 Accesses

Abstract

A common programming model in distributed and grid computing is the client/server paradigm, where the client submits requests to several geographically remote servers for executing already deployed applications on its own data. In this context it is mandatory to avoid unnecessary data transfer because the data set can be very large. This work addresses the problem of implementing a strategy for data management in case of data dependencies among subproblems in the same application. To this purpose, some minor changes have been introduced to the Distributed Storage Infrastructure in NetSolve distributed computing environment.

This work has been carried out as part of the project ”Sistema Cooperativo Distribuito ad Alte Prestazioni per elaborazioni Scientifiche Multidisciplinari (S.CO.P.E.)”, supported by the Italian Ministry of Education, University and Research (MIUR), PON 2000-2006.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arnold, D., Agrawal, S., Blackford, S., Dongarra, J., Miller, M., Seymour, K., Sagi, K., Shi, Z., Vadhiyar, S.: User’s Guide to NetSolve V. 2.0. Univ. of Tennessee, See also NetSolve home page (2004), http://icl.cs.utk.edu/netsolve/index.html

  2. Bassi, A., Beck, M., Moore, T., Plank, J.S., Swany, M., Wolski, R., Fagg, G.: The Internet Backplane Protocol:a study in Resource Sharing. Future Gener. Comput. Syst. 19, 551–561 (2003)

    Article  Google Scholar 

  3. Blackford, L., Choi, J., Cleary, A., D’Azevedo, E., Demmel, J., Dhillon, I., Dongarra, J., Hammarling, S., Henry, G., Petitet, A., Stanley, K., Walker, D., Whaley, R.: ScaLAPACK Users Guide. SIAM, Philadelphia (1997)

    Google Scholar 

  4. Czajkowsky, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., Tuecke, S.: A Resource Selection Management Architecture for Metacomputing Systems. In: Feitelson, D.G., Rudolph, L. (eds.) IPPS-WS 1998, SPDP-WS 1998, and JSSPP 1998. LNCS, vol. 1459, pp. 62–82. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  5. D’Amore, L., Laccetti, G., Lapegna, M.: Block matrix multiplication in a distributed computing environment: experiments with NetSolve. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds.) PPAM 2005. LNCS, vol. 3911, pp. 625–632. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  6. Dongarra, J.J., Du Croz, J., Hammarling, S., Hanson, R.J.: A Proposal for an Extended Set of Fortran Basic Linear Algebra Subprograms. ACM SIGNUM Newsletter 20, 2–18 (1985)

    Article  Google Scholar 

  7. Dongarra, J.J., Pineau, J.F., Robert, Y., Shi, Z., Vivien, F.: Revisiting Matrix Product on Master-Worker Platforms. In: APDCM workshop IPDPS 2007 Conference. A revised version is in International J. on Foundations of Computer Science (in press, 2007)

    Google Scholar 

  8. Foster, I.: What is the Grid? A three point checklist, http://www-fp.mcs.anl.gov/~foster/Article/WhatIsTheGrid.pdf

  9. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan and Kaufman, San Francisco (1998)

    Google Scholar 

  10. Petitet, F., Blackford, S., Dongarra, J., Ellis, B., Fagg, G., Roche, K., Vadhiyar, S.: Numerical Libraries and the Grid:The GrADS Experiment with ScaLAPACK. University of Tennessee Technical Report UT-CS-01-460 (2001)

    Google Scholar 

  11. Planck, J., Bassi, A., Beck, M., Moore, T., Swany, M., Wolsky, R.: Managing Data Storage in the Network. IEEE Internet Computing 5, 50–58 (2001)

    Article  Google Scholar 

  12. Ribler, R., Vetter, J., Simitci, H.: Reed: Autopilot:Adaptive Control of Distributed Applications. In: The 7th IEEE High Performance Distributed Computing Conference, pp. 172–179. IEEE Computer Society, Los Alamitos (1998)

    Google Scholar 

  13. Seti@home home page: http://setiathome.ssl.berkeley.edu/

  14. Vadhiar, S., Dongarra, J.: A Metascheduler for the Grid. In: The 11th IEEE High Performance Distributed Computing Conference, pp. 343–351. IEEE Computer Society, Los Alamitos (2002)

    Google Scholar 

  15. Vadhiar, S., Dongarra, J.: A performance oriented migration framework for the grid. In: CCGRID 2003 The 3rd International Symposium on Cluster Computing and the Grid, pp. 130–137. IEEE Computer Society, Los Alamitos (2003)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Roman Wyrzykowski Jack Dongarra Konrad Karczewski Jerzy Wasniewski

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Carracciuolo, L., Laccetti, G., Lapegna, M. (2008). Implementing Effective Data Management Policies in Distributed and Grid Computing Environments. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2007. Lecture Notes in Computer Science, vol 4967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68111-3_96

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-68111-3_96

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68105-2

  • Online ISBN: 978-3-540-68111-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics