Abstract
Grid computing has recently emerged as a response to the growing demand for resources (processing power, storage, etc.) exhibited by scientific applications. We address the challenge of sharing large amounts of data on such infrastructures, typically consisting of a federation of node clusters. We claim that storing, accessing, updating and sharing such data should be considered by applications as an external service. We propose an architecture for such a service, whose goal is to provide transparent access to mutable data, while enhancing data persistence and consistency despite node disconnections or failures. Our approach leverages on weaving together previous results in the areas of distributed shared memory systems, peer-to-peer systems, and fault-tolerant systems.
The GDS Project has been supported by the French ACI MD Fundamental Research Program on Data Masses, sponsored by the Ministry of Research, CNRS and INRIA. Project reference Web site: http://www.irisa.fr/GDS/.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
William Allcock, Joseph Bester, John Bresnahan, Ann Chervenak, Ian Foster, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, and Steven Tuecke. Data management and transfer in high-performance computational grid environments. Parallel Computing, 28(5):749–771, 2002.
Gabriel Antoniu, Luc Bougé, and Mathieu Jan. JuxMem: Weaving together the P2P and DSM paradigms to enable a Grid Data-sharing Service. Kluwer Journal of Super-computing, 2005. To appear. Preliminary electronic version available at URL http://www.inria.fr/rrrt/rr-5082.html.
Gabriel Antoniu, Jean-François Deverge, and Sébastien Monnet. Building fault-tolerant consistency protocols for an adaptive grid data-sharing service. In Proceedings of the ACM Workshop on Adaptive Grid Middleware (AGridM’ 04), Antibes Juan-les-Pins, France, September 2004. Held in conjunction with PACT 2004. To appear in Concurrency and Computation: Practice and Experience, special issue on Adaptive Grid Middleware.
Dorian Arnold, Sudesh Agrawal, Susan Blackford, Jack Dongarra, Micelle Miller, Kiran Sagi, Zhiao Shi, and Sthish Vadhiyar. Users’ guide to NetSolve V1.4. Technical Report CS-01-467, Computer Science Dept., Univ. Tennessee, Knoxville, TN, July 2001.
Alessandro Bassi, Micah Beck, Graham Fagg, Terry Moore, James Plank, Martin Swany, and Rich Wolski. The Internet Backplane Protocol: A study in resource sharing. In Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid’ 02), pages 194–201, Berlin, Germany, May 2002. IEEE.
Brian N. Bershad, Mattew J. Zekauskas, and Wayne A. Sawdon. The Midway distributed shared memory system. In Proceedings of the 38th IEEE International Computer Conference (COMPCON Spring’ 93), pages 528–537, Los Alamitos, CA, February 1993.
Marin Bertier, Olivier Marin, and Pierre Sens. Performance analysis of hierarchical failure detector. In Proceedings of the International Conference on Dependable Systems and Networks (DSN’ 03), pages 635–644. IEEE Society Press, June 2003.
Eddy Caron, Frédéric Desprez, Frédéric Lombard, Jean-Marc Nicod, Martin Quinson, and Frédéric Suter. A scalable approach to network enabled servers. In B. Monien and R. Feldmann, editors, 8th International Euro-Par Conference, volume 2400 of Lecture Notes in Computer Science, pages 907–910. Springer, August 2002.
Tushar Deepak Chandra and Sam Toueg. Unreliable failure detectors for reliable distributed systems. Journal of the ACM, 43(2):225–267, March 1996.
Gregory V. Chockler, Idit Keidar, and Roman Vitenberg. Group communication specifications: a comprehensive study. ACM Computing Surveys, 33(4):427–469, December 2001.
Olivier Coulaud, Michael Dussère, and Aurélien Esnard. Toward a computational steering environment based on CORBA. In G.R. Joubert, W.E. Nagel, F.J. Peters, and W.V. Walter, editors, Parallel Computing: Software Technology, Algorithms, Architectures and Applications, volume 13 of Advances in Parallel Computing, pages 151–158. Elsevier, 2004.
Michel Daydé, Luc Giraud, Montse Hernandez, Jean-Yves L’Excellent, Chiara Puglisi, and Marc Pantel. An overview of the GRID-TLSE project. In Poster Session of the 6th international meeting on high performance computing for computational science (VEC-PAR’ 04), pages 851–856, Valencia, Espagne, June 2004.
Alexandre Denis, Christian Pérez, and Thierry Priol. PadicoTM: An open integration framework for communication middleware and runtimes. Future Generation Computer Systems, 19(4):575–585, May 2003.
Frédéric Desprez, Martin Quinson, and Frédéric Suter. Dynamic performance forecasting for network enabled servers in a metacomputing environment. In Int. Conf. on Parallel and Distributed Processing Techniques and Applications (PDPTA’ 2001). CSREA Press, June 2001.
Bruno Del Fabbro, David Laiymani, Jean-Marc Nicod, and Laurent Philippe. Data management in grid applications providers. In Proceedings of the 1st IEEE Int. Conf. on Distributed Frameworks for Multimedia Applications (DFMA’ 05), February 2005. To appear.
Gilles Fedak, Cécile Germain, Vincent Neri, and Franck Cappello. XtremWeb: A generic global computing system. In Proceedings of the IEEE Workshop on Global Computing on Personal Devices (GCPD’ 01), pages 582–587, Brisbane, Australia, May 2001.
Ian Foster and Carl Kesselman. Globus: A metacomputing infrastructure toolkit. The Int. Journal of Supercomputing Applications and High-Performance Computing, 11(2): 115–128, 1997.
Liviu Iftode, Jaswinder Pal Singh, and Kai Li. Scope consistency: A bridge between release consistency and entry consistency. In Proceedings of the 8th ACM Annual Symposium on Parallel Algorithms and Architectures (SPAA’ 96), pages 277–287, Padova, Italy, June 1996.
Tevfik Kosar and Miron Livny. Stork: Making data placement a first-class citizen in the grid. In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS’ 04), pages 342–349, Tokyo, Japan, March 2004.
Kai Li and Paul Hudak. Memory coherence in shared virtual memory systems. ACM Transactions on Computer Systems, 7(4):321–359, November 1989.
R.W. Moore, A. Rajasekar, and M. Wan. Data grids, digital libraries, and persistent archives: an integrated approach to sharing, publishing, and archiving data. Proceedings of the IEEE, 93(3):578–588, March 2005.
Hidemoto Nakada, Mitsuhisa Sato, and Satoshi Sekiguchi. Design and implementations of Ninf: towards a global computing infrastructure. Future Generation Computing Systems, Metacomputing Issue, 15(5–6):649–658, 1999.
Jelica Protić, Milo Tomasević, and Veljko Milutinović. Distributed Shared Memory: Concepts and Systems. IEEE, August 1997.
Keith Seymour, Craig Lee, Frédéric Desprez, Hidemoto Nakada, and Yoshio Tanaka. The end-user and middleware APIs for GridRPC. In Proc. of the Work. on Grid App. Progr. Interfaces (GAPI’ 04), September 2004. Held in conjunction with GGF 12.
Keith Seymour, Hidemoto Nakada, Satoshi Matsuoka, Jack Dongarra, Craig Lee, and Henri Casanova. Overview of GridRPC: A remote procedure call API for grid computing. In Manish Parashar, editor, Proceedings of the 3rd International Workshop on Grid Computing (GRID’ 02), volume 2536 of Lecture Notes in Computer Science, pages 274–278, Baltimore, MD, USA, November 2002. Springer.
Yuanyuan Zhou, Liviu Iftode, and Kai Li. Performance evaluation of two home-based lazy release consistency protocols for shared memory virtual memory systems. In Proceedings of the 2nd Symposium on Operating Systems Design and Implementation (OSDI’ 96), pages 75–88, Seattle, WA, October 1996.
The JXTA project. http://www.jxta.org/, 2001.
The GDS project: a grid data service. http://www.irisa.fr/GDS/.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Science+Business Media, Inc.
About this chapter
Cite this chapter
Antoniu, G. et al. (2006). GDS: An Architecture Proposal for a Grid Data-Sharing Service. In: Getov, V., Laforenza, D., Reinefeld, A. (eds) Future Generation Grids. Springer, Boston, MA . https://doi.org/10.1007/978-0-387-29445-2_8
Download citation
DOI: https://doi.org/10.1007/978-0-387-29445-2_8
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-27935-0
Online ISBN: 978-0-387-29445-2
eBook Packages: Computer ScienceComputer Science (R0)