Abstract
Nowadays grid applications process large volumes of data. This creates the need for an effective data-management solutions. For the ClusteriX project the CDMS (ClusteriX Data Management System) is being developed. Analysis of user requirements and existing implementations of a Data Management System have been the foundations for its creation. Special attention has been paid to make the system user-friendly and efficient.
Taking into account grid specific networking conditions, for example different bandwidth, current load and network technologies, between geographically distant sites, CDMS tries to optimize data throughput via replication and replica selection techniques. Another key feature to be considered during grid service implementation is fault-tolerance. In the CDMS modular design and distributed operation model assures single point of failure elimination. In particular multiple instances of Data Broker are running simultaneously and their coherence is assured by a synchronization subsystem.
This work has been supported by the Polish Ministry of Science and Information Society Technologies under grant 6T11 2003C/06098 “ClusteriX - National Cluster of Linux Systems”.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allcock, B., et al.: Data Management and Transfer in High Performance Computational Grid Environments. Parallel Computing Journal 28,5 (2002) 749–771
Bruin, R.P., Dove, M.T., Calleja, M., Tucker. M.G.: Building and Managing the eMinerals Clusters: A Case Study in Grid-Enabled Cluster Operation. Computing in Science & Engineering 7,6 (2005) 30–37
ClusteriX Project Home Page, http://clusterix.pcz.pl
gSOAP Project Home Page, http://www.cs.fsu.edu/engelen/soap.html
GLOBUS Toolkit Homepage, http://www.globus.org/toolkit
GridSphere Project Home Page, http://gridsphere.org
http://www.man.poznan.pl/coe/documents/Data_Management_WP.pdf
Karczewski, K., Kuczynski, L., Wyrzykowski, R.: Secure Data Transfer and Replication Mechanisms in Grid Environments. Proc. Cracow Grid Workshop-CGW’03, Cracow, 2003, 190–196
Karczewski, K., Kuczynski, L., Wyrzykowski, R.: CDMS-ClusteriX Data Management System. Proc. Cracow Grid Workshop-CGW’04, Cracow, 2004, 241–247
Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Advanced Replica Management with Reptor. Lect. Notes in Comp. Sci. 3019 (2004) 848–855
SDSC Storage Resource Broker, http://www.sdsc.edu/srb/
Slota, R., Skital, L, Nikolow, D., Kitowski, J.: Algorithms for Automatic Data Replication in Grid Environment (this volume)
Valentin, O., Lombard, P., Lebre, A., Guinet, Ch., Denneulin, Y.: Distributed File System for Clusters and Grids. Lect. Notes in Comp. Sci. 3019 (2004) 1099–1104
Wyrzykowski, R., Meyer, N., Stroinski, M.: Concept and Implementation of ClusteriX: National Cluster of Linux Systems. Proc. LCI Int.Conf. on Linux Clusters: The HPC Revolution 2005, Chapel-Hill, NC, April 2005
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Science+Business Media, LLC
About this paper
Cite this paper
Karczewski, K., Kuczynski, L. (2007). Clusterix Data Management System (CDMS) — Architecture and use Cases. In: Talia, D., Bilas, A., Dikaiakos, M.D. (eds) Knowledge and Data Management in GRIDs. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-37831-2_7
Download citation
DOI: https://doi.org/10.1007/978-0-387-37831-2_7
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-37830-5
Online ISBN: 978-0-387-37831-2
eBook Packages: Computer ScienceComputer Science (R0)