Abstract
Grid applications deal with large volumes of data. As a consequence, effective data management solutions are vital for grids. The Clusterix Data Management System (CDMS) has been developed after a careful analysis of end-user requirements and existing implementations. A special attention has been paid to making the system user-friendly and efficient, aiming at the creation of a reliable and secure Data Storage System. For example, taking into account network parameters, CDMS tries to optimize data throughput via replication and replica selection techniques. Another key feature considered during the development is fault tolerance. In CDMS the distributed operation model and modular design assure elimination of single point of failure. In particular, multiple instances of the data broker are running concurrently, and their coherence is ascertained by the synchronization subsystem. This paper presents the concept and details of implementation of data management mechanisms adopted in CDMS, as well as its integration with applications.
This work has been supported by the Polish Ministry of Science and Information Society Technologies under grant 6T11 2003C/06098 “ClusteriX – National Cluster of Linux Systems”.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Allcock, B., et al.: Data Management and Transfer in High Performance Computational Grid Environments. Parallel Computing Journal 28(5), 749–771 (2002)
Bruin, R.P., Dove, M.T., Calleja, M., Tucker, M.G.: Building and Managing the eMinerals Clusters: A Case Study in Grid-Enabled Cluster Operation. Computing in Science & Engineering 7(6), 30–37 (2005)
ClusteriX Project Home Page, http://clusterix.pcz.pl
GLOBUS Toolkit Homepage, http://www.globus.org/toolkit
GridSphere Project Home Page, http://gridsphere.org
gSOAP Project Home Page, http://www.cs.fsu.edu/~engelen/soap.html
Karczewski, K., Kuczynski, L., Wyrzykowski, R.: Secure Data Transfer and Replication Mechanisms in Grid Environments. In: Proc. Cracow Grid Workshop - CGW 2003, Cracow, pp. 190–196 (2003)
Karczewski, K., Kuczynski, L., Wyrzykowski, R.: CDMS - ClusteriX Data Management System. In: Proc. Cracow Grid Workshop - CGW 2004, Cracow, pp. 241–247 (2004)
Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Advanced Replica Management with Reptor. In: Wyrzykowski, R., Dongarra, J., Paprzycki, M., Waśniewski, J. (eds.) PPAM 2004. LNCS, vol. 3019, pp. 848–855. Springer, Heidelberg (2004)
SDSC Storage Resource Broker, http://www.sdsc.edu/srb/
Slota, R., Skital, L., Nikolow, D., Kitowski, J.: Algorithms for Automatic Data Replication in Grid Environment (this volume)
Valentin, O., Lombard, P., Lebre, A., Guinet, C., Denneulin, Y.: Distributed File System for Clusters and Grids. In: Wyrzykowski, R., Dongarra, J., Paprzycki, M., Waśniewski, J. (eds.) PPAM 2004. LNCS, vol. 3019, pp. 1099–1104. Springer, Heidelberg (2004)
Wyrzykowski, R., Meyer, N., Stroinski, M.: Concept and Implementation of ClusteriX: National Cluster of Linux Systems. In: Proc. LCI Int.Conf. on Linux Clusters: The HPC Revolution 2005, Chapel-Hill, NC (April 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kuczynski, L., Karczewski, K., Wyrzykowski, R. (2006). ClusteriX Data Management System and Its Integration with Applications. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2005. Lecture Notes in Computer Science, vol 3911. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11752578_30
Download citation
DOI: https://doi.org/10.1007/11752578_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34141-3
Online ISBN: 978-3-540-34142-0
eBook Packages: Computer ScienceComputer Science (R0)