Skip to main content

An Efficient Data Management System with High Scalability for ChinaGrid Support Platform

  • Conference paper
Advanced Parallel Processing Technologies (APPT 2005)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3756))

Included in the following conference series:

Abstract

There are a great number of data intensive applications in ChinaGrid. They require an efficient and high performance data management. The data management in ChinaGrid Support Platform (CGSP) supplies a data access mechanism with location transparency, name transparency, and protocol transparency as while as ensuring the transfer efficiency. The data management system consists of five parts: the storage data server based on Global Distributed Storage System to guarantee the reliability and performance of data transfer; the storage resource agent to discover, publish and catalog the storage resources; the data logical domain management to enable applications to select specific storage resources; the metadata management to publish, query and access metadata; and the uniform data access entry to organize grid users’ data space. We present the design philosophy of the efficient data management system with high scalability for CGSP and also give preliminary performance results.

This paper is supported by ChinaGrid project of Ministry of Education of China, National Science Foundation of China under grant 60125208 and 90412010, Hubei Science Foundation under grant 2004ABA053.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barish, B.C., Weiss, R.: LIGO and the Detection of Gravitational Waves. Physics Today 52, 44 (1999)

    Article  Google Scholar 

  2. Wulz, C.-E.: CMS – Concept and Physics Potential. In: Proceedings II-SILAFAE, San Juan, Puerto Rico (1998)

    Google Scholar 

  3. NVO, http://www.us-vo.org/

  4. Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications 15 (2001)

    Google Scholar 

  5. Jin, H.: ChinaGrid: Making Grid Computing a Reality. In: Chen, Z., Chen, H., Miao, Q., Fu, Y., Fox, E., Lim, E.-p. (eds.) ICADL 2004. LNCS, vol. 3334, pp. 13–24. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  6. Jin, H., Ran, L., Wang, Z., Huang, C., Chen, Y., Zhou, R., Jia, Y.: Architecture Design of Global Distributed Storage System for Data Grid. High Technology Letters 9(4), 1–4 (2003)

    Google Scholar 

  7. ChinaGrid, http://www.chinagrid.edu.cn

  8. ChinaGrid Support Platform, http://www.chinagrid.edu.cn/CGSP

  9. CGSP Work Group, Design Specification of ChinaGrid Support Platform. Tsinghua University Press, Beijing, China (2004)

    Google Scholar 

  10. Singh, G., Bharathi, S., Chervenak, A., Deelman, E., Kesselman, C., Mahohar, M., Pail, S., Pearlman, L.: A Metadata Catalog Service for Data Intensive Applications. In: Proceedings of Supercomputing (SC 2003) (November 2003)

    Google Scholar 

  11. The Web Services Resource Framework, http://www.globus.org/wsrf/

  12. Deelman, E., Singh, G., Atkinson, M.P., Chervenak, A., Hong, N.P.C., Kesselman, C., Patil, S., Pearlman, L., Su, M.: Grid-Based Metadata Services. In: Proceedings of 16th International Conference on Scientific and Statistical Database Management (SSDBM 2004), June 2004, p. 393 (2004)

    Google Scholar 

  13. Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Resource Broker. In: Proc. CASCON 1998 Conference (1998)

    Google Scholar 

  14. MCAT, MCAT – A Meta Information Catalog (Version 1.1), http://www.npaci.edu/DICE/SRB/mcat.html

  15. Globus Tookit, http://www.globus.org/toolkit/

  16. Globus Alliance, http://www.globus.org/alliance/

  17. Allcock, B., Bester, J., Bresnahan, J., Chervenak, A., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In: Proceedings of IEEE Mass Storage Conference (2001)

    Google Scholar 

  18. Allcock, W.E., Foster, I., Madduri, R.: Reliable Data Transport: A Critical Service for the Grid. In: Building Service Based Grids Workshop, Global Grid Forum 11 (June 2004)

    Google Scholar 

  19. Ripeanu, M., Foster, I.: A Decentralized, Adaptive, Replica Location Service. In: Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland, July 24-16 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jin, H., Gong, W., Wu, S., Xiong, M., Qi, L., Wang, C. (2005). An Efficient Data Management System with High Scalability for ChinaGrid Support Platform. In: Cao, J., Nejdl, W., Xu, M. (eds) Advanced Parallel Processing Technologies. APPT 2005. Lecture Notes in Computer Science, vol 3756. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573937_31

Download citation

  • DOI: https://doi.org/10.1007/11573937_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29639-3

  • Online ISBN: 978-3-540-32107-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics