Skip to main content
Springer Nature Link
Log in

GFS: A Distributed File System with Multi-source Data Access and Replication for Grid Computing

  • Conference paper
Advances in Grid and Pervasive Computing (GPC 2009)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5529))

Included in the following conference series:

  • 632 Accesses

Abstract

In this paper, we design and implement a distributed file system with multi-source data replication ability, called Grid File System (GFS), for Unix-based grid systems. Traditional distributed file system technologies designed for local and campus area networks do not adapt well to wide area grid computing environments. Therefore, we design GFS file system that meets the needs of grid computing. With GFS, existing applications are able to access remote files without any modification, and jobs submitted in grid systems can access data transparently with GFS. GFS can be easily deployed and can be easily accessed without special accounts. Our system also provides strong security mechanisms and a multi-source data transfer method to increase communication throughput.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Taiwan unigrid project, http://www.unigrid.org.tw

  2. Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R., West, M.: Scale and performance in a distributed file system. ACM Transactions on Computer Systems (TOCS) 6(1), 51–81 (1988)

    Article  Google Scholar 

  3. Globus toolkit, http://www.globus.org

  4. Allcock, W., Foster, I., Tuecke, S., Chervenak, A., Kesselman, C.: Protocols and services for distributed data-intensive science. Advanced computing and analysis techniques in physics research 583, 161–163 (2001)

    Google Scholar 

  5. Autodock docking tools, http://autodock.scripps.edu/

  6. Sqlite, http://www.sqlite.org/

  7. Filesystem in userspace–fuse, http://fuse.sourceforge.net/

  8. Ho, L.-Y., Liu, P., Wang, C.-M., Wu, J.-J.: The development of a drug discovery virtual screening application on taiwan unigrid. In: The 4th Workshop on Grid Technologies and Application (WoGTA 2007), Providence University, Taichung,Taiwan (2007)

    Google Scholar 

  9. Russell, R., Haire, L., Stevens, D., Collins, P., Lin, Y., Blackburn, G., Hay, A., Gamblin, S., Skehel, J.: Structural biology: antiviral drugs fit for a purpose. Nature 443, 37–38 (2006)

    Article  Google Scholar 

  10. Xtreemfs, http://www.xtreemfs.org

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan

    Chun-Ting Chen, Chun-Chen Hsu & Pangfeng Liu

  2. Institute of Information Science, Academia Sinica, Taipei, Taiwan

    Chun-Chen Hsu & Jan-Jan Wu

  3. Graduated Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan

    Pangfeng Liu

Authors
  1. Chun-Ting Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun-Chen Hsu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan-Jan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pangfeng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Applied Sicences, Western Switzerland (HES-SO), Rue Prairie 4, 1202, Geneva, Switzerland

    Nabil Abdennadher

  2. Computer Science Department, West University of Timisoara, Timisoara, Romania

    Dana Petcu

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chen, CT., Hsu, CC., Wu, JJ., Liu, P. (2009). GFS: A Distributed File System with Multi-source Data Access and Replication for Grid Computing. In: Abdennadher, N., Petcu, D. (eds) Advances in Grid and Pervasive Computing. GPC 2009. Lecture Notes in Computer Science, vol 5529. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01671-4_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01671-4_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01670-7

  • Online ISBN: 978-3-642-01671-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics