Skip to main content
SpringerLink
Log in

Design and Realization of the Cloud Data Backup System Based on HDFS

  • Conference paper
Emerging Research in Web Information Systems and Mining (WISM 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 238))

Included in the following conference series:

  • 934 Accesses

Abstract

Based on cloud storage software HDFS, this paper has designed a cloud data backup system. Clients are divided into several groups and served by different servers so as to build backup/restore load balance. When backup server upload data to HDFS cluster or download data from HDFS cluster, it takes restore priority, conflict detection upload’s strategies to reduce the network transmission pressure. To meet the feature that HDFS is suitable for large file’s storage, backup server has combined small files to upload by setting a threshold, thus enhancing system performance. The HDFS-based cloud backup system designed by this paper has certain advantages on the aspects of safety, extendibility, economic efficiency and reliability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Li, W.J., Li, L.X., Li, L.L.: etal: Design and Implementation of Backup System Based on P2P Network. Journal Of Information Engineering University, 351–355 (2010)

    Google Scholar 

  2. Wang, G.X., Shi, M.R.: Data storage backup and disaster recovery. Electronic Industry Press, Beijing (2009)

    Google Scholar 

  3. Storage Networking Industry Association and the Open Grid Forum, http://www.snia.org/cloud/CloudStorageForCloudComputing.pdf

  4. China, T.T.: http://www.cloudcomputing-china.cn/Article/luilan

  5. The Apache Software Foundation, http://hadoop.apache.org/index.pdf

  6. Cheng, K., Zheng, W.M.: Cloud computing: System instances and current research. Software Journal, 1337–1348 (2009)

    Google Scholar 

  7. Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The Hadoop Distributed File System. In: 26th IEEE Symposium on Massive Storage Systems and Technologies, pp. 1–10. IEEE Press, Chicago (2010)

    Google Scholar 

  8. Ghemawat, S., Gobioff, H., Leung, S.: The Google file system. In: 19th ACM Symposium on Operating Systems Principles, pp. 29–43. ACM Press, New York (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Jilin University, Qianjin Street 2699, Changchun, China

    Dong Guo, Yong Du, Qiang Li & Liang Hu

  2. Heilongjiang Technology and Business College, Harbin, 150080, China

    Yong Du

Authors
  1. Dong Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yong Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qiang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer and Information Science, University of Macau, Taipa, Macau, China

    Gong Zhiguo

  2. School of Computer, Shanghai University, 200444, Shanghai, China

    Xiangfeng Luo

  3. School of Computer and Software, Taiyuan University of Technology, 030024, Taiyuan, China

    Junjie Chen

  4. Caritas Institute of Higher Education, 18 Chui Ling Road, Tseung Kwan, Hong Kong SAR, China

    Fu Lee Wang

  5. School of Computer and Information Engineering, Shanghai University of Electric Power, 200090, Shanghai, China

    Jingsheng Lei

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Guo, D., Du, Y., Li, Q., Hu, L. (2011). Design and Realization of the Cloud Data Backup System Based on HDFS. In: Zhiguo, G., Luo, X., Chen, J., Wang, F.L., Lei, J. (eds) Emerging Research in Web Information Systems and Mining. WISM 2011. Communications in Computer and Information Science, vol 238. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24273-1_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24273-1_54

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24272-4

  • Online ISBN: 978-3-642-24273-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation