Skip to main content
SpringerLink
Log in

A Distributed Storage System Based on Blockchain and Pipelined Code

  • Conference paper
  • First Online:
Smart City and Informatization (iSCI 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1122))

Included in the following conference series:

  • 1410 Accesses

Abstract

To achieve data reliability and security in distributed storage systems, different coding schemes have been proposed. Encoded data would be stored in different nodes which are called hosts. However, the knowledge of hosts is learned by each other, and all of it must be known by the central server that stores meta-data, so that users and hosts cannot keep anonymity which reduces the difficulty of eavesdropping attack. The central server is a bottleneck due to single point of failure or low performance. These problems reduce the stability and the security of the storage system. To address these problems, we proposed a decentralized secure distributed storage system based on pipelined code and blockchain. In our scheme, we use blockchain to realize decentralization to solve the single point of failure problem and anonymity to data breach. An explicit pipelined code process combined with blockchain is presented to construct the storage function basis. Furthermore, a time-based replica storage mechanism is used in our scheme to achieve better trade-off between storage overhead and decode computation overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. You, P., Huang, Z., Peng, Y., et al.: Towards a delivery scheme for speedup of data backup in distributed storage systems using erasure codes. J. Supercomput. 75(1), 50–64 (2019)

    Article  Google Scholar 

  2. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: Proceedings of the ACM Symposium on Operating Systems Principles (SOSP) (2003)

    Google Scholar 

  3. Li, J., Li, B., Li, B.: Mist: efficient dissemination of erasure-coded data in data centers. IEEE Trans. Emerg. Top. Comput. 7, 468–480 (2018)

    Article  Google Scholar 

  4. Hou, H., Shum, K.W., Chen, M., et al.: BASIC codes: low-complexity regenerating codes for distributed storage systems. IEEE Trans. Inf. Theory 62(6), 3053–3069 (2016)

    Article  MathSciNet  Google Scholar 

  5. Rawat, A.S., Koyluoglu, O.O., Silberstein, N., et al.: Optimal locally repairable and secure codes for distributed storage systems. IEEE Trans. Inf. Theory 60(1), 212–236 (2013)

    Article  Google Scholar 

  6. Koyluoglu, O.O., Rawat, A.S., Vishwanath, S.: Secure cooperative regenerating codes for distributed storage systems. IEEE Trans. Inf. Theory 60(9), 5228–5244 (2014)

    Article  MathSciNet  Google Scholar 

  7. Shah, N.B., Rashmi, K.V., Kumar, P.V.: Information-theoretically secure regenerating codes for distributed storage. In: 2011 IEEE Global Telecommunications Conference-GLOBECOM 2011, pp. 1–5. IEEE (2011)

    Google Scholar 

  8. Pawar, S., El Rouayheb, S., Ramchandran, K.: Securing dynamic distributed storage systems against eavesdropping and adversarial attacks. IEEE Trans. Inf. Theory 57(10), 6734–6753 (2011)

    Article  MathSciNet  Google Scholar 

  9. Tandon, R., Amuru, S.D., Clancy, T.C., et al.: On secure distributed storage systems with exact repair. In: 2014 IEEE International Conference on Communications (ICC), pp. 3908–3912. IEEE (2014)

    Google Scholar 

  10. Tandon, R., Amuru, S.D., Clancy, T.C., et al.: Distributed storage systems with secure and exact repair—new results. In: 2014 Information Theory and Applications Workshop (ITA), pp. 1–6. IEEE (2014)

    Google Scholar 

  11. Tandon, R., Amuru, S.D., Clancy, T.C., et al.: Toward optimal secure distributed storage systems with exact repair. IEEE Trans. Inf. Theory 62(6), 3477–3492 (2016)

    Article  MathSciNet  Google Scholar 

  12. Lin, H.Y., Tzeng, W.G.: A secure decentralized erasure code for distributed networked storage. IEEE Trans. Parallel Distrib. Syst. 21(11), 1586–1594 (2010)

    Article  Google Scholar 

  13. Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. ACM SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)

    Article  Google Scholar 

  14. Pamies-Juarez, L., Oggier, F., Datta, A.: Decentralized erasure coding for efficient data archival in distributed storage systems. In: Frey, D., Raynal, M., Sarkar, S., Shyamasundar, Rudrapatna K., Sinha, P. (eds.) ICDCN 2013. LNCS, vol. 7730, pp. 42–56. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-35668-1_4

    Chapter  Google Scholar 

  15. Crosby, M., Pattanayak, P., Verma, S., et al.: Blockchain technology: beyond bitcoin. Appl. Innov. 2(6–10), 71 (2016)

    Google Scholar 

  16. Wilkinson, S., Lowry, J., Boshevski, T.: Metadisk a blockchain-based decentralized file storage application. Technical report, hal, pp. 1–11, Storj Labs Inc. (2014)

    Google Scholar 

  17. Ali, M., Nelson, J., Shea, R., et al.: Blockstack: a global naming and storage system secured by blockchains. In: 2016 USENIX Annual Technical Conference (USENIX ATC 2016), pp. 181–194 (2016)

    Google Scholar 

  18. Fukumitsu, M., Hasegawa, S., Iwazaki, J., et al.: A proposal of a secure P2P-type storage scheme by using the secret sharing and the blockchain. In: 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), pp. 803–810. IEEE (2017)

    Google Scholar 

  19. Chen, Y., Li, H., Li, K., et al.: An improved P2P file system scheme based on IPFS and Blockchain. In: 2017 IEEE International Conference on Big Data (Big Data), pp. 2652–2657. IEEE (2017)

    Google Scholar 

  20. Pamies-Juarez, L., Datta, A., Oggier, F.: RapidRAID: pipelined erasure codes for fast data archival in distributed storage systems. In: 2013 Proceedings IEEE INFOCOM, pp. 1294–1302. IEEE (2013)

    Google Scholar 

  21. Li, C., Li, P., Xu, W., et al.: Scaling Nakamoto consensus to thousands of transactions per second. arXiv preprint arXiv:1805.03870 (2018)

  22. Aniello, L., Baldoni, R., Gaetani, E., et al.: A prototype evaluation of a tamper-resistant high performance blockchain-based transaction log for a distributed database. In: 2017 13th European Dependable Computing Conference (EDCC), pp. 151–154. IEEE (2017)

    Google Scholar 

  23. Shen, J., Gu, J., Zhou, Y., et al.: Bandwidth-aware delayed repair in distributed storage systems. In: 2016 IEEE/ACM 24th International Symposium on Quality of Service (IWQoS), pp. 1–10. IEEE (2016)

    Google Scholar 

  24. Chen, F., Xiang, T., Yang, Y., et al.: Secure cloud storage meets with secure network coding. IEEE Trans. Comput. 65(6), 1936–1948 (2015)

    Article  MathSciNet  Google Scholar 

  25. Amazon.com, “Amazon S3”. http://aws.amazon.com/s3

  26. Apache.org, “HDFS”. http://hadoop.apache.org/hdfs

  27. Nakamoto, S.: Bitcoin: a peer-to-peer electronic cash system (2008). https://bitcoin.org/bitcoin.pdf

Download references

Acknowledgements

This work is supported by the Key Technologies R & D Program of Henan Province (172102210017).

Author information

Authors and Affiliations

  1. PLA Information Engineering University, Zhengzhou, 450001, China

    Xuewei Li, Yue Chen, Yang Ba & Shuai Li

  2. 95937 Unit of PLA, Fuxin, 123004, Liaoning, China

    Huaiyu Zhu

Authors
  1. Xuewei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yue Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Ba
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shuai Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Huaiyu Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xuewei Li .

Editor information

Editors and Affiliations

  1. Guangzhou University, Guangzhou, China

    Guojun Wang

  2. University of Ottawa, Ottawa, ON, Canada

    Abdulmotaleb El Saddik

  3. Shanghai Jiao Tong University, Shanghai, China

    Xuejia Lai

  4. University of Murcia, Murcia, Spain

    Gregorio Martinez Perez

  5. The University of Texas at San Antonio, San Antonio, TX, USA

    Kim-Kwang Raymond Choo

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, X., Chen, Y., Ba, Y., Li, S., Zhu, H. (2019). A Distributed Storage System Based on Blockchain and Pipelined Code. In: Wang, G., El Saddik, A., Lai, X., Martinez Perez, G., Choo, KK. (eds) Smart City and Informatization. iSCI 2019. Communications in Computer and Information Science, vol 1122. Springer, Singapore. https://doi.org/10.1007/978-981-15-1301-5_49

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-1301-5_49

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-1300-8

  • Online ISBN: 978-981-15-1301-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation