Abstract
IPFS (Interplanetary File System) is a peer to peer distributed file system with fast downloading speed and high security. IPFS adopts the storage method of equal-size fragmentation and DHT-based resource search. Through investigation, it is found that the current IPFS system lacks the strategy of resource migration. Therefore, in order to improve the efficiency of its search and further improve the download speed of biological data, This paper adopts the sharding and uploading method based on the characteristics of biological data and propose the migration algorithm based on routing table and the migration algorithm based on biological historical access table. The experimental and analytical results show that the proposed method is effective.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Benet, J.: IPFS - Content Addressed, Versioned, P2P File System (DRAFT 3). Eprint Arxiv (2014)
Fielding, R, et al.: Hypertext Transfer Protocol – HTTP/1.1. Comput. Sci. Commun. Dict. 7(4), 595–599 (1999)
Donnelly, P., Thain, D.: ACM Press the 2013 International Workshop - Denver, Colorado (2013.11.18–2013.11.18). Proceedings of the 2013 International Workshop on Data-Intensive Scalable Computing Systems - DISCS-2013 - Design of an Active Storage Cluster File System for DAG Workflows, pp. 37–42 (2013)
Smith, R.N., Aleksic, J., Butano, D., et al.: InterMine: a flexible data warehouse system for the integration and analysis of heterogeneous biological data. Bioinformatics 28(23), 3163–3165 (2012)
Deorowicz, S., Grabowski, S.: Compression of DNA sequence reads in FASTQ format. Bioinformatics 27(6), 860–862 (2011)
Roberson, E.D.O.: Motif scraper: a cross-platform, open-source tool for identifying degenerate nucleotide motif matches in FASTA files. Bioinformatics 34, 3926–3928 (2018)
Li, H.E.A.: The sequence alignment/map (SAM) format. Bioinformatics 25(1 Pt 2), 1653–1654 (2009)
El-Ansary, S., Alima, L.O., Brand, P., Haridi, S.: Efficient broadcast in structured P2P networks. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 304–314. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45172-3_28
Rao, A., Lakshminarayanan, K., Surana, S., Karp, R., Stoica, I.: Load balancing in structured P2P systems. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 68–79. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45172-3_6
Prasad, K.K., Aithal, P.S.: A study on fingerprint hash code generation based on MD5 algorithm and freeman chain code. Int. J. Comput. Res. Dev. (IJCRD) 3, 13–22 (2018)
Wu, D., Tian, Y., Ng, K.W.: Achieving resilient and efficient load balancing in DHT-based P2P systems. In: 2006 31st IEEE Conference on Local Computer Networks. IEEE (2007)
Zhang, Y., et al.: An efficient unstructured P2P network search algorithm based on multi-information. In: International Conference on Instrumentation. IEEE (2011)
Wang, C., Xiao, L.: An effective P2P search scheme to exploit file sharing heterogeneity. IEEE Trans. Parallel Distrib. Syst. 18(2), 145–157 (2007)
Totekar, C.R., Thilagam, P.S.: An efficient search to improve neighbour selection mechanism in P2P network. In: Prasad, S.K., Routray, S., Khurana, R., Sahni, S. (eds.) ICISTM 2009. CCIS, vol. 31, pp. 119–127. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00405-6_16
Busnel, Y., Kermarrec, A.M.: PROXSEM: interest-based proximity measure to improve search efficiency in P2P systems. In: European Conference on Universal Multiservice Networks. IEEE (2007)
Sharifi, L., Khorsandi, S.: A popularity-based query scheme in P2P networks using adaptive gossip sampling. Peer-To-Peer Netw. Appl. 6(1), 75–85 (2013)
Yeferny, T., Arour, K.: Efficient routing method in P2P systems based upon training knowledge. In: International Conference on Advanced Information Networking & Applications Workshops. IEEE (2012)
Youming, F., et al.: An improved range query algorithm on over-DHT based P2P network. In: International Conference on Computer Science & Network Technology IEEE (2012)
Napoli, C., Pappalardo, G., Tramontana, E.: Improving files availability for bittorrent using a diffusion model. In: Wetice Conference, pp. 191–196. IEEE (2014)
Acknowledgments
The research of this article is supported by the national key research and development program “biological information security and efficient transmission” project, project letter no. 2017YFC1201204.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, C., Man, Y., He, J., Gu, J., Xing, X. (2019). Biological Data Migration Method Based on IPFS System. In: Milošević, D., Tang, Y., Zu, Q. (eds) Human Centered Computing. HCC 2019. Lecture Notes in Computer Science(), vol 11956. Springer, Cham. https://doi.org/10.1007/978-3-030-37429-7_60
Download citation
DOI: https://doi.org/10.1007/978-3-030-37429-7_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37428-0
Online ISBN: 978-3-030-37429-7
eBook Packages: Computer ScienceComputer Science (R0)