Abstract
This paper presents a subscription-based overlay network that supports file parallel downloading for cloud collaboration. First, our system lets users to register to a central server and allows this server to incrementally build a topology graph containing the network connections among the subscribers. With this topology graph in place, we plan to address the challenges of minimizing network traffic and choosing the best set of nodes storing a chosen file for parallel downloading. When a subscriber wants to access a chosen file stored in the cloud, our system obtains for her a list of nodes having this file. Nodes in this list, are sorted considering both their network distance to the subscriber and their workloads. Second, selecting those top nodes, a bandwidth-aware parallel downloading technique is executed. Finally, our proposed system also features leveraging idling nodes for file downloading. More specifically, the subscribers who are on-line but not participating in downloading are recruited to reduce both network traffic and average latency.
Keywords
This work was supported by the Universidad del Bio-Bio, grant no. GI 150115/EF.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
FileZilla Server. http://filezilla-project.org/download.php?type=server
Ns-3. http://www.nsnam.org
Al-Jaroodi, J., Mohamed, N.: Ddftp: dual-direction ftp. In: Proceedings of the International Symposium on Cluster, Cloud and Grid Computing, pp. 504–513 (2011)
Bernstein, D.J.: Pipeling. http://cr.yp.to/ftp/pipeling
Byers, J.W., Luby, M., Mitzenmacher, M.: Accessing multiple mirror sites in parallel: using tornado codes to speed up downloads. In: Proceedings of IEEE International Conference on Computer Communications, pp. 275–283, 21–25 March 1999
Chang, R.S., Guob, M.H., Lina, H.C.: A multiple parallel download scheme with server throughput and client bandwidth considerations for data grids. Future Gener. Comput. Syst. 24(8), 798–805 (2008)
Chen, H., Gong, Z., Huang, Z.: Parallel downloading algorithm for large-volume file distribution. In: Proceedings of the 6th International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 745–749, December 2005
Feldman, M., Lai, K., Stoica, I., Chuang, J.: Robust incentive techniques for peer-to-peer networks. In: Proceedings of the Conference on Electronic Commerce, pp. 102–111 (2004)
Funasaka, J., Nakawaki, N., Ishida, K., Amano, K.: A parallel downloading method of coping with variable bandwidth. In: Proceedings of the IEEE ICDCS Workshop on Assurance in Distributed Systems and Networks, pp. 14–19, 19–22 May 2003
Galdames, P., Zheng, Q., Cai, Y.: A subscription overlay network for large-scale and cost-efficient any source multicast. In: Proceedings of the IEEE on Performance Computing and Communications Conference, pp. 1–8, 17–19 November 2011
Gkantsidis, C., Ammar, M., Zegura, E.: On the effect of large-scale deployment of parallel downloading. In: IEEE Workshop on Internet Applications, pp. 79–90, 23–24 June 2003
Kolodner, E.K., Tal, S., Kyriazis, D., et al.: A cloud environment for data-intensive storage service. In: Proceedings of the International Conference on Cloud Computing Technology and Science, pp. 357–366, 29 November - 1 December 2011
Koo, M., Rosenberg, C., Dongyan, X.: Analysis of parallel downloading for large file distribution. In: Workshop on Future Trends of Distributed Computing Systems, pp. 128–135, 28–30 May 2003
Koo, S., Lee, C., Kannan, K.: A genetic-algorithm-based neighbor-selection strategy for hybrid peer-to-peer networks. In: Proceedings of the International Conference on Computer Communications and Networks, pp. 469–474 (2004)
Kurose, F., Ross, K.: Computer Networking: A Top-Down Approach, 6th edn. Pearson, US (2012)
Kuznetsov, A.: Tracepath. http://linux.die.net/man/8/tracepath
Lai, K., Feldman, M., Stoica, I., Chuang, J.: Incentives for cooperation in peer-to-peer networks. In: Workshop on Economics of Peer-to-Peer Systems (2003)
Li, J.: Erasure resilient codes in peer-to-peer storage cloud. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, 14–19 May 2006
Lv, Q., Cao, P., Cohen, E., Li, K., Shenker, S.: Search and replication in unstructured peer-to-peer networks. In: Proceedings of ACM International Conference on Supercomputing, New York City, NY, U.S.A, 22–26 June 2002
Ning, K., Zhou, Z., Zhang, L.J.: Leverage personal cloud storage services to provide shared storage for team collaboration. In: Proceedings of the International Conference on Services Computing, pp. 613–620, 27 June - 2 July 2014
Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content-addressable network. In: Proceedings of ACM SIGCOMM, pp. 161–172, San Diego, CA, U.S.A (2001)
Rodriguez, P., Kirpal, A., Biersack, E.: Parallel-access for mirror sites in the internet. In: Proceedings of the IEEE on Computer Communications, pp. 864–873 (2000)
Sohail, S., Jha, S., Kanhere, S., Chun, T.: Qos driven parallelization of resources to reduce file download delay. IEEE Trans. Parallel Distrib. Syst. 17, 12 (2006)
Stoica, I., Morris, R., Karger, D., Kaashock, M., Balakrishman, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. In: Proceedings of ACM SIGCOMM, pp. 149–160. San Diego, CA, U.S.A (2001)
Zhang, Z.L.: Feel free to cache: towards an open cdn architecture for cloud-based content distribution. In: Proceedings of the International Conference on Collaboration Technologies and Systems, pp. 488–490, 19–23 May 2014
Zinner, T., Tutschku, K., Nakao, A., Tran-Gia, P.: Using concurrent multipath transmission for transport virtualization: analyzing path selection. In: International Teletraffic Congress, pp. 1–7. IEEE (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Galdames, P., Gutierrez-Soto, C., Barrientos, C. (2015). A Subscription Overlay Network for Large-Scale and Efficient File Parallel Downloading. In: Baloian, N., Zorian, Y., Taslakian, P., Shoukouryan, S. (eds) Collaboration and Technology. CRIWG 2015. Lecture Notes in Computer Science(), vol 9334. Springer, Cham. https://doi.org/10.1007/978-3-319-22747-4_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-22747-4_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22746-7
Online ISBN: 978-3-319-22747-4
eBook Packages: Computer ScienceComputer Science (R0)