Abstract
The last years have seen the emergence of new P2P file distribution protocols such as BitTorrent as well as new Wide Area Storage based on Web Service technology. In this paper, we propose a multi-protocol file transfer service which supports client/server and P2P protocols, as well as Wide Area Storage such as Amazon S3. We describe the mechanisms used to ensure file transfer monitoring and reliability. We explain how to plug-in new or existing protocols and we give evidence of the versatility of the framework by implementing the HTTP, FTP and BitTorrent protocols and access to the Amazon S3 and IBP Wide Area Storage. Finally, we report on basic performance evaluation of our framework, both in a Grid context and on the Internet.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Amazon s3: Developer guide (March 2006)
Anderson, R.: The eternity service. In: Proceedings of Pragocrypt 1996 (1996)
Amazon web services
Bolze, R., et al.: Grid5000: A large scale highly reconfigurable experimental grid testbed. International Journal on High Performance Computing and Applications (2006)
Bassi, A., Beck, M., Fagg, G., Moore, T., Plank, J.S., Swany, M., Wolski, R.: The Internet BackPlane Protocol: A Study in Resource Sharing. In: Second IEEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, Germany (2002)
Cohen, B.: Incentives Build Robustness in BitTorrent. In: Workshop on Economics of Peer-to-Peer Systems, Berkeley (2003)
Fedak, G., He, H., Cappello, F.: BitDew: A Programmable Environment for Large-Scale Data Management and Distribution. Technical Report 6427, INRIA (January 2008)
Fernandess, Y., Malkhi, D.: On Collaborative Content Distribution using Multi-Message Gossip. In: Proceeding of IEEE IPDPS, Rhodes Island (2006)
Garfinkel, S.L.: An Evaluation of Amazon’s Grid Computing Services: EC2, S3 and SQS. Technical Report TR-08-07. Harvard University Cambridge, MA (2007)
Gkantsidis, C., Rodriguez, P.: Network Coding for Large Scale Content Distribution. In: Proceedings of IEEE/INFOCOM 2005, Miami, USA (March 2005)
Izal, M., Urvoy-Keller, G., Biersack, E.W., Felber, P.A., Hamra, A.A., Garces-Erice, L.: Dissecting BitTorrent: Five Months in a Torrent’s Lifetime. In: Proceedings of Passive and Active Measurements (PAM) (2004)
Kubiatowicz, J., et al.: OceanStore: An Architecture for Global-scale Persistent Storage. In: Proceedings of ACM ASPLOS. ACM, New York (2000)
Maymounkov, P., Maziéres, D.: Kademlia: A Peer-to-peer Information System Based on the XOR Metric. In: Proceedings of the 1st International Workshop on Peer-to-Peer Systems (IPTPS 2002). MIT, Cambridge (2002)
Palankar, M., Onibokun, A., Iamnitchi, A., Ripeanu, M.: Amazon S3 for Science Grids: a Viable Solution?. In: 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI 2007) (2007)
Qiu, D., Srikant, R.: Modeling and Performance analysis of BitTorrent-like Peer-to-Peer Networks. SIGCOMM Comput. Commun. Rev. 34(4), 367–378 (2004)
Rowstron, A., Druschel, P.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany (2001)
Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In: Proceedings of the ACM SIGCOMM 2001 Conference, San Diego, California (August 2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fedak, G., He, H., Cappello, F. (2008). A File Transfer Service with Client/Server, P2P and Wide Area Storage Protocols. In: Hameurlain, A. (eds) Data Management in Grid and Peer-to-Peer Systems. Globe 2008. Lecture Notes in Computer Science, vol 5187. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85176-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-85176-9_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85175-2
Online ISBN: 978-3-540-85176-9
eBook Packages: Computer ScienceComputer Science (R0)