ABSTRACT
In this paper, we propose to employ two optimizations - multi-hop path splitting and multi-pathing - to improve the performance of data transfers over shared public networks. We present a path determination algorithm which integrates the aforesaid optimizations in order to improve the performance of single file transfers. Finally, we develop a file transfer scheduling algorithm based on this framework, and evaluate its effectiveness on a wide-area testbed.
- The Large Haldron Collider (LHC). http://lhc.web.cern.ch/lhc/.Google Scholar
- W. Allcock. Gridftp: Protocol extensions to ftp for the grid. In Global Grid ForumGFD-R-P.020, 2003.Google Scholar
- K. Holtman. Cms data grid system overview and requirements. In Computing in High Energy and Nuclear Physics (CHEP), 2001.Google Scholar
- G. Khanna, T. Kurc, U. Catalyurek, R. Kettimuthu, P. Sadayappan, and J. Saltz. A dynamic scheduling approach for coordinated wide-area data transfers using gridftp. In Proc. of 22th International Parallel and Distributed Processing Symposium (IPDPS), Miami, Florida, 2008. to appear.Google Scholar
Index Terms
- Multi-hop path splitting and multi-pathing optimizations for data transfers over shared wide-area networks using gridFTP
Recommendations
An New Global Dynamic Scheduling Algorithm with Multi-Hop Path Splitting and Multi-Pathing Using GridFTP
PACCS '09: Proceedings of the 2009 Pacific-Asia Conference on Circuits, Communications and SystemsThis paper presents a file transfer global dynamic scheduling algorithm that incorporates the two optimizations of multi-hop path splitting and multi-pathing in conjunction with the use of available file replicas, This algorithm makes use of information ...
A Global Dynamic Scheduling Scheme and Architecture Using GridFTP
CESCE '10: Proceedings of the 2010 International Conference on Challenges in Environmental Science and Computer Engineering - Volume 01This paper presents a global dynamic scheduling approach for file transfer, which incorporates the two optimizations of multi-hop path splitting and multi-pathing, This algorithm makes use of information from past GridFTP transfers to estimate network ...
Improving GridFTP transfers by means of a multiagent parallel file system
Grid Computing, high performance and distributed applicationsData transfer in a grid environment has become one critical activity in a large number of applications that require access to huge volumes of data. In these scenarios, characterized by large latencies, poor performance and complex dependencies, the use ...
Comments