poster

Multi-hop path splitting and multi-pathing optimizations for data transfers over shared wide-area networks using gridFTP

Authors:

Ian FosterAuthors Info & Claims

HPDC '08: Proceedings of the 17th international symposium on High performance distributed computing

Pages 225 - 226

https://doi.org/10.1145/1383422.1383457

Published: 23 June 2008 Publication History

Get Access

Abstract

In this paper, we propose to employ two optimizations - multi-hop path splitting and multi-pathing - to improve the performance of data transfers over shared public networks. We present a path determination algorithm which integrates the aforesaid optimizations in order to improve the performance of single file transfers. Finally, we develop a file transfer scheduling algorithm based on this framework, and evaluate its effectiveness on a wide-area testbed.

References

[1]

The Large Haldron Collider (LHC). http://lhc.web.cern.ch/lhc/.

Google Scholar

[2]

W. Allcock. Gridftp: Protocol extensions to ftp for the grid. In Global Grid ForumGFD-R-P.020, 2003.

Google Scholar

[3]

K. Holtman. Cms data grid system overview and requirements. In Computing in High Energy and Nuclear Physics (CHEP), 2001.

Google Scholar

[4]

G. Khanna, T. Kurc, U. Catalyurek, R. Kettimuthu, P. Sadayappan, and J. Saltz. A dynamic scheduling approach for coordinated wide-area data transfers using gridftp. In Proc. of 22th International Parallel and Distributed Processing Symposium (IPDPS), Miami, Florida, 2008. to appear.

Google Scholar

Cited By

View all

Alkhonaini MEl-Sayed H(2020)Performance Evaluation and Examination of Data Transfer: A Review of Parallel Migration in Cloud StorageAdvances in Science, Technology and Engineering Systems Journal10.25046/aj0502075:2(57-63)Online publication date: 2020
https://doi.org/10.25046/aj050207
Lek CYaik OYue L(2017)Cloud-to-cloud parallel data transfer via spawning intermediate nodesTENCON 2017 - 2017 IEEE Region 10 Conference10.1109/TENCON.2017.8227943(657-661)Online publication date: Nov-2017
https://doi.org/10.1109/TENCON.2017.8227943
Okyere-Benya JExarchakos GMenkovski VLiotta AGiaccone P(2012)Mechanisms for Parallel Data TransportNext Generation Content Delivery Infrastructures10.4018/978-1-4666-1794-0.ch008(172-198)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-1794-0.ch008
Show More Cited By

Index Terms

Multi-hop path splitting and multi-pathing optimizations for data transfers over shared wide-area networks using gridFTP

Recommendations

An New Global Dynamic Scheduling Algorithm with Multi-Hop Path Splitting and Multi-Pathing Using GridFTP
PACCS '09: Proceedings of the 2009 Pacific-Asia Conference on Circuits, Communications and Systems

This paper presents a file transfer global dynamic scheduling algorithm that incorporates the two optimizations of multi-hop path splitting and multi-pathing in conjunction with the use of available file replicas, This algorithm makes use of information ...
A Global Dynamic Scheduling Scheme and Architecture Using GridFTP
CESCE '10: Proceedings of the 2010 International Conference on Challenges in Environmental Science and Computer Engineering - Volume 01

This paper presents a global dynamic scheduling approach for file transfer, which incorporates the two optimizations of multi-hop path splitting and multi-pathing, This algorithm makes use of information from past GridFTP transfers to estimate network ...
Improving GridFTP transfers by means of a multiagent parallel file system
Grid Computing, high performance and distributed applications

Data transfer in a grid environment has become one critical activity in a large number of applications that require access to huge volumes of data. In these scenarios, characterized by large latencies, poor performance and complex dependencies, the use ...

Comments

Information & Contributors

Information

Published In

HPDC '08: Proceedings of the 17th international symposium on High performance distributed computing

June 2008

252 pages

ISBN:9781595939975

DOI:10.1145/1383422

General Chairs:
Manish Parashar
Rutgers University, USA
,
Karsten Schwan
Georgia Institute of Technology, USA
,
Program Chairs:
Jon Weissman
National e-Science Center, Edinburgh, University of Minnesota, USA
,
Domenico Laforenza
Information Science and Technology Institute, CNR, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 June 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

HPDC '08

Sponsor:

HPDC '08: International Symposium on High Performance Distributed Computing

June 23 - 27, 2008

MA, Boston, USA

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
132
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alkhonaini MEl-Sayed H(2020)Performance Evaluation and Examination of Data Transfer: A Review of Parallel Migration in Cloud StorageAdvances in Science, Technology and Engineering Systems Journal10.25046/aj0502075:2(57-63)Online publication date: 2020
https://doi.org/10.25046/aj050207
Lek CYaik OYue L(2017)Cloud-to-cloud parallel data transfer via spawning intermediate nodesTENCON 2017 - 2017 IEEE Region 10 Conference10.1109/TENCON.2017.8227943(657-661)Online publication date: Nov-2017
https://doi.org/10.1109/TENCON.2017.8227943
Okyere-Benya JExarchakos GMenkovski VLiotta AGiaccone P(2012)Mechanisms for Parallel Data TransportNext Generation Content Delivery Infrastructures10.4018/978-1-4666-1794-0.ch008(172-198)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-1794-0.ch008
Bingxiang GJian H(2010)A Global Dynamic Scheduling Scheme and Architecture Using GridFTPProceedings of the 2010 International Conference on Challenges in Environmental Science and Computer Engineering - Volume 0110.1109/CESCE.2010.261(110-113)Online publication date: 6-Mar-2010
https://dl.acm.org/doi/10.1109/CESCE.2010.261
Bingxiang GBing L(2009)An New Global Dynamic Scheduling Algorithm with Multi-Hop Path Splitting and Multi-Pathing Using GridFTPProceedings of the 2009 Pacific-Asia Conference on Circuits, Communications and Systems10.1109/PACCS.2009.5(99-102)Online publication date: 16-May-2009
https://dl.acm.org/doi/10.1109/PACCS.2009.5

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

An New Global Dynamic Scheduling Algorithm with Multi-Hop Path Splitting and Multi-Pathing Using GridFTP

A Global Dynamic Scheduling Scheme and Architecture Using GridFTP

Improving GridFTP transfers by means of a multiagent parallel file system

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations