Abstract
This paper introduces two alternative algorithms for efficient data transfer in the Grid environment. For data transfer from a source node to the destination node, the algorithms can construct multiple dynamic paths by selecting some other nodes as data relays. The bandwidth available in different paths can be aggregated thus to significantly speed up the data transfer process. The proposed algorithms differ from each other in whether the global networking information should be considered. Experimental results indicate that both algorithms can provide efficient data transfer under various circumstances.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Wang, L. and Jie, W., “Towards supporting multiple virtual private computing environments on computational Grids," Advances in Engineering Software, 40, 4, pp. 239-245, 2009.
Allcock, W. E., Bester, J., Bresnahan, J., Chervenak, A.L., Foster I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., and Tuecke, S., “Data management and transfer in high-performance computational grid environments," Parallel Computing, 28, 5, pp. 749-771, 2002.
Chen, J., Druschel, P., and Subramanian, D., “An efficient multipath forwarding method," in Proc. the Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies 1998, IEEE Computer Society, pp. 1418-1425, 1998.
Cheng, B., Chou, C., Golubchik, L., Khuller, S. and Wan, Y.-C., “Large scale data collection: a coordinated approach," in Proc. of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies 2003, IEEE Communications Society, pp. 218-228, 2003.
Castro, M., Druschel, P., Kermarrec, A-M., Nandi, A., Rowstron, A. and Singh, A.,“SplitStream: High-bandwidth multicast in a cooperative environment," in Proc. of Symposium on Operating Systems Principles 2003 (Michael, L. S. and Larry, L. P. ed.), ACM Press, pp. 298-313, 2003.
Xiong, M. Z. and Jin, H., “Optimization Algorithms for Data Transfer in the Grid Environment," Quantitative Quality of Service for Grid Computing: Applications for Heterogeneity, Large-Scale Distribution and Dynamic Environments (Wang, L., Chen, J. and Jie, W. ed.), IGI Global, Chapter XXII, 2009.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dan Chen: This research was supported by the National Natural Science Foundation of China under the project grant No. 60804036. It is a collaborative work among the UoB, CUG and HUST under the Birmingham-Warwick Science City Research Interdisciplinary Alliance.
About this article
Cite this article
Xiong, M., Chen, D., Jin, H. et al. Multi-path based Algorithms for Data Transfer in the Grid Environment. New Gener. Comput. 28, 129–136 (2010). https://doi.org/10.1007/s00354-008-0080-6
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00354-008-0080-6