Abstract
In data grid environments, datasets are usually replicated to many servers when taking into consideration its efficiency. Since these files are usually huge in size, how to efficiently transmit and access between servers and grid users is an important issue. In this paper, we present an economy-based parallel file transfer technique using P2P co-allocation scheme, aiming to service grid applications efficiently and economically in data grids. Taking into consideration the cost factor, we present a novel mechanism for selection of appropriate server, by combining with an adaptive file decomposition scheme and the dynamic adjustment method. In order to evaluate the performance of the proposed method, we have implemented the proposed algorithm and compared with several other previous published techniques. Simulation results demonstrate that the proposed technique is economically effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kawano, A., Funasaka, J., Ishida, K.: Parallel Downloading Using Variable Length Blocks for Proxy Servers. In: 27th International Conference on Distributed Computing Systems Workshops (ICDCSW 2007), pp. 59–66 (2007)
Gkantsidis, C., Ammar, M., Zegura, E.: On the Effect of Large -Scale Deployment of Parallel Downloading. In: IEEE Workshop on Internet Applications (WIAPP 2003), pp. 79–89 (2003)
Yang, C.-T., Yang, I.-H., Wang, S.-Y., Chen, C.-H., Li, K.-C.: Improvements on Dynamic Adjustment Mechanism in Co-Allocation Data Grid Environments. Journal of Supercomputing 40(3), 269–280 (2007)
Yang, C.-T., Chi, Y.-C., Yang, M.-F., Hsu, C.-H.: A Recursively-Adjusting Co-Allocation Scheme with a Cyber-Transformer in Data Grid. Future Generation Computer Systems 25(7) (2009)
Yang, C.-T., Chi, Y.-C., Fu, C.-P., Hsu, C.-H.: An Anticipative Recursively-Adjustment Mechanism for Redundant Parallel File Transfer in Data Grids. In: Proceedings of the Thirteenth IEEE Asia-Pacific Computer Systems Architecture Conference (ACSAC 2008), Hsinchu, Taiwan, August 4-6, pp. 1–8 (2008)
Funasaka, J., Nakawaki, N., Ishida, K., Amano, K.: A parallel downloading method of coping with variable bandwidth. In: Proceedings of the 23rd International Conference on Distributed Computing Systems Workshops (ICDCSW 2003), pp. 14–19 (2003)
Funasaka, J., Kawano, A., Ishida, K.: Implementation issues of parallel downloading methods for a proxy system. In: Proceedings of the 25th IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW 2005 (2005)
Chang, R.-S., Wang, C.-M., Chen, P.-H.: Replica Selection on Co-allocation Data Grids. In: Cao, J., Yang, L.T., Guo, M., Lau, F. (eds.) ISPA 2004. LNCS, vol. 3358, pp. 584–593. Springer, Heidelberg (2004)
Bhuvaneswaran, R.S., Katayama, Y., Takahashi, N.: Dynamic Co-allocation Scheme for Parallel Data Transfer in Grid Environment. In: Proceedings of the First International Conference on Semantics, Knowledge, and Grid (SKG 2005), pp. 19–24 (2005)
Bhuvaneswaran, R.S., Katayama, Y., Takahashi, N.: Coordinated Co-allocator Model for Data Grid in Multi-sender Environment. In: Dan, A., Lamersdorf, W. (eds.) ICSOC 2006. LNCS, vol. 4294, pp. 66–77. Springer, Heidelberg (2006)
Chang, R.-S., Lin, C.-F., Ruey, J.-H., His, S.-C.: An efficient and bandwidth sensitive parallel download scheme in data grids. In: 3rd International Conference on Communication Systems Software and Middleware and Workshops, 2008 (COMSWARE 2008), pp. 296–301 (2008)
Vazhkudai, S., Schopf, J.: Predicting Sporadic Grid Data Transfers. In: Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC 2002), July 2002, pp. 188–196 (2002)
Vazhkudai, S., Schopf, J.: Using Regression Techniques to Predict Large Data Transfers. International Journal of High Performance Computing Applications (IJHPCA 2003), 249–268 (August 2003)
Vazhkudai, S.: Enabling the Co-Allocation of Grid Data Transfers. In: Proceedings of the Fourth International Workshop on Grid Computing (GRID 2003), November 17, pp. 44–51 (2003)
Xu, Z., Xianliang, L., Mengshu, H., Chuan, Z.: A Speed-based Adaptive Dynamic Parallel Downloading Technique. In: Proceedings of ACM Special Interest Group Operating, pp. 63–69 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Chu, CW., Hsu, CH., Chang, HY., Wang, ST., Li, KC. (2009). Parallel File Transfer for Grid Economic. In: Mueller, P., Cao, JN., Wang, CL. (eds) Scalable Information Systems. INFOSCALE 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 18. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10485-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-10485-5_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10484-8
Online ISBN: 978-3-642-10485-5
eBook Packages: Computer ScienceComputer Science (R0)