Abstract
In data grid, large quantity of data files is produced and data replication is applied to reduce data access time. Efficiently utilizing grid resources becomes important research issue since available resources in grid are limited while large number of workloads and large size of data files are produced. Dynamic replication in data grid aims to reduce data access time and to utilize network and storage resources efficiently. This paper proposes a novel dynamic replication strategy, called BHR, which reduces data access time by avoiding network congestions in a data grid network. With BHR strategy, we can take benefits from ‘network-level locality’ which represents that required file is located in the site which has broad bandwidth to the site of job execution. We evaluate BHR strategy by implementing it in an OptorSim, a data grid simulator initially developed by European Data Grid Projects. The simulation results show that BHR strategy can outperform other optimization techniques in terms of data access time when hierarchy of bandwidth appears in Internet. BHR extends current site-level replica optimization study to the network-level.
This work is supported by a grant of the International Mobile Telecommunications 2000 R&D Project, Ministry of Information & Communication in South Korea, ITA Professorship for Visiting Faculty Positions in Korea (International Joint Research Project) by Ministry of Information & Communication in South Korea, and grant No. (R01-2003-000-10794-0) from the Basic Research Program of the Korea Science & Engineering Foundation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bell, W.H., Cameron, D.G., Capozza, L., Paul Millar, A., Stockinger, K., Zini, F.: Simulation of Dynamic Grid Replication Strategies in OptorSim. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 46–57. Springer, Heidelberg (2002)
Bell, W.H., Cameron, D.G., Carvajal-Schiaffino, R., Paul Millar, A., Stockinger, K., Zini, F.: Evaluation of an Economy-Based File Replication Strategy for a Data Grid. In: International Workshop on Agent based Cluster and Grid Computing at CCGrid 2003, Tokyo, Japan, May 2003, IEEE Computer Society Press, Los Alamitos (2003)
Carman, M., Zini, F., Serafini, L., Stockinger, K.: Towards an Economy- Based Optimisation of File Access and Replication on a Data Grid. In: International Workshop on Agent based Cluster and Grid Computing at International Symposium on Cluster Computing and the Grid (CCGrid 2002), Berlin, Germany, May 2002, IEEE Computer Society Press, Los Alamitos (2002)
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23, 187–200 (2001)
EU Data Grid Project, http://www.eu-datagrid.org
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International J. Supercomputer Applications 15(3) (2001)
Hoschek, W., Jaen-Martinez, J., Samar, A., Stockinger, H., Stokkinger, K.: Data Management in an International Data Grid Project. In: Buyya, R., Baker, M. (eds.) GRID 2000. LNCS, vol. 1971, pp. 77–90. Springer, Heidelberg (2000)
OptorSim – A Replica Optimizer Simulation, http://edg-wp2.web.cern.ch/edg-wp2/optimization/optorsim.html
Park, S.-M., Kim, J.-H.: Chameleon: A Resource Scheduler in a Data Grid Environment. In: 2003 IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID 2003), Tokyo, Japan, May 2003, IEEE Computer Society Press, Los Alamitos (2003)
Ranganathan, K., Foster, I.: Design and Evaluation of Dynamic Replication Strategies for a High Performance Data Grid. In: International Conference on Computing in High Energy and Nuclear Physics, Beijing (September 2001)
Ranganathan, K., Foster, I.: Identifying Dynamic Replication Strategies for a High Performance Data Grid. In: International Workshop on Grid Computing, Denver (November 2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, SM., Kim, JH., Ko, YB., Yoon, WS. (2004). Dynamic Data Grid Replication Strategy Based on Internet Hierarchy. In: Li, M., Sun, XH., Deng, Q., Ni, J. (eds) Grid and Cooperative Computing. GCC 2003. Lecture Notes in Computer Science, vol 3033. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24680-0_133
Download citation
DOI: https://doi.org/10.1007/978-3-540-24680-0_133
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21993-4
Online ISBN: 978-3-540-24680-0
eBook Packages: Springer Book Archive