Abstract
In this paper, we present an efficient method for optimizing localities of data distribution when executing data parallel applications. The data to logical grid nodes mapping technique is employed to enhance the performance of parallel programs on cluster grid. Cluster grid is a typical computational grid environment consists of several clusters located in multiple campuses that are distributed globally over the Internet. Objective of the proposed technique is to reduce inter-cluster communication overheads and to speed the execution of data parallel programs in the underlying distributed cluster grid. The theoretical analysis and experimental results show improvement of communication costs and scalable of the proposed techniques on different hierarchical cluster grids.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Taiwan UniGrid, http://unigrid.nchc.org.tw
Beaumont, O., Legrand, A., Robert, Y.: Optimal algorithms for scheduling divisible workloads on heterogeneous systems. In: Proceedings of the 12th IEEE Heterogeneous Computing Workshop (2003)
Bal, H.E., Plaat, A., Bakker, M.G., Dozy, P., Hofman, R.F.H.: Optimizing Parallel Applications for Wide-Area Clusters. In: Proceedings of the 12th International Parallel Processing Symposium IPPS 1998, pp. 784–790 (1998)
Faerman, M., Birnbaum, A., Casanova, H., Berman, F.: Resource Allocation for Steerable Parallel Parameter Searches. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 157–168. Springer, Heidelberg (2002)
Blythe, J., Deelman, E., Gil, Y., Kesselman, C., Agarwal, A., Mehta, G., Vahi, K.: The role of planning in grid computing. In: Proceedings of ICAPS 2003 (2003)
Dawson, J., Strazdins, P.: Optimizing User-Level Communication Patterns on the Fujitsu AP3000. In: Proceedings of the 1st IEEE International Workshop on Cluster Computing, pp. 105–111 (1999)
Foster, I.: Building an open Grid. In: Proceedings of the second IEEE international symposium on Network Computing and Applications (2003)
Foster, I., Kessclman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1999) (ISBN 1-55860-475-8)
Foster, I., Kessclman, C.: Globus: A metacomputing infrastructure toolkit. Intl. J. Supercomputer Applications 11(2), 115–128 (1997)
Frey, J., Tannenbaum, T., Livny, M., Foster, I., Tuccke, S.: Condor-G: A Computation Management Agent for Multi-Institutional Grids. Journal of Cluster Computing 5, 237–246 (2002)
Lee, S., Yook, H.-G., Koo, M.-S., Park, M.-S.: Processor reordering algorithms toward efficient GEN_BLOCK redistribution. In: Proceedings of the 2001 ACM symposium on Applied computing (2001)
Guo, M., Nakata, I.: A Framework for Efficient Data Redistribution on Distributed Memory Multicomputers. The Journal of Supercomputing 20(3), 243–265 (2001)
Isaila, F., Tichy, W.F.: Mapping Functions and Data Redistribution for Parallel Files. In: Proceedings of IPDPS 2002 Workshop on Parallel and Distributed Scientific and Engineering Computing with Applications, Fort Lauderdale (April 2002)
Koonp, J., Mehofer, E.: Distribution assignment placement: Effective optimization of redistribution costs. IEEE TPDS 13(6) (June 2002)
Kalns, E.T., Ni, L.M.: Processor mapping techniques toward efficient data redistribution. IEEE TPDS 6(12), 1234–1247 (1995)
Lim, Y.W., Bhat, P.B., Parsanna, V.K.: Efficient algorithm for block-cyclic redistribution of arrays. Algorithmica 24(3-4), 298–330 (1999)
Plaat, A., Bal, H.E., Hofman, R.F.H.: Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects. In: Proceedings of the 5th IEEE High Performance Computer Architecture HPCA 1999, pp. 244–253 (1999)
Qin, X., Jiang, H.: Dynamic, Reliability-driven Scheduling of Parallel Real-time Jobs in Heterogeneous Systems. In: Proceedings of the 30th ICPP, Valencia, Spain (2001)
Ranaweera, S., Agrawal, D.P.: Scheduling of Periodic Time Critical Applications for Pipelined Execution on Heterogeneous Systems. In: Proceedings of the 30th ICPP, Valencia, Spain (2001)
Spooner, D.P., Jarvis, S.A., Caoy, J., Saini, S., Nudd, G.R.: Local Grid Scheduling Techniques using Performance Prediction. IEE Proc. Computers and Digital Techniques 150(2), 87–96 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hsu, CH., Lin, GH., Li, KC., Yang, CT. (2005). Localization Techniques for Cluster-Based Data Grid. In: Hobbs, M., Goscinski, A.M., Zhou, W. (eds) Distributed and Parallel Computing. ICA3PP 2005. Lecture Notes in Computer Science, vol 3719. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564621_9
Download citation
DOI: https://doi.org/10.1007/11564621_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29235-7
Online ISBN: 978-3-540-32071-5
eBook Packages: Computer ScienceComputer Science (R0)