Abstract
In recent years, the cluster computing technology has become a cost-effective computing infrastructure, because it aggregates resources of computational power, communication and storage. It is also considered a very attractive platform for low-cost supercomputing. Software distributed shared memory (DSM) provides a convenient and effective solution for programming parallel applications. However, both page faults and communication are major sources of overheads in DSM systems. Prefetching strategy can overlap data transporting time with computation time, as also reducing page faults. Unfortunately, it conducts load imbalance during barrier synchronization. For solving such inconveniences, this research paper discusses the load balancing for barrier synchronization in DSM systems. We discuss that, leaving the loop when half of hosts have finished prefetching is the best method, and therefore, we modify the threshold of leaving loop. Experiments show that, by incorporating load balancing into DSM systems, the barrier synchronization has been improved.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Cheung, B.W.-L., Wang, C.-L., LAU, F.C.-M.: Migrating-Home Protocol for Software Distributed Shared Memory. Journal of Information Science and Engineering 18, 929–957 (2002)
Crawford, J.A., Mobarry, C.M.: Hrunting: A Distributed Shared Memory System for the BEOWULF Parallel Workstation. In: The Proceedings of Aerospace Conference, vol. 4 (1998)
Eskicioglu, M.R., Marsland, T.A., Hu, W., Shi, W.: Evaluation of the JIAJIA Software DSM System on High Performance Computer Architectures. In: The Proceedings of the Hawaii’s International Conference On System Sciences, January 5–8 (1999)
Hu, W., Shi, W., Tang, Z.: Optimizing Home-Based Software DSM Protocols. Journal of Networks, Software Tools and Applications, Baltzer Science Publishers 4(3), 235–242 (2001)
Hu, W., Zhang, F., Ren, L., Shi, W., Tang, Z.: Running Real Applications on Software DSMs. The Proceedings of High Performance Computing in the Asia-Pacific Region 1, 148–153 (2000)
Hu, W., Shi, W., Tang, Z.: Reducing System Overheads in Home-Based Software DSMs. In: The Proceedings of 13th International and 10th Symposium on Parallel and Distributed Processing, April 12-16, pp. 167–173 (1999)
Liu, H., Hu, W.: A Comparison of Two Strategies Dynamic Data Prefetching in software DSM. In: The Proceedings of 15th International Parallel and Distributed Processing Symposium, April 23-27, p. 62 (2001)
Roh, Y., Seong, B.H., Park, D.: Hiding Latency Through Bulk Transfer and Prefetching in Distributed Shared Memory Multiprocessors. In: The Proceedings of The Fourth International High Performance Computing in the Asia-Pacific Region, vol. 1, pp. 164–166 (2000)
Shi, W., Tang, Z.: Dynamic Computation Scheduling for Load Balancing in Home-based Software DSMs. In: Proceedings of the 1999 International Symposium on Parallel Architectures, Algorithms and Networks (I-SPAN 1999), June 1999, pp. 248–253. IEEE CS Press, Perth (1999)
Shi, W., Tang, Z.: Load Balancing in Home-based Software DSMs. In: Special Issue of International Journal of Foundations of Computer Science, USA, June, 2001, vol. 12(3), pp. 307–324. World Scientic Publishing Co. Inc, Singapore (2001)
Tanenbaum, A.S.: Distributed Operating System. Prentice Hall International Editions, Englewood Cliffs (1995)
Wang, K.J., Wang, H.H., Li, K.C.: On Design of a Prefetching Strategy for DSM System. In: The Proceedings of PDPTA 2004 International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, USA (2004)
Wilkinson, B., Allen, M.: Parallel Programming Techniques and Applications Using Networked Workstations and Parallel Computers. Prentice Hall, Upper Saddle River (1999)
Yu, B., Huang, Z., Cranefield, S., Purvis, M.: Homeless and home-based Lazy Release Consistency protocols on Distributed Shared Memory. In: The Proceedings of the 27th conference on Australasian computer science, January 2004, vol. 26, pp. 117–123 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, HH., Li, KC., Wang, KJ., Lu, SH., Yang, CC. (2005). Load Balancing Design Issues on Prefetch-Based DSM Systems. In: Cao, J., Nejdl, W., Xu, M. (eds) Advanced Parallel Processing Technologies. APPT 2005. Lecture Notes in Computer Science, vol 3756. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573937_26
Download citation
DOI: https://doi.org/10.1007/11573937_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29639-3
Online ISBN: 978-3-540-32107-1
eBook Packages: Computer ScienceComputer Science (R0)