Abstract
This paper surveys and places into perspective a number of results concerning the D-BSP (Decomposable Bulk Synchronous Parallel) model of computation, a variant of the popular BSP model proposed byValiant in the early nineties. D-BSP captures part of the proximity structure of the computing platform, modeling it by suitable decompositions into clusters, each characterized by its own bandwidth and latency parameters. Quantitative evidence is provided that, when modeling realistic parallel architectures, D-BSP achieves higher effectiveness and portability than BSP, without significantly affecting the ease of use. It is also shown that D-BSP avoids some of the shortcomings of BSP which motivated the definition of other variants of the model. Finally, the paper discusses how the aspects of network proximity incorporated in the model allow for a better management of network congestion and bank contention, when supporting a shared-memory abstraction in a distributed-memory environment.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
[BDM95]A. Bäumker, W. Dittrich, and F. Meyer auf der Heide. Truly efficient parallel algorithms: c-optimal multisearch for and extension of the BSP model. In Proc. of the 3rd European Symposium on Algorithms, pages 17–30, 1995.
G. E. Blelloch, P. B. Gibbons, Y. Matias, and M. Zagha. Accounting for memory bank contention and delay in high-bandwidth multiprocessors. In Proc. of the 7th ACM Symp. on Parallel Algorithms and Architectures, pages 84–94, Santa Barbara, CA, July 1995.
G. Bilardi, K. T. Herley, A. Pietracaprina, G. Pucci, and P. Spirakis. BSP vs LogP. In Proc. of the 8th ACM Symp. on Parallel Algorithms and Architectures, pages 25–32, 1996. To appear in Algorithmica, Special Issue on Coarse Grained Parallel Algorithms.
G. Bilardi, K. Herley, A. Pietracaprina, and G. Pucci. On stalling in LogP. In Proc. of the Workshop on Advances in Parallel and Distributed Computational Models, LNCS 1800, pages 109–115, May 2000.
G. Bilardi, A. Pietracaprina, and G. Pucci. A quantitative measure of portability with application to bandwidth-latency models for parallel computing. In Proc. of EUROPAR 99, LNCS 1685, pages 543–551, September 1999.
D. E. Culler, R. Karp, D. Patterson, A. Sahay, E. Santos, K. E. Schauser, R. Subramonian, and T. V. Eicken. LogP: A practical model of parallel computation. Communications of the ACM, 39(11):78–85, November 1996.
[CMS95]A. Czumaj, F. Meyer auf der Heide, and V. Stemann. Shared memory simulations with triple-logarithmic delay. In Proc. of the 3rd European Symposium on Algorithms, pages 46–59, 1995.
J. L. Carter and M. N. Wegman. Universal classes of hash functions. Journal of Computer and System Sciences, 18:143–154, 1979.
P. De laTorre and C. P. Kruskal. Submachine locality in the bulk synchronous setting. In Proc. of EUROPAR 96, LNCS 1124, pages 352–358, August 1996.
C. Fantozzi, A. Pietracaprina, and G. Pucci. Implementing shared memory on clustered machines. In Proc. of 2nd International Parallel and Distributed Processing Symposium, 2001. To appear.
M. T. Goodrich. Communication-efficient parallel sorting. In Proc. of the 28th ACM Symp. on Theory of Computing, pages 247–256, Philadelphia, Pennsylvania USA, May 1996.
M. Hall Jr. Combinatorial Theory. John Wiley & Sons, New York NY, second edition, 1986.
J. JáJá. An Introduction to Parallel Algorithms. Addison Wesley, Reading MA, 1992.
B. H. H. Juurlink and H. A. G. Wijshoff. The E-BSP model: Incorporating general locality and unbalanced communication into the BSP model. In Proc. of EUROPAR 96, LNCS 1124, pages 339–347, August 1996.
B. H. H. Juurlink and H. A. G. Wijshoff. A quantitative comparison of paralle computation models. In Proc. of the 8th ACM Symp. on Parallel Algorithms and Architectures, pages 13–24, June 1996.
F. T. Leighton. Introduction to Parallel Algorithms and Architectures: Arrays • Trees • Hypercubes. Morgan Kaufmann, San Mateo, CA, 1992.
F. T. Leighton, B. M. Maggs, and A. W. Richa. Fast algorithms for finding O(congestion + dilation) packet routing schedules. Combinatorica, 19(3):375–401, 1999.
F. T. Leighton and S. Rao. Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms. Journal of the ACM, 46(6):787–832, 1999.
R. Motwani and P. Raghavan. Randomized Algorithms. Cambridge University Press, Cambridge MA, 1995.
K. Mehlhorn and U. Vishkin. Randomized and deterministic simulations of PRAMs by parallel machines with restricted granularity of parallel memories. Acta Informatica, 21:339–374, 1984.
[PPS00]A. Pietracaprina, G. Pucci, and J. Sibeyn. Constructive, deterministic implementation of shared memory on meshes. SIAM Journal on Computing, 30(2):625–648, 2000.
[Ran91]A. G. Ranade. How to emulate shared memory. Journal of Computer and System Sciences, 42:307–326, 1991.
J. F. Sibeyn and M. Kaufmann. Deterministic 1-k routing on meshes, with application to hot-potato worm-hole routing. In Proc. of the 11th Symp. on Theoretical Aspects of Computer Science, LNCS 775, pages 237–248, 1994.
E. Upfal and A. Widgerson. How to share memory in a distributed system. Journal of the ACM, 34(1):116–127, 1987.
L. G. Valiant. A bridging model for parallel computation. Communications of the ACM, 33(8):103–111, August 1990.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bilardi, G., Fantozzi, C., Pietracaprina, A., Pucci, G. (2001). On the Effectiveness of D-BSP as a Bridging Model of Parallel Computation. In: Alexandrov, V.N., Dongarra, J.J., Juliano, B.A., Renner, R.S., Tan, C.J.K. (eds) Computational Science - ICCS 2001. ICCS 2001. Lecture Notes in Computer Science, vol 2074. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45718-6_63
Download citation
DOI: https://doi.org/10.1007/3-540-45718-6_63
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42233-4
Online ISBN: 978-3-540-45718-3
eBook Packages: Springer Book Archive