Abstract
This paper analyzes the efficiency of Randomized Shared Memory (RSM) in terms of constant factors. RSM or memory hashing, that is, pseudorandom distribution of global memory addresses throughout local memories in a distributed-memory parallel system, has been proven to enable an (asymptotically) optimally efficient implementation of scalable and universal shared memory. High memory access latencies are hidden through massive parallelism. Our work examines the practical relevance and feasibility of this potentially significant theoretical result. After an introduction of the background, principles, and desirable properties of RSM and an outline of the approach to determine RSM efficiency, the major results of our simulations are presented. The results show that RSM efficiency is encouragingly high (up to 20% efficiency of idealized shared memory), even in an architecture modelled on the basis of state-of-the-art technology. Performance-limiting factors are identified from the results and architectural features to increase efficiency are proposed, most notably extremely fast process switching and a combining network. Several novel machine designs document the increased interest in RSM and hardware support.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
F. Abolhassan, J. Keller, W. J. Paul, On the Cost-Effectiveness and Realization of the Theoretical PRAM Model, Report SFB 124/D4, 09/1991, Univ. Saarbrücken (1991).
J. Allwright, “BSP-Occam: A Parallel Language Based on a Distributed Virtual Shared Memory”, submitted to Software: Practice and Experience (1992).
R. Alverson, D. Callahan, D. Cummings, B. Koblenz, A. Porterfield, B. Smith, “The Tera Computer System”, ACM SIGARCH Computer Architecture News 18,3 (Proc. 1990 Int 'l. Conf. on Supercomputing), pp. 1–6.
A. Gibbons, W. Rytter, Efficient Parallel Algorithms, Cambridge University Press, Cambridge (1988).
H. Hellwagner, A Survey of Virtually Shared Memory Schemes, SFB Report No. 342/33/90 A, Techn. Univ. Munich (1990).
H. Hellwagner, “Virtually Shared Memory Architectures for Scalable Universal Parallel Computers”, in H. Schwärtzel (ed.), Applied Computer Science and Software (Proc. Intl. Symp.), Springer-Verlag(1991), pp. 91–112.
H. Hofestädt, A. Klein, B. Reyzl, “Performance Benefits from Locally Adaptive Interval Routing in Dynamically Switched Interconnection Networks”, in A. Bode (ed.), Distributed Memory Computing (Proc. EDMCC 2), LNCS 487, Springer-Verlag (1991), pp. 193–202.
Inmos Ltd., The T9000 Transputer Products Overview Manual, First Edition, 1991.
R. M. Karp, V. Ramachandran, “Parallel Algorithms for Shared-Memory Machines”, in J. van Leeuwen (ed.), Handbook of Theoretical Computer Science, North-Holland, Amsterdam (1990).
K. Mehlhorn, U. Vishkin, “Randomized and Deterministic Simulations of PRAMs by Parallel Machines with Restricted Granularity of Parallel Memories”, Acta Informatica 21 (1984), pp. 339–374.
B. Nitzberg, V. Lo, “Distributed Shared Memory: A Survey of Issues and Algorithms”, COMPUTER 24, 8 (1991), pp. 52–60.
A. G. Ranade, S. N. Bhatt, S. L. Johnsson, “The Fluent Abstract Machine”, in J. Allen, F. T. Leighton (eds.), Advanced Research in VLSI (Proc. 5 th MIT Conf), MIT Press, Cambridge, MA (1988), pp. 71–93.
R. D. Rettberg, W. R. Crowther, P. P. Carvey, R. S. Tomlinson, “The Monarch Parallel Processor Hardware Design”, COMPUTER 23, 4 (1990), pp. 18–30.
L. G. Valiant, “General Purpose Parallel Architectures”, in J. van Leeuwen (ed.), Handbook of Theoretical Computer Science, North-Holland, Amsterdam (1990).
L. G. Valiant, “A Bridging Model for Parallel Computation”, Comm. ACM 33, 8 (1990), pp. 103–111.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1992 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hellwagner, H. (1992). On the practical efficiency of Randomized Shared Memory. In: Bougé, L., Cosnard, M., Robert, Y., Trystram, D. (eds) Parallel Processing: CONPAR 92—VAPP V. VAPP CONPAR 1992 1992. Lecture Notes in Computer Science, vol 634. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-55895-0_441
Download citation
DOI: https://doi.org/10.1007/3-540-55895-0_441
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-55895-8
Online ISBN: 978-3-540-47306-0
eBook Packages: Springer Book Archive