Abstract
It is unlikely that the Hopfield model will be of much practical use as a stand-alone associative memory for pattern recognition purposes. Its importance lies in its conceptual significance: since 1982 nearly all of the publications in this field have acknowledged the relevance of this model. Several papers have recently described modifications to the Hebb programming rule, to permit the storage of correlated patterns. Such systems are much more likely to be of use for pattern recognition, either as algorithmic models to be run on existing computers or perhaps as small-scale VLSI implementations. There are several factors which are important when assessing the importance of an associative memory. These include its pattern-storage capacity, its algorithmic or hardware complexity, its ability to recognise imperfect input patterns, and its response time. The present paper is intended to make a contribution towards describing the behaviour of the last two factors.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA 79, 2554–2558 (1982).
G. Weisbuch and F. Fogelman-Soulié, Scaling laws for the attractors of Hopfield networks, J. Physique Lett. 46, L623–L630 (1985).
D. J. Amit, H. Gutfreund and H. Sompolinsky, Statistical mechanics of neural networks near saturation, Ann. Phys. 175, 30–67 (1987).
A. D. Bruce, E. J. Gardner and D. J. Wallace, Dynamics and statistical mechanics of the Hopfield model, J. Phys. A: Math. Gen. 20, 2909–2934 (1987).
D. Grensing, R. Kühn and J. L. van Hemmen, Storing patterns in a spin-glass model of neural networks near saturation, J. Phys. A: Math. Gen. 20, 2935–2947 (1987).
S. Kirkpatrick and D. Sherrington, Infinite-ranged models of spin glasses. Phys. Rev. B17, 4384–4403 (1978).
J. Buhmann and K. Schulten, Associative recognition and storage in a model network of physiological neurons, Biol. Cybern. 54, 1–17 (1986).
H. P. Graf, L. D. Jackel, R. E. Howard, B. Straughn, J. S. Denker, W. Hubbard, D. M. Tennant and D. Schwartz, VLSI implementation of a neural network memory with several hundreds of neurons, Neural Networks for Computing, ed. J. S. Denker, pp. 182–187. Amer. Inst. Phys. Conf. Proc. 151, New York (1986).
M. R. B. Forshaw, Pattern storage and associative memory in quasi-neural networks, Pattern. Recogn. Letts. 4, 427–431 (1986).
M. R. B. Forshaw, Pattern Storage and Associative Memory in Quasi-Neural Networks, WOPPLOT 86—Parallel Processing: Logic, Organization and Technology, ed. J. D. Becker and I. Eisele, pp. 185–197. Springer-Verlag, Berlin (1987).
E. Gardner, B. Derrida and P. Mottishaw, Zero temperature parallel dynamics for infinite range spin glasses and neural networks, J. Physique 48, 741–755 (1987).
R. J. McEliece, E. C. Posner, E. R. Rodemich and S. S. Venkatesh, The capacity of the Hopfield associative memory, IEEE Trans. IT-33, 461–482 (1987).
J. D. Keeler, Basins of attraction of neural network models, Neural Networks for Computing, ed. J. S. Denker, pp. 259–264. Amer. Inst. Phys. Conf. Proc. 151, New York (1986).
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1988 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Forshaw, M.R.B. (1988). Dynamics of hopfield associative memories. In: Kittler, J. (eds) Pattern Recognition. PAR 1988. Lecture Notes in Computer Science, vol 301. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-19036-8_8
Download citation
DOI: https://doi.org/10.1007/3-540-19036-8_8
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-19036-3
Online ISBN: 978-3-540-38947-7
eBook Packages: Springer Book Archive