Abstract
We found via numerical simulations, that connectivity structure in sparsely connected hopfield networks for random bit patterns affects the storage capacity. Not only the number of local connections is important, but also, and in contrast, the recently found small-world-topology will increase the quality of recalled patterns. Here, we propose and investigate the impact from network network architecture to pattern storage capacity capabilities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilites. Proc. Nat. Acac. Sci. USA 79, 2554–2558 (1982)
Hopfield, J.J.: Neurons with graded response have collective computation abilities. Proc. Nat. Acad. Sci. USA 81, 3088–3092 (1984)
Watts, D.J., Strogatz, S.H.: Collective dynamics of ’small-world’ networks. Nature 393, 440–442 (1998)
Netoff, T.I., Clewley, R., Arno, S., Keck, T., White, J.A.: Epilepsy in Small-World Networks J. Neurosci. 24, 8075–8083 (2004)
Voigt, T., Opitz, T., de Lima, A.D.: Synchronous Oscillatory Activity in Immature Cortical Network is Driven by GABAergic Preplate Neurons. J. Neurosci. 21(22), 8895–8905 (2001)
Wang, X.F., Chen, G.: Small-World, Scale-Free and Beyond. IEEE circuits and systems magazine, first quarter (2003)
Buzsaki, G., Geisler, C., Henze, D.A., Wang, X.J.: Interneuron Diversity series: Circuit complexity and axon wiring economy of cortical interneurons. Trends Neurosci. 27, 186–193 (2004)
Herzog, A., Kube, K., Michaelis, B., de Lima, A.D., Voigt, T.: Connection strategies in neocortical networks. In: ESANN 2006 (in press, 2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kube, K., Herzog, A., Michaelis, B. (2006). Increased Storage Capacity in Hopfield Networks by Small-World Topology. In: Jiao, L., Wang, L., Gao, Xb., Liu, J., Wu, F. (eds) Advances in Natural Computation. ICNC 2006. Lecture Notes in Computer Science, vol 4221. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11881070_18
Download citation
DOI: https://doi.org/10.1007/11881070_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45901-9
Online ISBN: 978-3-540-45902-6
eBook Packages: Computer ScienceComputer Science (R0)