Skip to main content

An Iterative Incremental Learning Algorithm for Complex-Valued Hopfield Associative Memory

  • Conference paper
  • First Online:
  • 2425 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9950))

Abstract

This paper discusses a complex-valued Hopfield associative memory with an iterative incremental learning algorithm. The mathematical proofs derive that the weight matrix is approximated as a weight matrix by the complex-valued pseudo inverse algorithm. Furthermore, the minimum number of iterations for the learning sequence is defined with maintaining the network stability. From the result of simulation experiment in terms of memory capacity and noise tolerance, the proposed model has the superior ability than the model with a complex-valued pseudo inverse learning algorithm.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Albert, A.: Regression and the Moore-Penrose Inverse. Academic Press, New York (1972)

    MATH  Google Scholar 

  2. Blatt, M.G., Vergini, E.G.: Neural networks: a local learning prescription for arbitrary correlated patterns. Phys. Rev. Lett. 66(13), 1793 (1991)

    Article  Google Scholar 

  3. Chartier, S., Boukadoum, M.: A bidirectional heteroassociative memory for binary and grey-level patterns. IEEE Trans. Neural Netw. 17(2), 385–396 (2006)

    Article  Google Scholar 

  4. Diederich, S., Opper, M.: Learning of correlated patterns in spin-glass networks by local learning rules. Phys. Rev. Lett. 58(9), 949 (1987)

    Article  MathSciNet  Google Scholar 

  5. Gardner, E.: Optimal basins of attraction in randomly sparse neural network models. J. Phys. A: Math. Gen. 22(12), 1969 (1989)

    Article  MathSciNet  Google Scholar 

  6. Hagiwara, M.: Multidirectional associative memory. In: International Joint Conference on Neural Networks, vol. 1, pp. 3–6 (1990)

    Google Scholar 

  7. Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79(8), 2554–2558 (1982)

    Article  MathSciNet  Google Scholar 

  8. Isokawa, T., Nishimura, H., Matsui, N.: An iterative learning scheme for multistate complex-valued and quaternionic Hopfield neural networks (2009)

    Google Scholar 

  9. Jankowski, S., Lozowski, A., Zurada, J.: Complex-valued multistate neural associative memory. IEEE Trans. Neural Netw. 7(6), 1491–1496 (1996)

    Article  Google Scholar 

  10. Kobayashi, M., Yamazaki, H.: Complex-valued multidirectional associative memory. Electr. Eng. Jpn. 159(1), 39–45 (2007)

    Article  Google Scholar 

  11. Kosko, B.: Constructing an associative memory. Byte 12(10), 137–144 (1987)

    Google Scholar 

  12. Krauth, W., Mézard, M.: Learning algorithms with optimal stability in neural networks. J. Phys. A: Math. Gen. 20(11), L745 (1987)

    Article  MathSciNet  Google Scholar 

  13. Lee, D.L.: Improvements of complex-valued Hopfield associative memory by using generalized projection rules. IEEE Trans. Neural Netw. 17(5), 1341–1347 (2006)

    Article  Google Scholar 

  14. Storkey, A.J., Valabregue, R.: The basins of attraction of a new Hopfield learning rule. Neural Netw. 12(6), 869–876 (1999)

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to acknowledge a scholarship provided by the University of Malaya (Fellowship Scheme). This research is supported by High Impact Research UM.C/625/1/HIR/MOHE/FCSIT/10 from University of Malaya.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Naoki Masuyama .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Masuyama, N., Loo, C.K. (2016). An Iterative Incremental Learning Algorithm for Complex-Valued Hopfield Associative Memory. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9950. Springer, Cham. https://doi.org/10.1007/978-3-319-46681-1_51

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46681-1_51

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46680-4

  • Online ISBN: 978-3-319-46681-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics