Skip to main content

Matrix-Valued Hopfield Neural Networks

  • Conference paper
  • First Online:
Advances in Neural Networks – ISNN 2016 (ISNN 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9719))

Included in the following conference series:

Abstract

In this paper, we introduce matrix-valued Hopfield neural networks, for which the states, outputs, weights and thresholds are all square matrices. Matrix-valued neural networks represent a generalization of the complex-, hyperbolic-, quaternion- and Clifford-valued neural networks that have been intensively studied over the last few years. The dynamics of these networks is studied by giving an expression for the energy function, and proving that it is indeed an energy function for the proposed network.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arena, P., Fortuna, L., Muscato, G., Xibilia, M.: Multilayer perceptrons to approximate quaternion valued functions. Neural Netw. 10(2), 335–342 (1997)

    Article  Google Scholar 

  2. Arena, P., Fortuna, L., Occhipinti, L., Xibilia, M.: Neural networks for quaternion-valued function approximation. In: International Symposium on Circuits and Systems (ISCAS), vol. 6, pp. 307–310. IEEE (1994)

    Google Scholar 

  3. Buchholz, S., Sommer, G.: A hyperbolic multilayer perceptron. In: International Joint Conference on Neural Networks (IJCNN), vol. 2, pp. 129–133. IEEE (2000)

    Google Scholar 

  4. Buchholz, S., Sommer, G.: On Clifford neurons and Clifford multi-layer perceptrons. Neural Netw. 21(7), 925–935 (2008)

    Article  MATH  Google Scholar 

  5. Hirose, A.: Complex-Valued Neural Networks, Studies in Computational Intelligence, vol. 400. Springer, Heidelberg (2012)

    Book  MATH  Google Scholar 

  6. Hopfield, J.: Neural networks and physical systems with eemergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79(8), 2554–2558 (1982)

    Article  MathSciNet  Google Scholar 

  7. Hopfield, J.: Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. U.S.A. 81(10), 3088–3092 (1984)

    Article  Google Scholar 

  8. Hopfield, J., Tank, D.: “Neural” computation of decisions in optimization problems. Biol. Cybern. 52(3), 141–152 (1985)

    MathSciNet  MATH  Google Scholar 

  9. Kobayashi, M.: Hyperbolic hopfield neural networks. IEEE Trans. Neural Netw. Learn. Syst. 24(2), 335–341 (2013)

    Article  Google Scholar 

  10. Kuroe, Y.: Models of cClifford recurrent neural networks and their dynamics. In: International Joint Conference on Neural Networks (IJCNN), pp. 1035–1041. IEEE (2011)

    Google Scholar 

  11. Kuroe, Y., Hashimoto, N., Mori, T.: On energy function for complex-valued neural nnetworks and its applications. In: International Conference on Neural Information Processing (ICONIP), vol. 3, pp. 1079–1083. IEEE (2002)

    Google Scholar 

  12. Kuroe, Y., Tanigawa, S., Iima, H.: Models of hopfield-type Clifford neural networks and their energy functions - hyperbolic and dual valued networks. In: Lu, B.-L., Zhang, L., Kwok, J. (eds.) ICONIP 2011, Part I. LNCS, vol. 7062, pp. 560–569. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  13. Kuroe, Y., Yoshida, M., Mori, T.: On activation functions for complex-valued neural networks - existence of energy functions. Artificial Neural Networks and Neural Information Processing - ICANN/ICONIP. LNCS, pp. 985–992. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  14. Mandic, D., Goh, S.: Complex Valued Nonlinear Adaptive Filters Noncircularity, Widely Linear and Neural Models. Wiley, New York (2009)

    Book  MATH  Google Scholar 

  15. Nitta, T.: A quaternary version of the back-propagation algorithm. In: International Conference on Neural Networks, pp. 2753–2756, vol. 5. IEEE (1995)

    Google Scholar 

  16. Nitta, T., Buchholz, S.: On the decision boundaries of hyperbolic neurons. In: International Joint Conference on Neural Networks (IJCNN), pp. 2974–2980. IEEE (2008)

    Google Scholar 

  17. Pearson, J., Bisset, D.: Back propagation in a Clifford algebra. In: International Conference on Artificial Neural Networks, vol. 2, pp. 413–416 (1992)

    Google Scholar 

  18. Pearson, J., Bisset, D.: Neural networks in the Clifford domain. In: International Conference on Neural Networks, vol. 3, pp. 1465–1469. IEEE (1994)

    Google Scholar 

  19. Popa, C.A.: Matrix-Valued neural networks. In: Matoušek, R. (ed.) International Conference on Soft Computing (MENDEL). Advances in Intelligent Systems and Computing, vol. 378, pp. 245–255. Springer International Publishing, Heidelberg (2015)

    Google Scholar 

  20. Tank, D., Hopfield, J.: Simple “neural” optimization networks: an a/d converter, signal decision circuit, and a linear programming circuit. IEEE Trans. Circ. Syst. 33(5), 533–541 (1986)

    Article  Google Scholar 

  21. Valle, M.: A novel continuous-valued quaternionic hopfield neural network. In: Brazilian Conference on Intelligent Systems (BRACIS), pp. 97–102. IEEE (2014)

    Google Scholar 

  22. Vallejo, J., Bayro-Corrochano, E.: Clifford hopfield neural networks. In: International Joint Conference on Neural Networks (IJCNN), pp. 3609–3612. IEEE, June 2008

    Google Scholar 

  23. Widrow, B., McCool, J., Ball, M.: The Complex Lms Algorithm. Proc. IEEE 63(4), 719–720 (1975)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Călin-Adrian Popa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Popa, CA. (2016). Matrix-Valued Hopfield Neural Networks. In: Cheng, L., Liu, Q., Ronzhin, A. (eds) Advances in Neural Networks – ISNN 2016. ISNN 2016. Lecture Notes in Computer Science(), vol 9719. Springer, Cham. https://doi.org/10.1007/978-3-319-40663-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-40663-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-40662-6

  • Online ISBN: 978-3-319-40663-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics