Abstract
In this paper, we introduce matrix-valued Hopfield neural networks, for which the states, outputs, weights and thresholds are all square matrices. Matrix-valued neural networks represent a generalization of the complex-, hyperbolic-, quaternion- and Clifford-valued neural networks that have been intensively studied over the last few years. The dynamics of these networks is studied by giving an expression for the energy function, and proving that it is indeed an energy function for the proposed network.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arena, P., Fortuna, L., Muscato, G., Xibilia, M.: Multilayer perceptrons to approximate quaternion valued functions. Neural Netw. 10(2), 335–342 (1997)
Arena, P., Fortuna, L., Occhipinti, L., Xibilia, M.: Neural networks for quaternion-valued function approximation. In: International Symposium on Circuits and Systems (ISCAS), vol. 6, pp. 307–310. IEEE (1994)
Buchholz, S., Sommer, G.: A hyperbolic multilayer perceptron. In: International Joint Conference on Neural Networks (IJCNN), vol. 2, pp. 129–133. IEEE (2000)
Buchholz, S., Sommer, G.: On Clifford neurons and Clifford multi-layer perceptrons. Neural Netw. 21(7), 925–935 (2008)
Hirose, A.: Complex-Valued Neural Networks, Studies in Computational Intelligence, vol. 400. Springer, Heidelberg (2012)
Hopfield, J.: Neural networks and physical systems with eemergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79(8), 2554–2558 (1982)
Hopfield, J.: Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. U.S.A. 81(10), 3088–3092 (1984)
Hopfield, J., Tank, D.: “Neural” computation of decisions in optimization problems. Biol. Cybern. 52(3), 141–152 (1985)
Kobayashi, M.: Hyperbolic hopfield neural networks. IEEE Trans. Neural Netw. Learn. Syst. 24(2), 335–341 (2013)
Kuroe, Y.: Models of cClifford recurrent neural networks and their dynamics. In: International Joint Conference on Neural Networks (IJCNN), pp. 1035–1041. IEEE (2011)
Kuroe, Y., Hashimoto, N., Mori, T.: On energy function for complex-valued neural nnetworks and its applications. In: International Conference on Neural Information Processing (ICONIP), vol. 3, pp. 1079–1083. IEEE (2002)
Kuroe, Y., Tanigawa, S., Iima, H.: Models of hopfield-type Clifford neural networks and their energy functions - hyperbolic and dual valued networks. In: Lu, B.-L., Zhang, L., Kwok, J. (eds.) ICONIP 2011, Part I. LNCS, vol. 7062, pp. 560–569. Springer, Heidelberg (2011)
Kuroe, Y., Yoshida, M., Mori, T.: On activation functions for complex-valued neural networks - existence of energy functions. Artificial Neural Networks and Neural Information Processing - ICANN/ICONIP. LNCS, pp. 985–992. Springer, Heidelberg (2003)
Mandic, D., Goh, S.: Complex Valued Nonlinear Adaptive Filters Noncircularity, Widely Linear and Neural Models. Wiley, New York (2009)
Nitta, T.: A quaternary version of the back-propagation algorithm. In: International Conference on Neural Networks, pp. 2753–2756, vol. 5. IEEE (1995)
Nitta, T., Buchholz, S.: On the decision boundaries of hyperbolic neurons. In: International Joint Conference on Neural Networks (IJCNN), pp. 2974–2980. IEEE (2008)
Pearson, J., Bisset, D.: Back propagation in a Clifford algebra. In: International Conference on Artificial Neural Networks, vol. 2, pp. 413–416 (1992)
Pearson, J., Bisset, D.: Neural networks in the Clifford domain. In: International Conference on Neural Networks, vol. 3, pp. 1465–1469. IEEE (1994)
Popa, C.A.: Matrix-Valued neural networks. In: Matoušek, R. (ed.) International Conference on Soft Computing (MENDEL). Advances in Intelligent Systems and Computing, vol. 378, pp. 245–255. Springer International Publishing, Heidelberg (2015)
Tank, D., Hopfield, J.: Simple “neural” optimization networks: an a/d converter, signal decision circuit, and a linear programming circuit. IEEE Trans. Circ. Syst. 33(5), 533–541 (1986)
Valle, M.: A novel continuous-valued quaternionic hopfield neural network. In: Brazilian Conference on Intelligent Systems (BRACIS), pp. 97–102. IEEE (2014)
Vallejo, J., Bayro-Corrochano, E.: Clifford hopfield neural networks. In: International Joint Conference on Neural Networks (IJCNN), pp. 3609–3612. IEEE, June 2008
Widrow, B., McCool, J., Ball, M.: The Complex Lms Algorithm. Proc. IEEE 63(4), 719–720 (1975)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Popa, CA. (2016). Matrix-Valued Hopfield Neural Networks. In: Cheng, L., Liu, Q., Ronzhin, A. (eds) Advances in Neural Networks – ISNN 2016. ISNN 2016. Lecture Notes in Computer Science(), vol 9719. Springer, Cham. https://doi.org/10.1007/978-3-319-40663-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-40663-3_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40662-6
Online ISBN: 978-3-319-40663-3
eBook Packages: Computer ScienceComputer Science (R0)