Abstract
A method to embed N dimensional, multi-valued patterns into an auto-associative memory represented as a nonlinear line of attraction in a fully connected recurrent neural network is presented in this paper. The curvature of the nonlinear attractor is defined by the Kth degree polynomial line which best fits the training data in N dimensional state space. The width of the nonlinear line is then characterized by the statistical characteristics of the training patterns. Stability of the recurrent network is verified by analyzing the trajectory of the points in the state space during convergence. The performance of the network is benchmarked through the reconstruction of original gray-scale images from their corrupted versions. It is observed that the proposed method can quickly and successfully reconstruct each image with an average convergence rate of 3.10 iterations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558
Zhao L, Caceres JCG, Szu H (2003) Chaotic associative recalls for fixed point attractor patterns. Proc IEEE Int Conf Neural Netw 2:841–845
Seow MJ, Asari VK (2003) Associative memory using ratio rule for multi-valued pattern association. Proc IEEE Int Conf Neural Netw 4:2518–2522
Seow MJ, Asari VK (2006) Ratio rule and homomorphic filter for enhancement of digital color image. J Neurocomput 69:954–958
Brody CD, Kepecs RA (2003) Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations. Curr Opin Neurobiol 13:204–211
Stringer SM, Trappenberg TP, Rolls ET, de Araujo IET (2002) Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells. Netw Comput Neural Syst 13:217–242
Seung HS (1998) Continuous attractors and oculomotor control. Neural Netw 11:1253–1258
Seow MJ, Asari VK (2004) Recurrent network as a nonlinear line attractor for skin color association. Advances in Neural Networks—ISNN 2004. LNCS vol 3174. Springer, Berlin, pp 870–875
Seow MJ, Asari VK (2005) Color characterization and balancing by a nonlinear line attractor network for image enhancement. Neural Process Lett 22:291–309
Seow MJ, Asari VK (2006) Recurrent neural network as a linear attractor for pattern association. IEEE Trans Neural Netw 17:246–250
Yi Z, Tan KK (2004) Multistability analysis of discrete recurrent neural networks with unsaturating piecewise linear transfer functions. IEEE Trans Neural Netw 15(2):329–336
Cambell WM, Assaleh KT, Broun CC (2002) Speaker recognition with polynomial classifiers. IEEE Trans Speech Audio Proc 10(4):205–212
Jankowski S, Lozowski A, Zurada JM (1996) Complex-valued multi-state neural network associative memory. IEEE Trans Neural Netw 7:1491–1496
Muezzinoglu MK, Guzelis C, Zurada JM (2003) A new design method for complex-valued multi-state Hopfield associative memory. IEEE Trans Neural Netw 14(4):891–899
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Seow, MJ., Asari, V.K. & Livingston, A. Learning as a nonlinear line of attraction in a recurrent neural network. Neural Comput & Applic 19, 337–342 (2010). https://doi.org/10.1007/s00521-009-0304-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-009-0304-9