Abstract
This paper presents a modification of Pollack's RAAM (Recursive Auto-Associative Memory), called a Recursive Hetero-Associative Memory (RHAM), and shows that it is capable of learning simple translation tasks, by building a state-Space representation of each input string and unfolding it to obtain the corresponding output string. RHAM-based translators are computationally more powerful and easier to train than their corresponding double-RAAM counterparts in the literature.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Chalmers, D.J. (1990) “Syntactic Transformations on Distributed Representations”, Connection Science 2, 53–62.
Chrisman, L. (1991) “Learning Recursive Distributed Representations for Holistic Computation”, Connection Science 3:4, 345–366.
Hopcroft, J.E., Ullman, J.D. (1979) Introduction to automata theory, languages and computation. Reading, Massachussets: Addison-Wesley.
Neco, R., Forcada, M.L. (1996) “Beyond Mealy machines: Learning translators with recurrent neural networks”, Proc. World Congress on Neural Networks (San Diego, Calif., Sept. 1996), p. 408–411.
Pollack, J.B. (1990) “Recursive distributed representations”, Artificial Intelligence 46, 77–105.
Rumelhart, D.E., Hinton, G.E., Williams, R.J. (1986) “Learning internal representations by error propagation”. In Parallel Distributed Processing: Explorations in the Microstructure of Cognition (D.E. Rumelhart and J.L. McClelland, eds.), Vol. 1, Chapter 8, Cambridge, MA: MIT Press.
Salomaa, A. (1987) Formal Languages, Boston, Massachusetts: Academic Press.
Unnikrishnan, K.P., Venugopal, K.P. (1994) “Alopex: A Correlation-Based Algorithm for Feedforward and Recurrent Neural Networks”, Neural Computation 6, 469–490.
Williams, R.J., Zipser, D. (1989) “A learning algorithm for continually running fully recurrent neural networks”, Neural Comp. 1, 270–280.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Forcada, M.L., Ñeco, R.P. (1997). Recursive hetero-associative memories for translation. In: Mira, J., Moreno-Díaz, R., Cabestany, J. (eds) Biological and Artificial Computation: From Neuroscience to Technology. IWANN 1997. Lecture Notes in Computer Science, vol 1240. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032504
Download citation
DOI: https://doi.org/10.1007/BFb0032504
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63047-0
Online ISBN: 978-3-540-69074-0
eBook Packages: Springer Book Archive