Skip to main content

Recursive hetero-associative memories for translation

  • Plasticity Phenomena (Maturing, Learning and Memory)
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1240))

Abstract

This paper presents a modification of Pollack's RAAM (Recursive Auto-Associative Memory), called a Recursive Hetero-Associative Memory (RHAM), and shows that it is capable of learning simple translation tasks, by building a state-Space representation of each input string and unfolding it to obtain the corresponding output string. RHAM-based translators are computationally more powerful and easier to train than their corresponding double-RAAM counterparts in the literature.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Chalmers, D.J. (1990) “Syntactic Transformations on Distributed Representations”, Connection Science 2, 53–62.

    Google Scholar 

  • Chrisman, L. (1991) “Learning Recursive Distributed Representations for Holistic Computation”, Connection Science 3:4, 345–366.

    Google Scholar 

  • Hopcroft, J.E., Ullman, J.D. (1979) Introduction to automata theory, languages and computation. Reading, Massachussets: Addison-Wesley.

    Google Scholar 

  • Neco, R., Forcada, M.L. (1996) “Beyond Mealy machines: Learning translators with recurrent neural networks”, Proc. World Congress on Neural Networks (San Diego, Calif., Sept. 1996), p. 408–411.

    Google Scholar 

  • Pollack, J.B. (1990) “Recursive distributed representations”, Artificial Intelligence 46, 77–105.

    Google Scholar 

  • Rumelhart, D.E., Hinton, G.E., Williams, R.J. (1986) “Learning internal representations by error propagation”. In Parallel Distributed Processing: Explorations in the Microstructure of Cognition (D.E. Rumelhart and J.L. McClelland, eds.), Vol. 1, Chapter 8, Cambridge, MA: MIT Press.

    Google Scholar 

  • Salomaa, A. (1987) Formal Languages, Boston, Massachusetts: Academic Press.

    Google Scholar 

  • Unnikrishnan, K.P., Venugopal, K.P. (1994) “Alopex: A Correlation-Based Algorithm for Feedforward and Recurrent Neural Networks”, Neural Computation 6, 469–490.

    Google Scholar 

  • Williams, R.J., Zipser, D. (1989) “A learning algorithm for continually running fully recurrent neural networks”, Neural Comp. 1, 270–280.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

José Mira Roberto Moreno-Díaz Joan Cabestany

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Forcada, M.L., Ñeco, R.P. (1997). Recursive hetero-associative memories for translation. In: Mira, J., Moreno-Díaz, R., Cabestany, J. (eds) Biological and Artificial Computation: From Neuroscience to Technology. IWANN 1997. Lecture Notes in Computer Science, vol 1240. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032504

Download citation

  • DOI: https://doi.org/10.1007/BFb0032504

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-63047-0

  • Online ISBN: 978-3-540-69074-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics