Skip to main content

A Comparison of Selected Training Algorithms for Recurrent Neural Networks

  • Conference paper
PRICAI 2006: Trends in Artificial Intelligence (PRICAI 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4099))

Included in the following conference series:

Abstract

Recurrent Neural Networks (RNNs) are one in which self-loops and backward weight connections between neurons are allowed. As a result of these network characteristics, recurrent networks can address temporal behaviors which not possible in feedforward neural networks, such as their behavior in the limit reaches a steady state (fixed point), an oscillation (limit cycle), and an a periodic instability (choas). Since RNNs have been increasingly applied to many dynamic system applications, there have been extensive efforts to develop a variety of architectures and training algorithms concerning on the enhancement of dynamic system characteristics. This work focuses on comparison of the selected and proposed training algorithms for RNNs. To evaluate the performance of the algorithms in the daily stock price forecasting in terms of efficiency index and computational time. A simple analysis on the complexity of RNNs was also carried out. It is noted that when comparing the speed of the algorithm, two components to be taken into account : the computation complexity and the space complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Koivo, H.N.: Neuro-Fuzzy Computing in Automation. Lecture Notes of Helsinki University of Technology, AZ-74.115 (2002)

    Google Scholar 

  2. Sutton, R.S.: Learning to Predict by the Methods of Temporal Differences. Machine Learning 3, 9–44 (1986)

    Google Scholar 

  3. William, R., Zipser, D.: A Learning Algorithm for Continualty Running Fully Recurrent Neural Networks. Neural Computation 1(2), 270–280 (1989)

    Article  Google Scholar 

  4. Yamamoto, Y., Nikifuruk, P.N.: A Learning Algorithm for Recurrent Neural Networks and Its Application to Nonlinear Identification. In: IEEE International Symposium on Computer Aided Control System Design, Hawaii, pp. 551–556 (1999)

    Google Scholar 

  5. Atiya, A.F., Parlos, A.G.: New Result on Recurrent Network Training: Unifying the Algorithms and Accelerating Convergence. IEEE Transactions on Neural Networks 11(3), 697–709 (2000)

    Article  Google Scholar 

  6. Williams, R.: Complexity of Exact Gradient Computation Algorithms for Recurrent Neural Networks. Northeastern Univ. College Comp.Sci., Tech.Rep. NU-CCS-89-27, Boston MA (1989)

    Google Scholar 

  7. William, R., Zipser, D.: Experimental Analysis of the Real – Time Recurrent Learning Algorithm. Connection Science 1(1) (1989)

    Google Scholar 

  8. Danh, N.T., Phien, H.N., Gupta, A.D.: Neural Network Models for River Flow Forecasting. Water SA 25(1), 33–39 (1999)

    Google Scholar 

  9. Nash, J.E., Sutcliffee, J.V.: River Flow Forecasting through Comceptual Models. J. Hydrology 10(3), 282–290 (1970)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pattamavorakun, S., Pattamavorakun, S. (2006). A Comparison of Selected Training Algorithms for Recurrent Neural Networks. In: Yang, Q., Webb, G. (eds) PRICAI 2006: Trends in Artificial Intelligence. PRICAI 2006. Lecture Notes in Computer Science(), vol 4099. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-36668-3_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-36668-3_37

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-36667-6

  • Online ISBN: 978-3-540-36668-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics