Skip to main content
SpringerLink
Log in

Multilayer perceptron with different training algorithms for streamflow forecasting

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Streamflow forecasting has always been a challenging task for water resources engineers and managers. This study applies Multilayer Perceptron (MLP) networks optimized with three training algorithms, including resilient back-propagation (MLP_RP), variable learning rate (MLP_GDX), and Levenberg–Marquardt (MLP_LM), to forecast streamflow in Aspas Watershed, located in Fars province in southwestern Iran. The algorithms were trained and tested using 3 years of data. Antecedent streamflow with 1 day time lag constituted the first input vector, and MLP with this vector, labeled as MLP1 was the first model. Inclusion of streamflow with two, three, and four time lags led to input vectors 2, 3, and 4 which when combined with MLP resulted in MLP2, MLP3, and MLP4, respectively. It was found that the Levenberg–Marquardt algorithm performed best among three types of training algorithms employed for training the MLP models. Generally, the MLP4_LM model yields the best result with a determination coefficient and a root mean square error of 0.93 and 2.6 (m3/s).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Aghajanloo MB, Sabziparvar AA, Hosseinzadeh Talaee P (2012) Artificial neural network–genetic algorithm for estimation of crop evapotranspiration in a semi-arid region of Iran. Neural Comput Appl. doi:10.1007/s00521-012-1087-y

    MATH  Google Scholar 

  2. Ahmed JA, Sarma AK (2009) Artificial neural network model for synthetic streamflow generation. Water Resour Manage 21:1015–1029

    Article  Google Scholar 

  3. Can I, Tosunoğlu F, Kahya E (2012) Daily streamflow modelling using autoregressive moving average and artificial neural networks models: case study of Çoruh basin, Turkey. Hydrol Process doi. doi:10.1111/j.1747-6593.2012.00337.x

    Google Scholar 

  4. Coulibaly P, Anctil F, Bobe’e B (1999) Pre’vision hydrologique par re’seaux de neurones artificiels: e’tat de l’art. Can J Civil Eng 26:293–304

    Article  Google Scholar 

  5. Coulibaly P, Anctil F, Bobe’e B (2001) Multivariate reservoir inflow forecasting using temporal neural network. J Hydrol Eng ASCE 6(5):367–376

    Article  Google Scholar 

  6. Cybenko G (1989) Approximation by superposition of a sigmoidal function. Math Control Signals Syst 2:303–314

    Article  MATH  MathSciNet  Google Scholar 

  7. Dawson CW, Brown MA, Wilby R (2000) Inductive learning approaches to rainfall-runoff modelling. Int J Neural Sys 10:43–57

    Article  Google Scholar 

  8. Dawson CW, Harpham C, Wilby RL, Chen Y (2002) Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China. Hydrol Earth Syst Sci 6(4):619–626

    Article  Google Scholar 

  9. Dawson CW, Wilby R (1998) An artificial neural network approach to rainfall-runoff modelling. Hydrol Sci J 43:47–66

    Article  Google Scholar 

  10. Gavin B, Graeme D, Holger M (2005) Input determination for neural network models in water resources applications, Part1-background and methodology. J Hydrol 301(1):75–92

    Google Scholar 

  11. Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Networks 2:359–366

    Article  Google Scholar 

  12. Hosseinzadeh Talaee P, Heydari M, Fathi P, Marofi S, Tabari H (2012) Numerical model and computational intelligence approaches for estimating flow through rockfill dam. J Hydrol Eng ASCE 17(14):528–536

    Article  Google Scholar 

  13. Hsu KL, Gupta HV, Sorooshian S (1995) Artificial neural network modeling of rainfall-runoff process. Water Resour Res 31(10):2517–2530

    Article  Google Scholar 

  14. Jain SK, Nayak PC, Sudheer KP (2008) Models for estimating evapotranspiration using artificial neural networks, and their physical interpretation. Hydrol Process 22:2225–2234

    Article  Google Scholar 

  15. Kalra A, Li L, Li X, Ahmad S (2012) Improving streamflow forecast lead time using oceanic-atmospheric oscillations for Kaidu River Basin, Xinjiang, China. J Hydrol Eng doi:10.1061/(ASCE)HE.1943-5584.0000707

    Google Scholar 

  16. Karunanithi N, Grenney WJ, Whitley D, Bovee K (1994) Neural networks for river flow prediction. J Comput Civil Eng ASCE 8(2):201–220

    Article  Google Scholar 

  17. Kisi O (2004) River flow modeling using Artificial Neural Networks. J Hydrol Eng ASCE 9(1):60–63

    Article  Google Scholar 

  18. Kisi O (2005) Daily river flow forecasting using artificial neural networks and auto-regressive models. Turk J Eng Env Sci 29:9–20

    Google Scholar 

  19. Kisi O (2007) Streamflow forecasting using different artificial neural network algorithms. J Hydrol Eng ASCE 12(5):532–539

    Article  Google Scholar 

  20. Kisi O (2008) River flow forecasting and estimation using different artificial neural network techniques. Hydrol Res 39(1):27–40

    Article  Google Scholar 

  21. Kisi O, Moghaddam Nia A, Ghafari Gosheh M, Jamalizadeh Tajabadi MR, Ahmadi A (2012) Intermittent streamflow forecasting by using several data driven techniques. Water Resour Manage 26(2):457–474

    Article  Google Scholar 

  22. Kumar APS, Sudheer KP, Jain SK, Agarwal PK (2005) Rainfall-runoff modeling using artificial neural networks: comparison of network types. Hydrol Process 19:1277–1291

    Article  Google Scholar 

  23. Maier HR, Dandy GC (2000) Neural networks for the prediction and forecasting of water resources variables: a review of modeling issues and applications. Environ Model Soft 15:101–124

    Article  Google Scholar 

  24. Marofi S, Tabari H, Zare Abyaneh H (2011) Predicting spatial distribution of snow water equivalent using multivariate non-linear regression and computational intelligence methods. Water Resour Manage 25:1417–1435

    Article  Google Scholar 

  25. Masters T (1993) Practical neural network recipes in C++. Academic Press, San Diego

    Google Scholar 

  26. Modarres R (2009) Multi-criteria validation of artificial neural network rainfall–runoff modeling. Hydrol Earth Syst Sci 13:411–421

    Article  Google Scholar 

  27. Moradkhani H, Hsu K-L, Gupta HV, Sorooshian S (2004) Improved streamflow forecasting using self-organizing radial basis function artificial neural networks. J Hydrol 295(1–4):246–262

    Article  Google Scholar 

  28. More JJ (1977) The Levenberg—Marquardt algorithm: implementation and theory, numerical analysis. In: Watson GA (ed) Lecture notes in mathematics 630. Springer, New York, pp 105–116

    Google Scholar 

  29. Nayak PC, Sudheer KP, Rangan DM, Ramasastri KS (2005) Short-term flood forecasting with a neurofuzzy model. Water Resour Res 41:W04004. doi:10.1029/2004WR003562

    Google Scholar 

  30. Reed RD, Marks RJ (1998) Neural smithing: supervised learning in feedforward artificial neural networks. MIT Press, Cambridge, pp 163–204

    Google Scholar 

  31. Rezaeian Zadeh M, Amin S, Khalili D, Singh VP (2010) Daily outflow prediction by multilayer perceptron with logistic sigmoid and tangent sigmoid activation functions. Water Resour Manage 24(11):2673–2688

    Article  Google Scholar 

  32. Rezaeian-Zadeh M, Tabari H, Abghari H (2012) Prediction of monthly discharge volume by different artificial neural network algorithms in semi-arid regions. Arab J Geosci. doi:10.1007/s12517-011-0517-y

    Google Scholar 

  33. Riedmiller M, Braun H (1993) A direct adaptive method for faster back propagation learning: the RPROP algorithm. Proceedings of IEEE international joint conference on neural networks, San Francisco, pp 586–591

  34. Shahin MA, Jaksa MB, Maier HR (2008) State of the art of artificial neural networks in geotechnical engineering. Electron. J Geotech Engin 8:1–26

    Google Scholar 

  35. Shamseldin AY (1997) Application of neural network technique to rainfall-runoff modeling. J Hydrol 199(3–4):272–294

    Article  Google Scholar 

  36. Sivakumar B, Jayawardena AW, Fernando TMKG (2002) River flow forecasting: use of phase-space reconstruction and artificial neural networks approaches. J Hydrol 265:225–245

    Article  Google Scholar 

  37. Smith GN (1986) Probability and statistics in civil engineering: An introduction. Collins, London

    Google Scholar 

  38. Smith M (1993) Neural networks for statistical modeling. Wiley, New York

    MATH  Google Scholar 

  39. Sudheer KP, Gosain AK, Ramasastri KS (2002) A data driven algorithm for constructing artificial neural network rainfall-runoff models. Hydrol Process 16(6):1325–1330

    Article  Google Scholar 

  40. Sudheer KP, Jain A (2004) Explaining the internal behaviour of artificial neural network river flow models. Hydrol Process 18(4):833–844

    Article  Google Scholar 

  41. Tabari H, Hosseinzadeh Talaee P (2012) Multilayer perceptron for reference evapotranspiration estimation in a semiarid region. Neural Comput Appl. doi:10.1007/s00521-012-0904-7

    Google Scholar 

  42. Tabari H, Marofi S, Sabziparvar AA (2010) Estimation of daily pan evaporation using artificial neural network and multivariate non-linear regression. Irrig Sci 28:399–406

    Article  Google Scholar 

  43. Tabari H, Marofi S, Zare Abyaneh H, Sharifi MR (2010) Comparison of artificial neural network and combined models in estimating spatial distribution of snow depth and snow water equivalent in Samsami basin of Iran. Neural Comput Applic 19:625–635

    Article  Google Scholar 

  44. Tabari H, Sabziparvar AA, Ahmadi M (2011) Comparison of artificial neural network and multivariate linear regression methods for estimation of daily soil temperature in an arid region. Meteor Atmos Phys 110:135–142

    Article  Google Scholar 

  45. Tokar AS, Johnson A (1999) Rainfall-runoff modeling using artificial neural networks. J Hydrol Eng ASCE 4(3):232–239

    Article  Google Scholar 

  46. Tokar AS, Markus M (2000) Precipitation-runoff modeling using artificial neural networks and conceptual models. J. Hydrol. Eng. ASCE 5(2):156–161

    Article  Google Scholar 

  47. Twomey JM, Smith AE (1997) Validation and verification. In: Kartam N, Flood I, Garrett JH (eds) Artificial neural networks for civil engineers: Fundamentals and applications. ASCE, New York, pp 44–64

    Google Scholar 

  48. Wang W, Van Gelder PHAJM, Vrijling JK, Ma J (2006) Forecasting daily streamflow using hybrid ANN models. J Hydrol 324(1–2):383–399

    Article  Google Scholar 

  49. Wu JS, Han J, Annambhotla S, Bryant S (2005) Artificial Neural Networks for Forecasting Watershed Runoff and Stream Flows. J Hydrol Eng ASCE 10(3):216–222

    Article  Google Scholar 

  50. Yadav D, Naresh R, Sharma V (2011) Stream flow forecasting using Levenberg-Marquardt algorithm approach. Int J Water Resour Environ Eng 3(1):30–40

    Google Scholar 

  51. Yonaba H, Anctil F, Fortin V (2010) Comparing sigmoid transfer functions for neural network multistep ahead streamflow forecasting. J Hydrol Eng ASCE 15(4):275–283

    Article  Google Scholar 

  52. Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecasting 14:35–62

    Article  Google Scholar 

Download references

Acknowledgments

The data used to carry out this research were provided by Surface Water Office of Fars Regional Water Affair.

Author information

Authors and Affiliations

  1. Young Researchers Club, Hamedan Branch, Islamic Azad University, Hamedan, Iran

    P. Hosseinzadeh Talaee

Authors
  1. P. Hosseinzadeh Talaee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. Hosseinzadeh Talaee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hosseinzadeh Talaee, P. Multilayer perceptron with different training algorithms for streamflow forecasting. Neural Comput & Applic 24, 695–703 (2014). https://doi.org/10.1007/s00521-012-1287-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-012-1287-5

Keywords

Search

Navigation