Skip to main content
Log in

Exploring the best sequence LSTM modeling architecture for flood prediction

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Accurate and efficient models for rainfall–runoff (RR) simulations are crucial for flood risk management. Recently, the success of the recurrent neural network (RNN) applied to sequential models has motivated groups to pursue RR modeling using RNN. Existing RNN based methods generally use either sequence input single output or unsynced sequence input and output architectures. In this paper, we propose a synced sequence input and output long short-term memory (LSTM) network architecture for hydrologic analysis and compare it to existing methods (sequence input single output LSTM). We expect the model will improve RR prediction in terms of accuracy, calibration training time, and computational cost. The key idea is to efficiently learn the long term dependency of runoff on past rainfall history. To be more specific, we use the indigenous ability of the LSTM network to preserve long term memory instead of artificially setting a time window for input data. In this way, we can avoid losing long term memory of the input, the calibration of the time window length, and excessive computation. The whole procedure mimics the traditional process-driven methods and is closer to the physics interpretation of the RR process. We conducted experiments on real-world hydrologic data from the Brays Bayou in Houston, Texas. Extensive experimental results clearly validate the effectiveness of our proposed method in terms of various statistical and hydrological related evaluation metrics. Notably, our experiment shows that some rainfall events could affect the runoff process in the test watershed for at least a week. For fine temporal resolution prediction, this long term effect needs to be carefully handled, and our proposed method is superior in this case.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. NOAA National Centers for Environmental Information (NCEI) (2018) U.S. billion-dollar weather and climate disasters. https://www.ncdc.noaa.gov/billions/. Accessed 20 Aug 2008

  2. Duan Q, Sorooshian S, Gupta V (1992) Effective and efficient global optimization for conceptual rainfall–runoff models. Water Resour Res. https://doi.org/10.1029/91WR02985

    Article  Google Scholar 

  3. Pappenberger F, Beven KJ, Hunter NM et al (2005) Cascading model uncertainty from medium range weather forecasts (10 days) through a rainfall–runoff model to flood inundation predictions within the European Flood Forecasting System (EFFS). Hydrol Earth Syst Sci. https://doi.org/10.5194/hess-9-381-2005

    Article  Google Scholar 

  4. Lili W, Hongjun B, Yu S, Zhongbo Y (2008) Rainfall–runoff simulation and flood forecasting for Huaihe Basin. Water Sci Eng 1:24–35

    Google Scholar 

  5. Talchabhadel R, Shakya NM, Dahal V, Eslamian S (2015) Rainfall runoff modelling for flood forecasting (a case study on west rapti watershed). J Flood Eng 6:53–61

    Google Scholar 

  6. Bedient PB, Holder A, Benavides JA, Vieux BE (2003) Radar-based flood warning system applied to tropical storm allison. J Hydrol Eng. https://doi.org/10.1061/(ASCE)1084-0699(2003)8:6(308)

    Article  Google Scholar 

  7. Downer CW, Ogden FL (2004) GSSHA: model to simulate diverse stream flow producing processes. J Hydrol Eng. https://doi.org/10.1061/(ASCE)1084-0699(2004)9:3(161)

    Article  Google Scholar 

  8. A.C.E. US (2010) HEC-RAS river analysis system. User’s manual, version 41. https://www.hec.usace.army.mil/software/hec-ras/documentation/HEC-RAS%205.0%20Reference%20Manual.pdf

  9. Dawson CW, Wilby R (1998) An artificial neural network approach to rainfall–runoff modelling. Hydrol Sci J. https://doi.org/10.1080/02626669809492102

    Article  Google Scholar 

  10. Young CC, Liu WC, Wu MC (2017) A physically based and machine learning hybrid approach for accurate rainfall–runoff modeling during extreme typhoon events. Appl Soft Comput J. https://doi.org/10.1016/j.asoc.2016.12.052

    Article  Google Scholar 

  11. Sudheer KP, Gosain AK, Ramasastri KS (2002) A data-driven algorithm for constructing artificial neural network rainfall–runoff models. Hydrol Process. https://doi.org/10.1002/hyp.554

    Article  Google Scholar 

  12. Hettiarachchi P, Hall MJ, Minns AW (2005) The extrapolation of artificial neural networks for the modelling of rainfall–runoff relationships. J Hydroinform. https://doi.org/10.2166/hydro.2005.0025

    Article  Google Scholar 

  13. Srinivasulu S, Jain A (2006) A comparative analysis of training methods for artificial neural network rainfall–runoff models. Appl Soft Comput J. https://doi.org/10.1016/j.asoc.2005.02.002

    Article  Google Scholar 

  14. Taver V, Johannet A, Borrell-Estupina V, Pistre S (2015) Feed-forward vs recurrent neural network models for non-stationarity modelling using data assimilation and adaptivity. Hydrol Sci J. https://doi.org/10.1080/02626667.2014.967696

    Article  Google Scholar 

  15. Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertainty Fuzziness Knowl Based Syst. https://doi.org/10.1142/S0218488598000094

    Article  MATH  Google Scholar 

  16. Gers FA, Schmidhuber J, Cummins F (2000) Learning to forget: continual prediction with LSTM. Neural Comput. https://doi.org/10.1162/089976600300015015

    Article  Google Scholar 

  17. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735

    Article  Google Scholar 

  18. Tian Y, Xu YP, Yang Z et al (2018) Integration of a parsimonious hydrological model with recurrent neural networks for improved streamflow forecasting. Water (Switzerland). https://doi.org/10.3390/w10111655

    Article  Google Scholar 

  19. Mhammedi Z, Hellicar A, Rahman A et al (2016) Recurrent neural networks for one day ahead prediction of stream flow. In: ACM international conference proceeding series

  20. Kratzert F, Klotz D, Brenner C et al (2018) Rainfall–runoff modelling using long short-term memory (LSTM) networks. Hydrol Earth Syst Sci. https://doi.org/10.5194/hess-22-6005-2018

    Article  Google Scholar 

  21. Wu Y, Liu Z, Xu W et al (2018) Context-aware attention LSTM network for flood prediction. In: Proceedings—international conference on pattern recognition

  22. Yuan X, Chen C, Lei X et al (2018) Monthly runoff forecasting based on LSTM–ALO model. Stoch Environ Res Risk Assess. https://doi.org/10.1007/s00477-018-1560-y

    Article  Google Scholar 

  23. Le X-H, Ho VH, Lee G, Jung S (2019) Application of long short-term memory (LSTM) neural network for flood forecasting. Water 11:1387

    Article  Google Scholar 

  24. Kratzert F, Klotz D, Shalev G et al (2019) Benchmarking a catchment-aware long short-term memory network (LSTM) for large-scale hydrological modeling. Hydrol Earth Syst Sci Discuss. https://doi.org/10.5194/hess-2019-368

    Article  Google Scholar 

  25. Hu C, Wu Q, Li H et al (2018) Deep learning with a long short-term memory networks approach for rainfall–runoff simulation. Water 10:1543

    Article  Google Scholar 

  26. Kao I-F, Zhou Y, Chang L-C, Chang F-J (2020) Exploring a long short-term memory based encoder–decoder framework for multi-step-ahead flood forecasting. J Hydrol. https://doi.org/10.1016/J.JHYDROL.2020.124631

    Article  Google Scholar 

  27. Widiasari IR, Nugoho LE, Widyawan, Efendi R (2018) Context-based hydrology time series data for a flood prediction model using LSTM. In: Proceedings—2018 5th international conference on information technology, computer and electrical engineering, ICITACEE 2018

  28. NOAA (2009) NOAA water level and meteorological data report: Hurricane Ike. Maryland

  29. Li W, Kiaghadi A, Dawson CN (2020) High temporal resolution rainfall runoff modelling using long-short-term-memory (LSTM) networks. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05010-6

    Article  Google Scholar 

  30. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980

  31. Phuong TT, Trieu Phong L (2019) On the convergence proof of AMSGrad and a new version. arXiv:1904.03590

  32. Paszke A, Chanan G, Lin Z et al (2017) Automatic differentiation in PyTorch. In: 31st conference on neural information processing systems

  33. Rathje EM, Clint D, Padgett JE et al (2017) DesignSafe: new cyberinfrastructure for natural hazards engineering. Nat Hazards Rev 18:6017001. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000246

    Article  Google Scholar 

  34. De Giorgi MG, Campilongo S, Ficarella A, Congedo PM (2014) Comparison between wind power prediction models based on wavelet decomposition with least-squares support vector machine (LS-SVM) and artificial neural network (ANN). Energies 7:5251–5272. https://doi.org/10.3390/en7085251

    Article  Google Scholar 

  35. Iacobellis V (2008) Probabilistic model for the estimation of T year flow duration curves. Water Resour Res. https://doi.org/10.1029/2006WR005400

    Article  Google Scholar 

Download references

Acknowledgements

This research was funded by the National Oceanic and Atmospheric Administration (NOAA, Grant Number NA18NOS0120158), National Science Foundation (NSF, CMMI-1520817), XSEDE Grant NSF-DMS080016N, and generous support from the Texas Advanced Computing Center.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amin Kiaghadi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, W., Kiaghadi, A. & Dawson, C. Exploring the best sequence LSTM modeling architecture for flood prediction. Neural Comput & Applic 33, 5571–5580 (2021). https://doi.org/10.1007/s00521-020-05334-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05334-3

Keywords

Navigation