Abstract
Accurate and efficient models for rainfall–runoff (RR) simulations are crucial for flood risk management. Recently, the success of the recurrent neural network (RNN) applied to sequential models has motivated groups to pursue RR modeling using RNN. Existing RNN based methods generally use either sequence input single output or unsynced sequence input and output architectures. In this paper, we propose a synced sequence input and output long short-term memory (LSTM) network architecture for hydrologic analysis and compare it to existing methods (sequence input single output LSTM). We expect the model will improve RR prediction in terms of accuracy, calibration training time, and computational cost. The key idea is to efficiently learn the long term dependency of runoff on past rainfall history. To be more specific, we use the indigenous ability of the LSTM network to preserve long term memory instead of artificially setting a time window for input data. In this way, we can avoid losing long term memory of the input, the calibration of the time window length, and excessive computation. The whole procedure mimics the traditional process-driven methods and is closer to the physics interpretation of the RR process. We conducted experiments on real-world hydrologic data from the Brays Bayou in Houston, Texas. Extensive experimental results clearly validate the effectiveness of our proposed method in terms of various statistical and hydrological related evaluation metrics. Notably, our experiment shows that some rainfall events could affect the runoff process in the test watershed for at least a week. For fine temporal resolution prediction, this long term effect needs to be carefully handled, and our proposed method is superior in this case.





Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
NOAA National Centers for Environmental Information (NCEI) (2018) U.S. billion-dollar weather and climate disasters. https://www.ncdc.noaa.gov/billions/. Accessed 20 Aug 2008
Duan Q, Sorooshian S, Gupta V (1992) Effective and efficient global optimization for conceptual rainfall–runoff models. Water Resour Res. https://doi.org/10.1029/91WR02985
Pappenberger F, Beven KJ, Hunter NM et al (2005) Cascading model uncertainty from medium range weather forecasts (10 days) through a rainfall–runoff model to flood inundation predictions within the European Flood Forecasting System (EFFS). Hydrol Earth Syst Sci. https://doi.org/10.5194/hess-9-381-2005
Lili W, Hongjun B, Yu S, Zhongbo Y (2008) Rainfall–runoff simulation and flood forecasting for Huaihe Basin. Water Sci Eng 1:24–35
Talchabhadel R, Shakya NM, Dahal V, Eslamian S (2015) Rainfall runoff modelling for flood forecasting (a case study on west rapti watershed). J Flood Eng 6:53–61
Bedient PB, Holder A, Benavides JA, Vieux BE (2003) Radar-based flood warning system applied to tropical storm allison. J Hydrol Eng. https://doi.org/10.1061/(ASCE)1084-0699(2003)8:6(308)
Downer CW, Ogden FL (2004) GSSHA: model to simulate diverse stream flow producing processes. J Hydrol Eng. https://doi.org/10.1061/(ASCE)1084-0699(2004)9:3(161)
A.C.E. US (2010) HEC-RAS river analysis system. User’s manual, version 41. https://www.hec.usace.army.mil/software/hec-ras/documentation/HEC-RAS%205.0%20Reference%20Manual.pdf
Dawson CW, Wilby R (1998) An artificial neural network approach to rainfall–runoff modelling. Hydrol Sci J. https://doi.org/10.1080/02626669809492102
Young CC, Liu WC, Wu MC (2017) A physically based and machine learning hybrid approach for accurate rainfall–runoff modeling during extreme typhoon events. Appl Soft Comput J. https://doi.org/10.1016/j.asoc.2016.12.052
Sudheer KP, Gosain AK, Ramasastri KS (2002) A data-driven algorithm for constructing artificial neural network rainfall–runoff models. Hydrol Process. https://doi.org/10.1002/hyp.554
Hettiarachchi P, Hall MJ, Minns AW (2005) The extrapolation of artificial neural networks for the modelling of rainfall–runoff relationships. J Hydroinform. https://doi.org/10.2166/hydro.2005.0025
Srinivasulu S, Jain A (2006) A comparative analysis of training methods for artificial neural network rainfall–runoff models. Appl Soft Comput J. https://doi.org/10.1016/j.asoc.2005.02.002
Taver V, Johannet A, Borrell-Estupina V, Pistre S (2015) Feed-forward vs recurrent neural network models for non-stationarity modelling using data assimilation and adaptivity. Hydrol Sci J. https://doi.org/10.1080/02626667.2014.967696
Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertainty Fuzziness Knowl Based Syst. https://doi.org/10.1142/S0218488598000094
Gers FA, Schmidhuber J, Cummins F (2000) Learning to forget: continual prediction with LSTM. Neural Comput. https://doi.org/10.1162/089976600300015015
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
Tian Y, Xu YP, Yang Z et al (2018) Integration of a parsimonious hydrological model with recurrent neural networks for improved streamflow forecasting. Water (Switzerland). https://doi.org/10.3390/w10111655
Mhammedi Z, Hellicar A, Rahman A et al (2016) Recurrent neural networks for one day ahead prediction of stream flow. In: ACM international conference proceeding series
Kratzert F, Klotz D, Brenner C et al (2018) Rainfall–runoff modelling using long short-term memory (LSTM) networks. Hydrol Earth Syst Sci. https://doi.org/10.5194/hess-22-6005-2018
Wu Y, Liu Z, Xu W et al (2018) Context-aware attention LSTM network for flood prediction. In: Proceedings—international conference on pattern recognition
Yuan X, Chen C, Lei X et al (2018) Monthly runoff forecasting based on LSTM–ALO model. Stoch Environ Res Risk Assess. https://doi.org/10.1007/s00477-018-1560-y
Le X-H, Ho VH, Lee G, Jung S (2019) Application of long short-term memory (LSTM) neural network for flood forecasting. Water 11:1387
Kratzert F, Klotz D, Shalev G et al (2019) Benchmarking a catchment-aware long short-term memory network (LSTM) for large-scale hydrological modeling. Hydrol Earth Syst Sci Discuss. https://doi.org/10.5194/hess-2019-368
Hu C, Wu Q, Li H et al (2018) Deep learning with a long short-term memory networks approach for rainfall–runoff simulation. Water 10:1543
Kao I-F, Zhou Y, Chang L-C, Chang F-J (2020) Exploring a long short-term memory based encoder–decoder framework for multi-step-ahead flood forecasting. J Hydrol. https://doi.org/10.1016/J.JHYDROL.2020.124631
Widiasari IR, Nugoho LE, Widyawan, Efendi R (2018) Context-based hydrology time series data for a flood prediction model using LSTM. In: Proceedings—2018 5th international conference on information technology, computer and electrical engineering, ICITACEE 2018
NOAA (2009) NOAA water level and meteorological data report: Hurricane Ike. Maryland
Li W, Kiaghadi A, Dawson CN (2020) High temporal resolution rainfall runoff modelling using long-short-term-memory (LSTM) networks. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05010-6
Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980
Phuong TT, Trieu Phong L (2019) On the convergence proof of AMSGrad and a new version. arXiv:1904.03590
Paszke A, Chanan G, Lin Z et al (2017) Automatic differentiation in PyTorch. In: 31st conference on neural information processing systems
Rathje EM, Clint D, Padgett JE et al (2017) DesignSafe: new cyberinfrastructure for natural hazards engineering. Nat Hazards Rev 18:6017001. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000246
De Giorgi MG, Campilongo S, Ficarella A, Congedo PM (2014) Comparison between wind power prediction models based on wavelet decomposition with least-squares support vector machine (LS-SVM) and artificial neural network (ANN). Energies 7:5251–5272. https://doi.org/10.3390/en7085251
Iacobellis V (2008) Probabilistic model for the estimation of T year flow duration curves. Water Resour Res. https://doi.org/10.1029/2006WR005400
Acknowledgements
This research was funded by the National Oceanic and Atmospheric Administration (NOAA, Grant Number NA18NOS0120158), National Science Foundation (NSF, CMMI-1520817), XSEDE Grant NSF-DMS080016N, and generous support from the Texas Advanced Computing Center.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, W., Kiaghadi, A. & Dawson, C. Exploring the best sequence LSTM modeling architecture for flood prediction. Neural Comput & Applic 33, 5571–5580 (2021). https://doi.org/10.1007/s00521-020-05334-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05334-3