Abstract
Accurate forecasting of water quality parameters is a significant part of the process of water resource management. In this paper we demonstrate the applicability of Long Short-Term Memory (LSTM) combined with attention mechanism for the long-term forecasting (after 24 h) of Dissolved Oxygen content at various stations of Ganga River flowing through the state of Uttar Pradesh, India. In the given model, the hidden states of the LSTM units are passed to the attention layer. The attention layer then gives different weights to the hidden states based on their relevance. The performance of the models is evaluated using root mean square error, mean absolute error and coefficient of determination. The experimental results indicate that combining attention mechanism with LSTM significantly improves the forecasted values of Dissolved Oxygen when compared with state-of-the-art models like Recurrent Neural Network, LSTM, and bidirectional LSTM. The demonstrated model is particularly useful during the availability of only univariate datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Singh, K.P., Basant, A., Malik, A., Jain, G.: Artificial neural network modeling of the river water quality— a case study. Ecol. Model. 220, 888–895 (2009). https://doi.org/10.1016/j.ecolmodel.2009.01.004
Ruben, G.B., Zhang, K., Bao, H., Ma, X.: Application and sensitivity analysis of artificial neural network for prediction of chemical oxygen demand. Water Resour. Manag. 32(1), 273–283 (2017). https://doi.org/10.1007/s11269-017-1809-0
Yeon, I.S., Kim, J.H., Jun, K.W.: Application of artificial intelligence models in water quality forecasting. Environ. Technol. 29(6), 625–631 (2008). https://doi.org/10.1080/09593330801984456
Rankovic, V., Radulovic, J., Radojevic, I., Ostojic, A., Comic, L.: Neural network modeling of dissolved oxygen in the Gruza reservoir, Serbia. Ecol. Model. 221(8), 1239–1244 (2010)
Emamgholizadeh, S., Kashi, H., Marofpoor, I., Zalaghi, E.: Prediction of water quality parameters of Karoon river (Iran) by artificial intelligence-based models. Int. J. Environ. Sci. Technol. 11(3), 645–656 (2013). https://doi.org/10.1007/s13762-013-0378-x
Sarkar, A., Pandey, P.: River water quality modelling using artificial neural network technique. Aquatic Procedia 4, 1070–1077 (2015)
Alizadeh, M.J., Kavianpour, M.R.: Development of wavelet-ANN models to predict water quality parameters in Hilo Bay, Pacific ocean. Mar. Pollut. Bull. 98(1), 171–178 (2015)
Csábrági, A., Molnár, S., Tanos, P., Kovács, J.: Application of artificial neural networks to the forecasting of dissolved oxygen content in the Hungarian section of the river Danube. Ecol. Eng. 100, 63–72 (2017). https://doi.org/10.1016/j.ecoleng.2016.12.027
Zou, Q., Xiong, Q., Li, Q., Yi, H., Yu, Y., Wu, C.: A water quality prediction method based on the multi-time scale bidirectional long short-term memory network. Environ. Sci. Pollut. Res. 27(14), 16853–16864 (2020). https://doi.org/10.1007/s11356-020-08087-7
Li, Z., Peng, F., Niu, B., Li, G., Wu, J., Miao, Z.: Water quality prediction model combining sparse auto-encoder and LSTM network. IFAC-PapersOnLine 51(17), 831–836 (2018)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: ICLR (2015)
Niu, Z., Yu, Z., Tang, W., Wu, Q., Reformat, M.: Wind power forecasting using attention-based gated recurrent unit network. Energy 196, 117081 (2020)
Ding, Y.K., Zhu, Y.L., Feng, J., Zhang, P.C., Cheng, Z.R.: Interpretable spatio-temporal attention LSTM model for flood forecasting. Neurocomputing 403, 348–359 (2020)
Zang, H., Xu, R., Cheng, L., Ding, T., Liu, L., Wei, Z., Sun, G.: Residential load forecasting based on LSTM fusing self-attention mechanism with pooling. Energy, 229, 120682, ISSN 0360-5442 (2021). https://doi.org/10.1016/j.energy.2021.120682
Liu, Y., Zhang, Q., Song, L., Chen, Y.: Attention-based recurrent neural networks for accurate short-term and long-term dissolved oxygen prediction. Comput. Electron. Agric. 165, Article 104964 (2019). https://doi.org/10.1016/j.compag.2019.104964
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Guo, F.F., Li, L.P., Wei, C.H.: Short term load forecasting based on phase space reconstruction algorithm and bi-square kernel regression model. Appl. Energy 224, 13–33 (2018)
Kim, T.Y., Cho, S.B.: Predicting residential energy consumption using CNN-LSTM neural networks. Energy 182, 72–81 (2019)
Chang, Y.S., Chiao, H.T., Abimannan, S., Huang, Y.P., Tsai, Y.T., Lin, K.M.: An LSTM-based aggregated model for air pollution forecasting. Atmos. Pollut. Res. 11, 1451–1463 (2020)
Xu, Y., Hu, C., Wu, Q., Jian, S., Li, Z., Chen, Y., Wang, S.: Research on particle swarm optimization in LSTM neural networks for rainfall-runoff simulation. J. Hydrol. 608, Article 127553 (2022). https://doi.org/10.1016/j.jhydrol.2022.127553
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Pant, N., Toshniwal, D., Gurjar, B.R. (2023). Application of Attention Mechanism Combined with Long Short-Term Memory for Forecasting Dissolved Oxygen in Ganga River. In: Guyet, T., Ifrim, G., Malinowski, S., Bagnall, A., Shafer, P., Lemaire, V. (eds) Advanced Analytics and Learning on Temporal Data. AALTD 2022. Lecture Notes in Computer Science(), vol 13812. Springer, Cham. https://doi.org/10.1007/978-3-031-24378-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-24378-3_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-24377-6
Online ISBN: 978-3-031-24378-3
eBook Packages: Computer ScienceComputer Science (R0)
