Abstract
With an increase in the diversity of data that companies in our society produce today, extracting insights from them manually has become an arduous task. One of the processes of extracting knowledge from the data is the application of anomaly detection models, which allows for finding unusual patterns in a given dataset. The application of these models in the context of Wastewater Treatment Plants (WWTPs) can improve water quality monitoring in these facilities, alerting decision-makers to act more quickly and effectively on anomalous events. Hence, this study aims to conceive and evaluate several candidate models based on Isolations Forest and Long Short-Term Memory-Autoencoders (LSTM-AE) to detect anomalies in the WWTP effluent, namely in the concentration of nitrates. Considering the obtained results, the best candidate was the LSTM-AE-based model, which had the best performance with an F1-Score of 97% and an AUC-ROC of 98%.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Pang, G., Shen, C., Cao, L., Hengel, A.V.D.: Deep learning for anomaly detection: a review. ACM Comput. Surv. (CSUR) 54(2), 1–38 (2021). https://doi.org/10.1145/3439950
Zenati, H., Romain, M., Foo, C. S., Lecouat, B., Chandrasekhar, V. (2018, November). Adversarially learned anomaly detection. In 2018 IEEE International conference on data mining (ICDM) (pp. 727–736). IEEE. https://doi.org/10.1109/ICDM.2018.00088
Cook, A.A., Mısırlı, G., Fan, Z.: Anomaly detection for IoT time-series data: a survey. IEEE Internet Things J. 7(7), 6481–6494 (2019). https://doi.org/10.1109/JIOT.2019.2958185
Nassif, A.B., Talib, M.A., Nasir, Q., Dakalbab, F.M.: Machine learning for anomaly detection: a systematic review. IEEE Access (2021). https://doi.org/10.1109/ACCESS.2021.3083060
Yun, Y., Li, Z., Chen, Y.H., Saino, M., Cheng, S., Zheng, L.: Elimination of nitrate in secondary effluent of wastewater treatment plants by Fe0 and Pd-Cu/diatomite. J. Water Reuse Desalination 8(1), 29–37 (2018). https://doi.org/10.2166/wrd.2016.122
Mamandipoor, B., Majd, M., Sheikhalishahi, S., Modena, C., Osmani, V.: Monitoring and detecting faults in wastewater treatment plants using deep learning. Environ. Monit. Assess. 192(2), 1–12 (2020). https://doi.org/10.1007/s10661-020-8064-1
Li, Z., Zhang, C., Liu, H., Zhang, C., Zhao, M., Gong, Q., Fu, G.: Developing stacking ensemble models for multivariate contamination detection in water distribution systems. Sci. Total Environ. 828, 154284 (2022). https://doi.org/10.1016/j.scitotenv.2022.154284
Farhi, N., Kohen, E., Mamane, H., Shavitt, Y.: Prediction of wastewater treatment quality using LSTM neural network. Environ. Technol. Innov. 23, 101632 (2021). https://doi.org/10.1016/j.eti.2021.101632
Tharwat, A.: Classification assessment methods. Appl. Comput. Inform. (2020). https://doi.org/10.1016/j.aci.2018.08.003
Muschelli, J.: ROC and AUC with a binary predictor: a potentially misleading metric. J. Classif. 37(3), 696–708 (2019). https://doi.org/10.1007/s00357-019-09345-1
Al Farizi, W. S., Hidayah, I., Rizal, M.N.: isolation forest based anomaly detection: a systematic literature review. In: 2021 8th International Conference on Information Technology, Computer and Electrical Engineering (ICITACEE), pp. 118–122. IEEE, September 2021. https://doi.org/10.1109/ICITACEE53184.2021.9617498
Tran, P.H., Heuchenne, C., Thomassey, S.: An anomaly detection approach based on the combination of LSTM autoencoder and isolation forest for multivariate time series data. In Developments of Artificial Intelligence Technologies in Computation and Robotics: Proceedings of the 14th International FLINS Conference (FLINS 2020), pp. 589–596 (2020). https://doi.org/10.1142/9789811223334_0071
Acknowledgments
This work is financed by National Funds through the Portuguese funding agency, FCT - Fundação para a Ciência e a Tecnologia within project DSAIPA/AI/0099/2019.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Oliveira, P., Duarte, M.S., Novais, P. (2022). Applying Anomaly Detection Models in Wastewater Management: A Case Study of Nitrates Concentration in the Effluent. In: Bicharra Garcia, A.C., Ferro, M., Rodríguez Ribón, J.C. (eds) Advances in Artificial Intelligence – IBERAMIA 2022. IBERAMIA 2022. Lecture Notes in Computer Science(), vol 13788. Springer, Cham. https://doi.org/10.1007/978-3-031-22419-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-22419-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22418-8
Online ISBN: 978-3-031-22419-5
eBook Packages: Computer ScienceComputer Science (R0)