Skip to main content

Applying Anomaly Detection Models in Wastewater Management: A Case Study of Nitrates Concentration in the Effluent

  • Conference paper
  • First Online:
Advances in Artificial Intelligence – IBERAMIA 2022 (IBERAMIA 2022)

Abstract

With an increase in the diversity of data that companies in our society produce today, extracting insights from them manually has become an arduous task. One of the processes of extracting knowledge from the data is the application of anomaly detection models, which allows for finding unusual patterns in a given dataset. The application of these models in the context of Wastewater Treatment Plants (WWTPs) can improve water quality monitoring in these facilities, alerting decision-makers to act more quickly and effectively on anomalous events. Hence, this study aims to conceive and evaluate several candidate models based on Isolations Forest and Long Short-Term Memory-Autoencoders (LSTM-AE) to detect anomalies in the WWTP effluent, namely in the concentration of nitrates. Considering the obtained results, the best candidate was the LSTM-AE-based model, which had the best performance with an F1-Score of 97% and an AUC-ROC of 98%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Pang, G., Shen, C., Cao, L., Hengel, A.V.D.: Deep learning for anomaly detection: a review. ACM Comput. Surv. (CSUR) 54(2), 1–38 (2021). https://doi.org/10.1145/3439950

    Article  Google Scholar 

  2. Zenati, H., Romain, M., Foo, C. S., Lecouat, B., Chandrasekhar, V. (2018, November). Adversarially learned anomaly detection. In 2018 IEEE International conference on data mining (ICDM) (pp. 727–736). IEEE. https://doi.org/10.1109/ICDM.2018.00088

  3. Cook, A.A., Mısırlı, G., Fan, Z.: Anomaly detection for IoT time-series data: a survey. IEEE Internet Things J. 7(7), 6481–6494 (2019). https://doi.org/10.1109/JIOT.2019.2958185

    Article  Google Scholar 

  4. Nassif, A.B., Talib, M.A., Nasir, Q., Dakalbab, F.M.: Machine learning for anomaly detection: a systematic review. IEEE Access (2021). https://doi.org/10.1109/ACCESS.2021.3083060

    Article  Google Scholar 

  5. Yun, Y., Li, Z., Chen, Y.H., Saino, M., Cheng, S., Zheng, L.: Elimination of nitrate in secondary effluent of wastewater treatment plants by Fe0 and Pd-Cu/diatomite. J. Water Reuse Desalination 8(1), 29–37 (2018). https://doi.org/10.2166/wrd.2016.122

    Article  Google Scholar 

  6. Mamandipoor, B., Majd, M., Sheikhalishahi, S., Modena, C., Osmani, V.: Monitoring and detecting faults in wastewater treatment plants using deep learning. Environ. Monit. Assess. 192(2), 1–12 (2020). https://doi.org/10.1007/s10661-020-8064-1

    Article  Google Scholar 

  7. Li, Z., Zhang, C., Liu, H., Zhang, C., Zhao, M., Gong, Q., Fu, G.: Developing stacking ensemble models for multivariate contamination detection in water distribution systems. Sci. Total Environ. 828, 154284 (2022). https://doi.org/10.1016/j.scitotenv.2022.154284

    Article  Google Scholar 

  8. Farhi, N., Kohen, E., Mamane, H., Shavitt, Y.: Prediction of wastewater treatment quality using LSTM neural network. Environ. Technol. Innov. 23, 101632 (2021). https://doi.org/10.1016/j.eti.2021.101632

    Article  Google Scholar 

  9. Tharwat, A.: Classification assessment methods. Appl. Comput. Inform. (2020). https://doi.org/10.1016/j.aci.2018.08.003

    Article  Google Scholar 

  10. Muschelli, J.: ROC and AUC with a binary predictor: a potentially misleading metric. J. Classif. 37(3), 696–708 (2019). https://doi.org/10.1007/s00357-019-09345-1

    Article  MathSciNet  MATH  Google Scholar 

  11. Al Farizi, W. S., Hidayah, I., Rizal, M.N.: isolation forest based anomaly detection: a systematic literature review. In: 2021 8th International Conference on Information Technology, Computer and Electrical Engineering (ICITACEE), pp. 118–122. IEEE, September 2021. https://doi.org/10.1109/ICITACEE53184.2021.9617498

  12. Tran, P.H., Heuchenne, C., Thomassey, S.: An anomaly detection approach based on the combination of LSTM autoencoder and isolation forest for multivariate time series data. In Developments of Artificial Intelligence Technologies in Computation and Robotics: Proceedings of the 14th International FLINS Conference (FLINS 2020), pp. 589–596 (2020). https://doi.org/10.1142/9789811223334_0071

Download references

Acknowledgments

This work is financed by National Funds through the Portuguese funding agency, FCT - Fundação para a Ciência e a Tecnologia within project DSAIPA/AI/0099/2019.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pedro Oliveira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Oliveira, P., Duarte, M.S., Novais, P. (2022). Applying Anomaly Detection Models in Wastewater Management: A Case Study of Nitrates Concentration in the Effluent. In: Bicharra Garcia, A.C., Ferro, M., Rodríguez Ribón, J.C. (eds) Advances in Artificial Intelligence – IBERAMIA 2022. IBERAMIA 2022. Lecture Notes in Computer Science(), vol 13788. Springer, Cham. https://doi.org/10.1007/978-3-031-22419-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22419-5_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22418-8

  • Online ISBN: 978-3-031-22419-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics