Skip to main content

Indecision-Aware Deep Active Anomaly Detection

  • Conference paper
  • First Online:
Intelligent Data Engineering and Automated Learning – IDEAL 2024 (IDEAL 2024)

Abstract

This work introduces the \(\mathrm {AE\!-\!AAD}\) algorithm, for Active Anomaly Detection through Auto-Encoders. Differently from pure unsupervised approaches, the algorithm has the possibility to improve output quality by incorporating the knowledge encoded by query answers. Specifically, we train an autoencoder-based architecture to directly reconstruct normally labelled and unlabelled examples and to maximize the difference between anomalously labelled examples and their reconstruction. Being the method aware of the target associated with both normal and abnormal data, we can introduce a notion of indecision which quantifies the maximum amount of deviation of a specific instance from its possible target reconstructions. Thus, our method is able to better discern between instances that are badly reconstructed because they comply with the anomalous target reconstruction from those that do not really conform to normal behavior. We perform experiments to clarify the behavior of the method and to compare performances with those of alternative anomaly detectors. Experimental results show that our method is able to exploit queries to improve the quality of the anomaly detection and also to ameliorate performances over other active anomaly detection proposals.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. An, J., Cho, S.: Variational autoencoder based anomaly detection using reconstruction probability. Technical Report 3, SNU Data Mining Center (2015)

    Google Scholar 

  2. Angiulli, F., Fassetti, F., Ferragina, L.: LatentOut: an unsupervised deep anomaly detection approach exploiting latent space distribution. Mach. Learn. 112, 4323–4349 (2022)

    Article  Google Scholar 

  3. Angiulli, F., Fassetti, F., Ferragina, L.: Reconstruction error-based anomaly detection with few outlying examples. arXiv preprint arXiv:2305.10464 (2023)

  4. Angiulli, F., Fassetti, F., Ferragina, L., Spada, R.: Cooperative deep unsupervised anomaly detection. In: Discovery Science - 25th International Conference (2022)

    Google Scholar 

  5. Angiulli, F., Pizzuti, C.: Fast outlier detection in large high-dimensional data sets. In: International Conference on Principles of Data Mining and Knowledge Discovery (2002)

    Google Scholar 

  6. Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3) (2009)

    Google Scholar 

  7. Deng, L.: The mnist database of handwritten digit images for machine learning research. IEEE Signal Process. Mag. 29(6), 141–142 (2012)

    Article  Google Scholar 

  8. Faber, K., Corizzo, R., Sniezynski, B., Japkowicz, N.: Active lifelong anomaly detection with experience replay. In: 2022 IEEE 9th International Conference on DSAA (2022)

    Google Scholar 

  9. Hawkins, S., He, H., Williams, G., Baxter, R.: Outlier detection using replicator neural networks. In: International Conference on DAWAK (2002)

    Google Scholar 

  10. Li, A., Qiu, C., Kloft, M., Smyth, P., Mandt, S., Rudolph, M.: Deep anomaly detection under labeling budget constraints. In: International Conference on Machine Learning (2023)

    Google Scholar 

  11. Liu, F., Ting, K., Zhou, Z.H.: Isolation-based anomaly detection. TKDD (2012)

    Google Scholar 

  12. Pang, G., Shen, C., van den Hengel, A.: Deep anomaly detection with deviation networks. In: ACM SIGKDD International Conference on KDD (2019)

    Google Scholar 

  13. Pimentel, T., Monteiro, M., Veloso, A., Ziviani, N.: Deep active learning for anomaly detection. In: International Joint Conference on Neural Networks (IJCNN) (2020)

    Google Scholar 

  14. Ruff, L., et al.: Deep one-class classification. In: ICML (2018)

    Google Scholar 

  15. Ruff, L., et al.: A unifying review of deep and shallow anomaly detection. Proc. IEEE 109(5), 756–795 (2021)

    Article  Google Scholar 

  16. Ruff, L., et al.: Deep semi-supervised anomaly detection. In: ICLR (2020)

    Google Scholar 

  17. Russo, S., Lürig, M., Hao, W., Matthews, B., Villez, K.: Active learning for anomaly detection in environmental data. Environ. Model. Softw. 134, 104869 (2020)

    Article  Google Scholar 

  18. Trittenbach, H., Englhardt, A., Böhm, K.: An overview and a benchmark of active learning for outlier detection with one-class classifiers. Expert Syst. Appl. 168, 114372 (2021)

    Article  Google Scholar 

  19. Wang, W., Chen, P., Xu, Y., He, Z.: Active-mtsad: multivariate time series anomaly detection with active learning. In: IEEE International Conference on Dependable Systems and Networks (2022)

    Google Scholar 

  20. Xiao, H., Rasul, K., Vollgraf, R.: Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. CoRR arxiv:1708.07747 (2017)

Download references

Acknowledgments

We acknowledge the support of the PNRR project FAIR - Future AI Research (PE00000013), Spoke 9 - Green-aware AI, under the NRRP MUR program funded by the NextGenerationEU.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simone Amirato .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Amirato, S., Angiulli, F., Fassetti, F., Ferragina, L. (2025). Indecision-Aware Deep Active Anomaly Detection. In: Julian, V., et al. Intelligent Data Engineering and Automated Learning – IDEAL 2024. IDEAL 2024. Lecture Notes in Computer Science, vol 15347. Springer, Cham. https://doi.org/10.1007/978-3-031-77738-7_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-77738-7_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-77737-0

  • Online ISBN: 978-3-031-77738-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics