Abstract
This work introduces the \(\mathrm {AE\!-\!AAD}\) algorithm, for Active Anomaly Detection through Auto-Encoders. Differently from pure unsupervised approaches, the algorithm has the possibility to improve output quality by incorporating the knowledge encoded by query answers. Specifically, we train an autoencoder-based architecture to directly reconstruct normally labelled and unlabelled examples and to maximize the difference between anomalously labelled examples and their reconstruction. Being the method aware of the target associated with both normal and abnormal data, we can introduce a notion of indecision which quantifies the maximum amount of deviation of a specific instance from its possible target reconstructions. Thus, our method is able to better discern between instances that are badly reconstructed because they comply with the anomalous target reconstruction from those that do not really conform to normal behavior. We perform experiments to clarify the behavior of the method and to compare performances with those of alternative anomaly detectors. Experimental results show that our method is able to exploit queries to improve the quality of the anomaly detection and also to ameliorate performances over other active anomaly detection proposals.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
An, J., Cho, S.: Variational autoencoder based anomaly detection using reconstruction probability. Technical Report 3, SNU Data Mining Center (2015)
Angiulli, F., Fassetti, F., Ferragina, L.: LatentOut: an unsupervised deep anomaly detection approach exploiting latent space distribution. Mach. Learn. 112, 4323–4349 (2022)
Angiulli, F., Fassetti, F., Ferragina, L.: Reconstruction error-based anomaly detection with few outlying examples. arXiv preprint arXiv:2305.10464 (2023)
Angiulli, F., Fassetti, F., Ferragina, L., Spada, R.: Cooperative deep unsupervised anomaly detection. In: Discovery Science - 25th International Conference (2022)
Angiulli, F., Pizzuti, C.: Fast outlier detection in large high-dimensional data sets. In: International Conference on Principles of Data Mining and Knowledge Discovery (2002)
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3) (2009)
Deng, L.: The mnist database of handwritten digit images for machine learning research. IEEE Signal Process. Mag. 29(6), 141–142 (2012)
Faber, K., Corizzo, R., Sniezynski, B., Japkowicz, N.: Active lifelong anomaly detection with experience replay. In: 2022 IEEE 9th International Conference on DSAA (2022)
Hawkins, S., He, H., Williams, G., Baxter, R.: Outlier detection using replicator neural networks. In: International Conference on DAWAK (2002)
Li, A., Qiu, C., Kloft, M., Smyth, P., Mandt, S., Rudolph, M.: Deep anomaly detection under labeling budget constraints. In: International Conference on Machine Learning (2023)
Liu, F., Ting, K., Zhou, Z.H.: Isolation-based anomaly detection. TKDD (2012)
Pang, G., Shen, C., van den Hengel, A.: Deep anomaly detection with deviation networks. In: ACM SIGKDD International Conference on KDD (2019)
Pimentel, T., Monteiro, M., Veloso, A., Ziviani, N.: Deep active learning for anomaly detection. In: International Joint Conference on Neural Networks (IJCNN) (2020)
Ruff, L., et al.: Deep one-class classification. In: ICML (2018)
Ruff, L., et al.: A unifying review of deep and shallow anomaly detection. Proc. IEEE 109(5), 756–795 (2021)
Ruff, L., et al.: Deep semi-supervised anomaly detection. In: ICLR (2020)
Russo, S., Lürig, M., Hao, W., Matthews, B., Villez, K.: Active learning for anomaly detection in environmental data. Environ. Model. Softw. 134, 104869 (2020)
Trittenbach, H., Englhardt, A., Böhm, K.: An overview and a benchmark of active learning for outlier detection with one-class classifiers. Expert Syst. Appl. 168, 114372 (2021)
Wang, W., Chen, P., Xu, Y., He, Z.: Active-mtsad: multivariate time series anomaly detection with active learning. In: IEEE International Conference on Dependable Systems and Networks (2022)
Xiao, H., Rasul, K., Vollgraf, R.: Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. CoRR arxiv:1708.07747 (2017)
Acknowledgments
We acknowledge the support of the PNRR project FAIR - Future AI Research (PE00000013), Spoke 9 - Green-aware AI, under the NRRP MUR program funded by the NextGenerationEU.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Amirato, S., Angiulli, F., Fassetti, F., Ferragina, L. (2025). Indecision-Aware Deep Active Anomaly Detection. In: Julian, V., et al. Intelligent Data Engineering and Automated Learning – IDEAL 2024. IDEAL 2024. Lecture Notes in Computer Science, vol 15347. Springer, Cham. https://doi.org/10.1007/978-3-031-77738-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-77738-7_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-77737-0
Online ISBN: 978-3-031-77738-7
eBook Packages: Computer ScienceComputer Science (R0)