Abstract
Anomaly detection is a crucial task in various domains such as finance, cybersecurity or medical diagnosis. The demand for interpretability and explainability in model decisions has revived the use of traceable models, with Histogram Based Outlier Scores being a notable option due to its fast speed and commendable performance. Histogram Based Outlier Scores is a well-known and efficient unsupervised anomaly detection algorithm. Despite its popularity, it suffers from several limitations, including the inability to update its internal knowledge, model complex distributions, and consider feature relations. This work aims to provide a comprehensive analysis of the Histogram Based Outlier Scores algorithm status and its limitations. We conduct a comparative analysis of Histogram Based Outlier Scores with other state-of-the-art anomaly detection algorithms to identify its strengths and weaknesses. Our study shows that while Histogram Based Outlier Scores is efficient and computationally inexpensive, it may not be the best option in scenarios where the underlying data distribution is complex or where variable relations play a significant role. The presented alternatives and extensions to Histogram Based Outlier Scores provide valuable insights into the development of future anomaly detection methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aggarwal, C.C.: An introduction to outlier analysis. In: Outlier Analysis, pp. 1–34. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-47578-3_1
Aguilera-Martos, I., et al.: Multi-step histogram based outlier scores for unsupervised anomaly detection: arcelormittal engineering dataset case of study. Neurocomputing 544, 126228 (2023)
Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: LOF: identifying density-based local outliers. SIGMOD Rec. 29(2), 93–104 (2000)
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. (CSUR) 41(3), 1–58 (2009)
Goldstein, M., Dengel, A.: Histogram-based outlier score (HBOS): a fast unsupervised anomaly detection algorithm
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)
Leigh, C., et al.: A framework for automated anomaly detection in high frequency water-quality data from in situ sensors. Sci. Total Environ. 664, 885–898 (2019)
Li, Z., Zhao, Y., Hu, X., Botta, N., Ionescu, C., Chen, G.: ECOD: unsupervised outlier detection using empirical cumulative distribution functions. IEEE Trans. Knowl. Data Eng. (2022)
Liu, F.T., Ting, K.M., Zhou, Z.H.: Isolation forest. In: Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, pp. 413–422 (2008)
Moustafa, N., Hu, J., Slay, J.: A holistic review of network anomaly detection systems: a comprehensive survey. J. Netw. Comput. Appl. 128, 33–55 (2019)
Pevný, T.: LODA: lightweight on-line detector of anomalies. Mach. Learn. 102(2), 275–304 (2016)
Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets, pp. 427–438 (2000)
Schölkopf, B., Williamson, R., Smola, A., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. In: Proceedings of the 12th International Conference on Neural Information Processing Systems, pp. 582–588 (1999)
Shebuti, R.: ODDS Library (2016). http://odds.cs.stonybrook.edu
Shyu, M.L., Chen, S.C., Sarinnapakorn, K., Chang, L.: A novel anomaly detection scheme based on principal component classifier. In: Proceedings of International Conference on Data Mining (2003)
Xue, Q., Li, G., Zhang, Y., Shen, S., Chen, Z., Liu, Y.: Fault diagnosis and abnormality detection of lithium-ion battery packs based on statistical distribution. J. Power Sources 482, 228964 (2021)
Zhang, G., et al.: eFraudCom: an e-commerce fraud detection system via competitive graph neural networks. ACM Trans. Inf. Syst. (TOIS) 40(3), 1–29 (2022)
Acknowledgment
This work has been supported by the Ministry of Science and Technology of Spain under project PID2020-119478GB-I00 and the project TED2021-132702B-C21 from the Ministry of Science and Innovation of Spain. I. Aguilera-Martos was supported by the Spanish Ministry of Science under the FPI programme PRE2021-100169.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Aguilera-Martos, I., Luengo, J., Herrera, F. (2023). Revisiting Histogram Based Outlier Scores: Strengths and Weaknesses. In: García Bringas, P., et al. Hybrid Artificial Intelligent Systems. HAIS 2023. Lecture Notes in Computer Science(), vol 14001. Springer, Cham. https://doi.org/10.1007/978-3-031-40725-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-40725-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40724-6
Online ISBN: 978-3-031-40725-3
eBook Packages: Computer ScienceComputer Science (R0)