Skip to main content

Advertisement

Springer Nature Link
Log in

Generic and scalable periodicity adaptation framework for time-series anomaly detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nowadays, multivariate time series data is increasingly collected in many large-scale application systems, which often has periodic, repetitive patterns that can be affected by advertisements, workdays, holidays, and some user behavior activities. However, existing density and distance-based anomaly detection approaches suffer from detecting anomalies related to periodicity and seasonality. To address this problem, we propose a generic and scalable adaptation framework (GSPAD) for unsupervised anomaly detection in time series with periodic patterns. Our framework mainly consists of a time series predictor and an anomaly detector. Therefore, we present a Convolutional Attention-skip Network (CASNet) as a predictor responsible for predicting both short- and long-term patterns. These two types of patterns are modeled by the CASNet combining the Convolutional Neural Network (CNN) and the Dual Branch Attention-skip Network. Moreover, the proposed anomaly detector can deduce the anomaly according to the severity of the deviations between the actual and predicted values. Compared with other related researches on public datasets, GSPAD shows better performance with an average F-score over 0.76.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Abbasi R A, Javaid N, Ghuman M N J, Khan Z A, Rehman S U, et al. (2019) Short term load forecasting using xgboost. In: Workshops of the international conference on advanced information networking and applications. Springer, pp 1120–1131

  2. Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: ICLR

  3. Blázquez-García A, Conde A, Mori U, Lozano J A (2021) A review on outlier/anomaly detection in time series data. ACM Comput Surv (CSUR) 54(3):1–33

    Article  Google Scholar 

  4. Buda T S, Caglayan B, Assem H (2018) Deepad: a generic framework based on deep learning for time series anomaly detection. In: Pacific-Asia conference on knowledge discovery and data mining. Springer, pp 577–588

  5. Canizo M, Triguero I, Conde A, Onieva E (2019) Multi-head cnn–rnn for multi-time series anomaly detection: an industrial case study. Neurocomputing 363:246–260

    Article  Google Scholar 

  6. Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv (CSUR) 41(3):1–58

    Article  Google Scholar 

  7. Chen B-J, Chang M-W, et al. (2004) Load forecasting using support vector machines: a study on eunite competition 2001. IEEE Trans Power Syst 19 (4):1821–1830

    Article  Google Scholar 

  8. Cho K, Van Merriënboer B, Bahdanau D, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. In: EMNLP

  9. Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805

  10. Dudek G (2015) Short-term load forecasting using random forests. In: Intelligent systems. Springer, pp 821–828

  11. Durbin J, Koopman S J (2012) Time series analysis by state space methods. Oxford university press

  12. Erfani S M, Rajasegarar S, Karunasekera S, Leckie C (2016) High-dimensional and large-scale anomaly detection using a linear one-class svm with deep learning. Pattern Recogn 58:121–134

    Article  Google Scholar 

  13. Goldstein M, Dengel A (2012) Histogram-based outlier score (hbos): a fast unsupervised anomaly detection algorithm. KI-2012: Poster and Demo Track, 59–63

  14. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neur Comput 9(8):1735–1780

    Article  Google Scholar 

  15. Huang S, Wang D, Wu X, Tang A (2019) Dsanet: dual self-attention network for multivariate time series forecasting. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 2129–2132

  16. Kim T-Y, Cho S-B (2018) Web traffic anomaly detection using c-lstm neural networks. Expert Syst Appl 106:66–76

    Article  Google Scholar 

  17. Kingma D P, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980

  18. Kwon D, Kim H, Kim J, Suh S C, Kim I, Kim K J (2019) A survey of deep learning-based network anomaly detection. Clust Comput 22(1):949–961

    Article  Google Scholar 

  19. Li Z, Zhao Y, Botta N, Ionescu C, Hu X (2020) Copod: copula-based outlier detection. In: IEEE International conference on data mining (ICDM)

  20. Liao M, Chen J (2019) Intelligent business and marketing model under full platform multimedia soft computing framework. Multimed Tools Applic 78(4):4155–4177

    Article  Google Scholar 

  21. Lim B, Arık S O, Loeff N, Pfister T (2021) Temporal fusion transformers for interpretable multi-horizon time series forecasting. Int J Forecast

  22. Liu D, Zhao Y, Xu H, Sun Y, Pei D, Luo J, Jing X, Feng M (2015) Opprentice: towards practical and automatic anomaly detection through machine learning. In: Proceedings of the 2015 internet measurement conference, pp 211–224

  23. Liu Y, Li Z, Zhou C, Jiang Y, Sun J, Wang M, He X (2019) Generative adversarial active learning for unsupervised outlier detection. IEEE Trans Knowl Data Eng 32(8):1517–1528

    Google Scholar 

  24. Luong M-T, Pham H, Manning C D (2015) Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1412–1421

  25. Mikalef P, Krogstie J, Pappas I O, Pavlou P (2020) Exploring the relationship between big data analytics capability and competitive performance: the mediating roles of dynamic and operational capabilities. Inform Manag 57(2):103169

    Article  Google Scholar 

  26. Munir M, Siddiqui S A, Dengel A, Ahmed S (2018) Deepant: a deep learning approach for unsupervised anomaly detection in time series. IEEE Access 7:1991–2005

    Article  Google Scholar 

  27. Münz G, Li S, Carle G (2007) Traffic anomaly detection using k-means clustering. In: GI/ITG Workshop MMBnet, pp 13–14

  28. Pecht M G, Kang M (2019) Machine learning: anomaly detection. In: Prognostics and health management of electronics: fundamentals, machine learning, and the internet of things, pp 131–162

  29. Rathore S, Park J H (2018) Semi-supervised learning based distributed attack detection framework for iot. Appl Soft Comput 72:79–89

    Article  Google Scholar 

  30. Schuster M, Paliwal K K (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681

    Article  Google Scholar 

  31. Thabtah F, Hammoud S, Kamalov F, Gonsalves A (2020) Data imbalance in classification: experimental evaluation. Inf Sci 513:429–441

    Article  MathSciNet  Google Scholar 

  32. Turner C J, Emmanouilidis C, Tomiyama T, Tiwari A, Roy R (2019) Intelligent decision support for maintenance: an overview and future trends. Int J Comput Integr Manuf 32(10):936–959

    Article  Google Scholar 

  33. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008

  34. Wulsin DF, Gupta JR, Mani R, Blanco JA, Litt B (2011) Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement. J Neural Eng 8(3):036015

    Article  Google Scholar 

  35. Zeng S, Tong X, Sang N, Huang R (2013) A study on semi-supervised fcm algorithm. Knowl Inform Syst 35(3):585–612

    Article  Google Scholar 

  36. Zhang J, Zulkernine M (2006) Anomaly based network intrusion detection with unsupervised outlier detection. In: 2006 IEEE International conference on communications, vol 5. IEEE, pp 2388–2393

  37. Zhang Z, Hong W-C (2021) Application of variational mode decomposition and chaotic grey wolf optimizer with support vector regression for forecasting electric loads. Knowl-Based Syst 228:107297

    Article  Google Scholar 

  38. Zhao Y, Hu X, Cheng C, Wang C, Wan C, Wang W, Yang J, Bai H, Li Z, Xiao C et al (2021) Suod: accelerating large-scale unsupervised heterogeneous outlier detection, Proc Mach Learn Syst, 3

  39. Zhou B, He D, Sun Z (2006) Traffic modeling and prediction using arima/garch model. In: Modeling and simulation tools for emerging telecommunication networks. Springer, pp 101–121

Download references

Acknowledgments

This research is supported by the National Key R&D Program of China (2018YFC0809001).

Author information

Authors and Affiliations

  1. Systems Engineering Institute, School of Electronic and Information Engineering, Xi’an Jiaotong University, Xianning Road, Xi’an, 710049, China

    Zhao Sun, Qinke Peng, Xu Mou & Muhammad Fiaz Bashir

Authors
  1. Zhao Sun
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Qinke Peng
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Xu Mou
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Muhammad Fiaz Bashir
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zhao Sun.

Ethics declarations

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Z., Peng, Q., Mou, X. et al. Generic and scalable periodicity adaptation framework for time-series anomaly detection. Multimed Tools Appl 82, 2731–2748 (2023). https://doi.org/10.1007/s11042-022-13304-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13304-1

Keywords