Skip to main content

An Unsupervised Deep Learning Framework for Anomaly Detection

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13995))

Included in the following conference series:

  • 321 Accesses

Abstract

In recent years, with the evolution of technology and hardware, people can per-form anomaly detection on machines by collecting immediate time series data, thereby realizing the vision of an unmanned chemical factory. However, the data is often collected from multiple sensors, and multivariate time series anomaly detection is a difficult and complex problem because of the different scales and the unclear interaction of each feature. In addition, there usually exist noises in the data, and those make it difficult to predict the trend of the data. Moreover, practically, it’s hard to collect abnormal data, thus the imbalance is an important issue. Recently, with the rapid development of data science, unsupervised methods based on deep learning manner have gradually dominated the field of multivariate time series anomaly detection. In this paper, we propose a 3D-causal Temporal Convolutional Network based framework, namely TCN3DPredictor, to detect anomaly signals from sensors data. Our proposed TCN3DPredictor modifies multi-scale convolutional recurrent encoder-decoder by 3D-causal Temporal Convolutional Network which can learn the interaction and temporal correlation between features and even predict the next data. Based on the results of 3D-causal Temporal Convolutional Network, a new breed of statistical method is proposed in our proposed TCN3DPredictor to measure the anomaly score precisely. Through a series of experiments using dataset crawled from a computer numerical control (CNC) metal cutting machine tool in a precision machinery factory, we have validated the proposed TCN3DPredictor and shown that it has excellent effectiveness compared with state-of-the-art anomaly prediction methods under various conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    BBC: Taiwan train crash driver disabled speed controls https://www.bbc.com/news/world-asia-45951475.

  2. 2.

    https://www.goodwaycnc.com/exhtml_goodway/goodway_en/index.htm.

References

  1. Bai, S., Kolter, J.Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 (2018)

  2. Blázquez-García, A., Conde, A., Mori, U., Lozano, J.A.: A review on outlier/anomaly detection in time series data. ACM Comput. Surv. (CSUR) 54(3), 1–33 (2021)

    Article  Google Scholar 

  3. Dopico, M., Gómez, A., De la Fuente, D., García, N., Rosillo, R., Puche, J.: A vision of industry 4.0 from an artificial intelligence point of view. In: Proceedings on the International Conference on Artificial Intelligence (ICAI), p. 407. The Steering Committee of The World Congress in Computer Science, Computer (2016)

    Google Scholar 

  4. Guo, H., Zhang, D., Jiang, L., Poon, K.W., Lu, K.: ASTCN: an attentive spatial-temporal convolutional network for flow prediction. IEEE Internet Things J. 9(5), 3215–3225 (2021)

    Article  Google Scholar 

  5. Hallac, D., Vare, S., Boyd, S., Leskovec, J.: Toeplitz inverse covariance-based clustering of multivariate time series data. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 215–223 (2017)

    Google Scholar 

  6. Hautamaki, V., Karkkainen, I., Franti, P.: Outlier detection using k-nearest neighbour graph. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004, vol. 3, pp. 430–433. IEEE (2004)

    Google Scholar 

  7. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  8. Jin, S., Mordasini, C.: Compositional imprints in density-distance-time: a rocky composition for close-in low-mass exoplanets from the location of the valley of evaporation. Astrophys. J. 853(2), 163 (2018)

    Article  Google Scholar 

  9. Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-normalizing neural networks. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  10. Liang, H., Song, L., Wang, J., Guo, L., Li, X., Liang, J.: Robust unsupervised anomaly detection via multi-time scale DCGANs with forgetting mechanism for industrial multivariate time series. Neurocomputing 423, 444–462 (2021)

    Article  Google Scholar 

  11. Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., Shroff, G.: LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv preprint arXiv:1607.00148 (2016)

  12. van den Oord, A., et al.: WaveNet: a generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016)

  13. Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)

  14. Shi, X., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., Woo, W.C.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Advances in Neural Information Processing Systems, vol. 28 (2015)

    Google Scholar 

  15. Song, D., Xia, N., Cheng, W., Chen, H., Tao, D.: Deep r-th root of rank supervised joint binary embedding for multivariate time series retrieval. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2229–2238 (2018)

    Google Scholar 

  16. Tayeh, T., Aburakhia, S., Myers, R., Shami, A.: An attention-based ConvLSTM autoencoder with dynamic thresholding for unsupervised anomaly detection in multivariate time series. Mach. Learn. Knowl. Extr. 4(2), 350–370 (2022)

    Article  Google Scholar 

  17. Yaacob, A.H., Tan, I.K., Chien, S.F., Tan, H.K.: Arima based network anomaly detection. In: 2010 Second International Conference on Communication Software and Networks, pp. 205–209. IEEE (2010)

    Google Scholar 

  18. Zhang, C., et al.: A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 1409–1416 (2019)

    Google Scholar 

  19. Zhao, P., Chang, X., Wang, M.: A novel multivariate time-series anomaly detection approach using an unsupervised deep neural network. IEEE Access 9, 109025–109041 (2021)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Josh Jia-Ching Ying .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kuo, CW., Ying, J.JC. (2023). An Unsupervised Deep Learning Framework for Anomaly Detection. In: Nguyen, N.T., et al. Intelligent Information and Database Systems. ACIIDS 2023. Lecture Notes in Computer Science(), vol 13995. Springer, Singapore. https://doi.org/10.1007/978-981-99-5834-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-5834-4_23

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-5833-7

  • Online ISBN: 978-981-99-5834-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics