Skip to main content
Springer Nature Link
Log in

Two-stage anomaly detection for positive samples and small samples based on generative adversarial networks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Anomaly detection approaches based on generative adversary networks usually directly input the image into the generator for reconstruction. As a result, the results of anomaly detection are not ideal. This paper proposes a novel anomaly detection model based on a two-stage generative adversarial network to improve the results. It consists of feature extraction and anomaly detection networks. The former combines a convolutional neural network and multi-scale feature extraction to study latent code. The latent code from the former model instead of the original image is fed to the generator of the anomaly detection module. The experiment shows the proposed method outperforms several existing anomaly detection methods with multiple datasets. Additionally, the quantitative result indicates the proposed model optimizes anomaly detection performance and improves by 8.8% and 19.2% on both the liver CT image medical dataset and the CIFAR10 public dataset respectively compared to the baseline of the skip-GANomaly model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Akcay S, Atapour-Abarghouei A, Breckon TP (2019) Skip-ganomaly: skip connected and adversarially trained encoder-decoder anomaly detection IEEE. https://doi.org/10.1109/IJCNN.2019.8851808

  2. Akcay S, Atapour-Abarghouei A, Breckon TP (2018) Ganomaly: semi-supervised anomaly detection via adversarial training. https://doi.org/10.1007/978-3-030-20893_39

  3. Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Computer Science

  4. Bergmann P, Sdea Fauser M (2020) Uninformed students: student-teacher anomaly detection with discriminative latent embeddings. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

  5. Bhatti UA, Huang M, Wu D, Zhang Y, Mehmood A, Han H (2018) Recommendation system using feature extraction and pattern recognition in clinical care systems. Enterprise Information Systems, pp 1–23

  6. Bhatti UA, Yuan L, Yu Z, Nawaz SA, Xiao S (2021) Predictive data modeling using sp-knn for risk factor evaluation in urban demographical healthcare data. Journal of Medical Imaging and Health Informatics 11(1):7–14

    Article  Google Scholar 

  7. Boriah S, Chandola V, Kumar V (2008) Similarity measures for categorical data: a comparative evaluation. In: Proceedings of the SIAM International Conference on Data Mining, SDM 2008, April 24-26, Atlanta, Georgia, USA

  8. Chalapathy R, Menon AK, Chawla S (2018) Anomaly detection using one-class neural networks. https://doi.org/10.48550/arXiv.1802.06360

  9. Chalapathy R, Chawla S (2019) Deep learning for anomaly detection: a survey. https://doi.org/10.48550/arXiv.1901.03407

  10. Chen Y, Tian Y, Pang G, Carneiro G (2021) Deep one-class classification via interpolated gaussian descriptor. https://doi.org/10.48550/arXiv.2101.10043

  11. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2018) Dual attention network for scene segmentation. https://doi.org/10.48550/arXiv.1809.02983

  12. Geert L, Thijs K, Babak E, Bejnordi A, Arindra A (2017) A survey on deep learning in medical image analysis medical image analysis

  13. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks

  14. Haloui I, Gupta JS, Feuillard V (2018) Anomaly detection with wasserstein gan. https://doi.org/10.48550/arXiv.1812.02463

  15. He Z, Xu X, Deng S (2003) Discovering cluster-based local outliers. Pattern Recogn Lett 24 (9-10):1641–1650. https://doi.org/10.1016/S0167-8655(03)00003-5

    Article  MATH  Google Scholar 

  16. Huang H, Lin L, Tong R, Hu H, Wu J (2020) Unet 3+: a full-scale connected unet for medical image segmentation IEEE. https://doi.org/10.1109/ICASSP40776.2020.9053405

  17. Kingma DP, Welling M (2014) Auto-encoding variational bayes, arXiv.org. https://doi.org/10.48550/arXiv.1312.6114

  18. Li J, Fang F, Mei K, Zhang G (2018) Multi-scale residual network for image super-resolution. In: 15th european conference, munich, germany, september 8-14, 2018, proceedings, part viii, Springer, Cham

  19. Michelucci U (2022) An introduction to autoencoders. https://doi.org/10.48550/arXiv.2201.03898

  20. Milletari F, Navab N, Ahmadi SA (2016) V-net fully convolutional neural networks for volumetric medical image segmentation

  21. Nawaz SA, Li J, Bhatti UA, Bazai SU, Zafar A, Bhatti MA, Mehmood A, Ain QU, Shoukat MU (2021) A hybrid approach to forecast the covid-19 epidemic trend. PLOS ONE vol 16

  22. Nong Y, Qiang C (2001) An anomaly detection technique based on a chi-square statistic for detecting intrusions into information systems

  23. Oktay O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, Mcdonagh S, Hammerla NY, Kainz B (2018) Attention u-net: learning where to look for the pancreas. https://doi.org/10.48550/arXiv.1804.03999

  24. Perera P, Nallapati R, Bing X (2019) Ocgan: one-class novelty detection using gans with constrained latent representations IEEE

  25. Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. Computer ence

  26. Rifai S, Vincent P, Muller X, Glorot X, Bengio Y (2013) Contracting auto-encoders

  27. Salehi M, Sadjadi N, Baselizadeh S, Rohban MH, Rabiee HR (2020) Multiresolution knowledge distillation for anomaly detection. https://doi.org/10.48550/arXiv.2011.11108

  28. Salvador S, Chan PK, Brodie J (2003) Learning states and rules for time series anomaly detection. Seventeenth International Florida Artificial Intelligence Research Society Conference

  29. Schlegl T, Seebck P, Waldstein SM, Schmidt-Erfurth U, Langs G (2017) Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. Springer Cham. https://doi.org/10.1007/978-3-319-59050-9_12

  30. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

  31. Song JW, Kong K, Park YI, Kang SJ (2021) Attention map-guided two-stage anomaly detection using hard augmentation. https://doi.org/10.48550/arXiv.2103.16851

  32. Varun C, Arindam B, Vipin K (2009) Anomaly detection: a survey. Acm Computing Surveys. https://doi.org/10.48550/arXiv.1901.03407

  33. Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. https://doi.org/10.1145/1390156.1390294

  34. Zeeshan Z, Ain QU, Bhatti UA, Memon WH, Ali S, Nawaz SA, Nizamani MM, Mehmood A, Bhatti MA, Shoukat MU (2021) Feature-based multi-criteria recommendation system using a weighted approach with ranking correlation Intelligent data analysis pp 25-4

  35. Zenati H, Foo CS, Lecouat B, Manek G, Chandrasekhar VR (2018) Efficient gan-based anomaly detection Computer Vision and Pattern Recognition. https://doi.org/10.48550/arXiv.1802.06222

  36. Zhao J, Mathieu M, Lecun Y (2016) Energy-based generative adversarial network. https://doi.org/10.48550/ arXiv:1609.03126

Download references

Author information

Authors and Affiliations

  1. School of Information and Electronic Engineering, Zhejiang University of Science and Technology, No.318 Liuhe Road, Hangzhou, 310023, Zhejiang, China

    Caie Xu, Bingyan Wang & Mingyang Wu

  2. College of Computer Science and Technology, Zhejiang University, No. 38, Zheda Road, Hangzhou, 310013, Zhejiang, China

    Dandan Ni & Honghua Gan

Authors
  1. Caie Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Dandan Ni
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Bingyan Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Mingyang Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Honghua Gan
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Honghua Gan.

Ethics declarations

We confirm that we have read, understand, and agreed to the submission guidelines, policies, and submission declaration of the journal, and all authors of the manuscript have no conflict of interest to declare. The manuscript is the author’s original work, and the manuscript has not received prior publication and is not under consideration for publication elsewhere. On behalf of all Co-Authors, I bear full responsibility for the submission.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, C., Ni, D., Wang, B. et al. Two-stage anomaly detection for positive samples and small samples based on generative adversarial networks. Multimed Tools Appl 82, 20197–20214 (2023). https://doi.org/10.1007/s11042-022-14306-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-14306-9

Keywords