Abstract
Recent studies on anomaly detection have achieved great success in data analysis, yet the application of out-of-distribution detection in medical imaging remains an underdeveloped area of study. In this paper, we propose a 3D fully self-supervised learning method for volumetric medical image data. Inspired by recent advancements in representation learning for out-of-distribution detection, we propose a training method for pseudoanomaly generation with copy-paste. The training uses contrasts of the normal image with the pseudoanomaly image that is generated from the normal image. Through this scheme, a representation is learned to detect an abnormal image and to localize the anomaly area. In addition, we use a 3D patch as an input to provide the spatial information of the third dimension from volumetric image data. The proposed approach was tested in the 2021 MICCAI MOOD challenge, and it ranked the first place in both sample-level and pixel-level tasks.
This research was supported by the Capacity Enhancement Program for Scientific and Cultural Exhibition Services through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (NRF-2018X1A3A1069693).
J. Cho and I. Kang—Contributed equally to this work as first authors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Code available at https://github.com/zinic95/MOOD_CGV.
References
Ballard, D.H.: Modular learning in neural networks. In: AAAI, vol. 647, pp. 279–284 (1987)
Chen, L., et al.: Self-supervised learning for medical image analysis using image context restoration. Med. Image Anal. 58, 101539 (2019)
Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for contrastive learning of visual representations. arXiv preprint arXiv:2002.05709 (2020)
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., Hinton, G.: Big self-supervised models are strong semi-supervised learners (2020)
Drew, T., Võ, M.L.H., Wolfe, J.M.: The invisible gorilla strikes again: sustained inattentional blindness in expert observers. Psychol. Sci. 24(9), 1848–1853 (2013)
He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsupervised visual representation learning (2020)
Hendrycks, D., Mazeika, M., Kadavath, S., Song, D.: Using self-supervised learning can improve model robustness and uncertainty (2019)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization (2017)
Li, C., Sohn, K., Yoon, J., Pfister, T.: CutPaste: self-supervised learning for anomaly detection and localization. CoRR abs/2104.04015 (2021). https://arxiv.org/abs/2104.04015
Lu, Y., Xu, P.: Anomaly detection for skin disease images using variational autoencoder (2018)
Marimont, S.N., Tarroni, G.: Anomaly detection through latent space restoration using vector-quantized variational autoencoders (2020)
Perera, P., Nallapati, R., Xiang, B.: OCGAN: one-class novelty detection using GANs with constrained latent representations (2019)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. CoRR abs/1505.04597 (2015). http://arxiv.org/abs/1505.04597
Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection (2018)
Smith, L.N., Topin, N.: Super-convergence: very fast training of neural networks using large learning rates. In: Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, vol. 11006, p. 1100612. International Society for Optics and Photonics (2019)
Tack, J., Mo, S., Jeong, J., Shin, J.: CSI: novelty detection via contrastive learning on distributionally shifted instances (2020)
Taleb, A., Lippert, C., Klein, T., Nabi, M.: Multimodal self-supervised learning for medical image analysis. In: Feragen, A., Sommer, S., Schnabel, J., Nielsen, M. (eds.) IPMI 2021. LNCS, vol. 12729, pp. 661–673. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78191-0_51
Tan, J., Hou, B., Batten, J., Qiu, H., Kainz, B.: Detecting outliers with foreign patch interpolation. CoRR abs/2011.04197 (2020). https://arxiv.org/abs/2011.04197
Yi, J., Yoon, S.: Patch SVDD: patch-level SVDD for anomaly detection and segmentation (2020)
Zimmerer, D., et al.: Medical out-of-distribution analysis challenge 2021, March 2021. https://doi.org/10.5281/zenodo.4573948
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Cho, J., Kang, I., Park, J. (2022). Self-supervised 3D Out-of-Distribution Detection via Pseudoanomaly Generation. In: Aubreville, M., Zimmerer, D., Heinrich, M. (eds) Biomedical Image Registration, Domain Generalisation and Out-of-Distribution Analysis. MICCAI 2021. Lecture Notes in Computer Science(), vol 13166. Springer, Cham. https://doi.org/10.1007/978-3-030-97281-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-97281-3_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-97280-6
Online ISBN: 978-3-030-97281-3
eBook Packages: Computer ScienceComputer Science (R0)
