Abstract
Novelty detection is a process of identifying if new data does not belong to the previously observed patterns; this is important in several applications such as medical diagnosis and autonomous driving, where wrongly identifying a novel pattern could be catastrophic. We focus on the problem of novelty detection in images based on deep learning (DL) techniques. DL based models are trained through an optimization process in which a loss function is minimized. For visual novelty detection, this loss function must be able to capture in a scalar value the visual properties of the normal samples, usually the mean square error (MSE). While satisfactory performance has been obtained with this formulation, it is often complicated for a single loss function to capture all of the relevant information to discriminate novelty from normality. In this paper we propose novel reconstruction loss that combines pixel-wise and perceptual information. Its performance is experimentally evaluated using generative adversarial networks (GANs), and compared against autoencoders based on MSE, showing superior performance. Additionally, we present an application to novelty detection in X-Ray images, which is relevant for current work con COVID diagnosis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Amarbayasgalan, T., Jargalsaikhan, B., Ryu, K.H.: Unsupervised novelty detection using deep autoencoders with density based clustering. Appl. Sci. 8(9), 1468 (2018)
Amini, A., Schwarting, W., Rosman, G., Araki, B., Karaman, S., Rus, D.: Variational autoencoder for end-to-end control of autonomous driving with novelty detection and training de-biasing. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 568–575, October 2018
Bojarski, M., et al.: Visualbackprop: efficient visualization of CNNs for autonomous driving. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 4701–4708 (2018)
Chen, V., Yoon, M., Shao, Z.: Novelty detection via network saliency in visual-based deep learning. CoRR abs/1906.03685 (2019)
Cichosz, P., et al.: Novelty detection for breast cancer image classification. In: Romaniuk, R.S. (ed.) Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2016. vol. 10031, pp. 861–872. International Society for Optics and Photonics, SPIE (2016)
Deng, L.: The MNIST database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process. Mag. 29(6), 141–142 (2012)
Ferrag, M.A., Maglaras, L., Moschoyiannis, S., Janicke, H.: Deep learning for cyber security intrusion detection: approaches, datasets, and comparative study. J. Inf. Secur. Appl. 50, 102419 (2020)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. The MIT Press (2016)
Goodfellow, I.J., et al.: Generative adversarial networks (2014)
Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), vol. 2, pp. 1735–1742 (2006)
Halabi, S.S., et al.: The RSNA pediatric bone age machine learning challenge. Radiology 290(2), 498–503 (2019). pMID: 30480490
Kermany, D.S., et al.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5), 1122–1131.e9 (2018)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization (2017)
Lekamlage, C.D., Afzal, F., Westerberg, E., Cheddad, A.: Mini-DDSM: Mammography-Based Automatic Age Estimation, pp. 1–6. Association for Computing Machinery, New York (2020)
Menze, B.H., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2015)
Perera, P., Nallapati, R., Xiang, B.: Ocgan: one-class novelty detection using GANs with constrained latent representations. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019
Pimentel, M.A., Clifton, D.A., Clifton, L., Tarassenko, L.: A review of novelty detection. Signal Process. 99, 215–249 (2014)
Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018)
Sokolov, E.N.: Higher nervous functions: the orienting reflex. Ann. Rev. Physiol. 25(1), 545–580 (1963). pMID: 13977960
Tieleman, T., Hinton, G.: Lecture 6.5–RmsProp: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning (2012)
Huan-gang Wang, Xin Li, T.Z.: Generative adversarial network based novelty detection using minimized reconstruction error. Front. Inf. Technol. Electron. Eng. 19(1), 116 (2018)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Zhou, J.T., Du, J., Zhu, H., Peng, X., Liu, Y., Goh, R.S.M.: Anomalynet: an anomaly detection network for video surveillance. IEEE Trans. Inf. Forensics Secur. 14(10), 2537–2550 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Palacios-Alonso, M.A., Escalante, H.J., Sucar, L.E. (2021). Perceptual and Pixel-Wise Information for Visual Novelty Detection. In: Roman-Rangel, E., Kuri-Morales, Á.F., Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Olvera-López, J.A. (eds) Pattern Recognition. MCPR 2021. Lecture Notes in Computer Science(), vol 12725. Springer, Cham. https://doi.org/10.1007/978-3-030-77004-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-77004-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77003-7
Online ISBN: 978-3-030-77004-4
eBook Packages: Computer ScienceComputer Science (R0)
