Abstract
Deep learning is a subset of machine learning that is powerful at recognizing patterns and extensively used for image classification. However, it typically requires a large amount of data and it is computationally expensive for training an application from scratch. ImageNet database has millions of images pertaining to different categories that are acquired by years of hard work. Getting such a database for every application is tough and time consuming. Transfer learning is an alternative to conventional training. Transfer learning results in much faster and easier training of a network. This research set out to evaluate the effect of transfer learning on the performance of a Deep Neural Network (DNN). Pre-trained AlexNet was selected, modified and retrained for 3 image classification applications (gears, connectors and coins) with a modest database. This approach gave 99% classification accuracy using transfer learning. To test the robustness of the network, unknown images were added to one of the classes and the accuracy was reinforced using a probability threshold. This approach succeeded in compensating for the effect of unknowns in the accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dougherty, G.: Introduction. In: Dougherty, G. (ed.) Pattern Recognition and Classification, pp. 1–7. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-5323-9_1
Bremananth, R., Balaji, B., Sarkari, M., Chitra, A.: A new approach to coin recognition using neural pattern analysis. In: IEEE Indicon Conference, Chennai, India, pp. 366–370 (2005)
Chauhan, V., Joshi, K.D., Surgenor, B.: Machine vision for coin recognition with ANNs: effect of training and testing parameters. In: Boracchi, G., Iliadis, L., Jayne, C., Likas, A. (eds.) EANN 2017. CCIS, vol. 744, pp. 523–534. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65172-9_44
Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)
Rastegari, M., Ordonez, V., Redmon, J., Farhadi, A.: XNOR-Net: ImageNet classification using binary convolutional neural networks, pp. 1–17. arXiv:1603.05279v4 (2016)
Fadaeddini, A., Eshghi, M., Majidi, B.: A deep residual neural network for low altitude remote sensing image classification. In: 6th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), Kerman, Iran, pp. 43–46 (2018)
Ciresan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: Computer Vision and Pattern Recognition, Providence, USA, pp. 3642–3649 (2012)
Nguyen, A., Yosinski, J., Clune, J.: Deep neural networks are easily fooled: high confidence predictions for unrecognizable images. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, pp. 427–436 (2015)
Szegedy, C., et al.: Intriguing properties of neural networks. arxiv preprint arXiv:1312.6199 (2014)
Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of Research on Machine Learning Applications (2009)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems 27, NIPS 2014, pp. 1–14 (2014)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Szegedy, C., et al.: Going deeper with convolutions. In: Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, pp. 1–9 (2015)
Joshi, K., Chauhan, V., Surgenor, B.: Real-time recognition and counting of Indian currency coins using machine vision: a preliminary analysis. In: Proceedings of the Canadian Society for Mechanical Engineering (CSME) International Congress, Kelowna, Canada (2016)
Cognex: Color Light Selection Guide. https://www.cognex.com/products/machine-vision/2d-machine-vision-systems/in-sight-7000-series/colored-light-selection-guide. Accessed 31 Mar 2018
Chauhan, V.: Fault detection and classification in automated assembly machines using machine vision. Doctoral thesis, Department of Mechanical and Materials Engineering, Queen’s University, Canada, (2016)
Shah, S., Bennamoun, M., Boussaid, F.: Iterative deep learning for image set based face and object recognition. Neurocomputing 174, 866–874 (2015)
Noda, K., Yamaguchi, Y., Nakadai, K., Okuno, H., Ogata, T.: Audio-visual speech recognition using deep learning. Appl. Intell. 42, 722–737 (2015)
Zhou, S., Chen, Q., Wang, X.: Active deep learning method for semi-supervised sentiment classification. Neurocomputing 120, 536–546 (2013)
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)
Joshi, K.D.: A flexible machine vision system for small part inspection based on a hybrid SVM/ANN approach. Doctoral thesis, Department of Mechanical and Materials Engineering, Queen’s University, Canada (2018)
Machine Learning and Deep Learning Toolbox, MATLAB R2018b (2018)
Mittal, A., Soundararajan, R., Bovik, A.: Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Chauhan, V., Joshi, K.D., Surgenor, B. (2019). Image Classification Using Deep Neural Networks: Transfer Learning and the Handling of Unknown Images. In: Macintyre, J., Iliadis, L., Maglogiannis, I., Jayne, C. (eds) Engineering Applications of Neural Networks. EANN 2019. Communications in Computer and Information Science, vol 1000. Springer, Cham. https://doi.org/10.1007/978-3-030-20257-6_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-20257-6_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20256-9
Online ISBN: 978-3-030-20257-6
eBook Packages: Computer ScienceComputer Science (R0)