Abstract
In this paper, we propose a method for rules generation for images, which can be further used to enhance the classification accuracy of a convolutional neural network as well as to increase the level of explainability of neural network decisions. For each image from the training set, a descriptor is created based on the information contained in the convolutional layers of the network. The descriptors of images of the same class are then used to create a single-class prototype, which is characteristic of that class. The prototypes of different but semantically similar prototypes are then grouped into major categories using the DBSCAN algorithm. The analysis is carried out using the ILSVRC dataset and the VGG16 net is used. The experimental verification performed on the validation set demonstrated the validity and general nature of the rules obtained using the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Babenko, A., Slesarev, A., Chigorin, A., Lempitsky, V.: Neural codes for image retrieval. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 584–599. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_38
Chauhan, S.S., Batra, S.: Efficient layer-wise feature incremental approach for content-based image retrieval system. J. Electron. Imaging 28(2), 023038 (2019)
Dong, R., Liu, M., Li, F.: Multilayer convolutional feature aggregation algorithm for image retrieval. Math. Probl. Eng. 2019 (2019). https://www.hindawi.com/journals/mpe/2019/9794202/
Dubey, D., Suryawanshi, V., Prajapati, G.: Interactive content based image retrieval system: survey and overview. Int. Res. J. Eng. Technol. 3, 1239–1245 (2016)
Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, KDD 1996, pp. 226–231. AAAI Press (1996)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016). http://www.deeplearningbook.org
Grycuk, R., Najgebauer, P., Kordos, M., Scherer, M.M., Marchlewska, A.: Fast image index for database management engines. J. Artif. Intel. Soft Comput. Res. 10(2), 113–123 (2020). https://doi.org/10.2478/jaiscr-2020-0008
Gu, Y., Wang, Y., Li, Y.: A survey on deep learning-driven remote sensing image scene understanding: scene classification, scene retrieval and scene-guided object detection. Appl. Sci. 9(10), 2110 (2019)
Ismail, M.M.B.: A survey on content-based image retrieval. Int. J. Adv. Comput. Sci. Appl. (IJACSA) 8(5), 159–170 (2017)
Jose, A., Lopez, R.D., Heisterklaus, I., Wien, M.: Pyramid pooling of convolutional feature maps for image retrieval. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 480–484. IEEE (2018)
Jun, H., Ko, B., Kim, Y., Kim, I., Kim, J.: Combination of multiple global descriptors for image retrieval. arXiv preprint arXiv:1903.10663 (2019)
Long, C., Collins, R., Swears, E., Hoogs, A.: Deep neural networks in fully connected crf for image labeling with social network metadata. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1607–1615. IEEE (2019)
Maaten, L.v.d, Hinton, G.: Visualizing data using T-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)
Radenović, F., Tolias, G., Chum, O.: CNN image retrieval learns from BoW: unsupervised fine-tuning with hard examples. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 3–20. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_1
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015). https://doi.org/10.1007/s11263-015-0816-y
Saritha, R.R., Paul, V., Kumar, P.G.: Content based image retrieval using deep learning process. Cluster Comput. 22(2), 4187–4200 (2018). https://doi.org/10.1007/s10586-018-1731-0
Somasundaran, B.V., Soundararajan, R., Biswas, S.: Robust image retrieval by cascading a deep quality assessment network. Sig. Process. Image Commun. 80, 115652 (2020)
Tzelepi, M., Tefas, A.: Deep convolutional learning for content based image retrieval. Neurocomputing 275, 2467–2478 (2018)
Wu, Z., Yu, J.: A multi-level descriptor using ultra-deep feature for image retrieval. Multimedia Tools Appl. 78(18), 25655–25672 (2019). https://doi.org/10.1007/s11042-019-07771-2
Zhou, W., Deng, X., Shao, Z.: Region convolutional features for multi-label remote sensing image retrieval. arXiv preprint arXiv:1807.08634 (2018)
Zhou, W., Li, H., Tian, Q.: Recent advance in content-based image retrieval: a literature survey. arXiv preprint arXiv:1706.06064 (2017)
Acknowledgment
This work was supported by the Polish National Science Centre under Grant no. 2017/27/B/ST6/02852.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Staszewski, P., Jaworski, M., Rutkowski, L., Tao, D. (2020). Explainable Cluster-Based Rules Generation for Image Retrieval and Classification. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2020. Lecture Notes in Computer Science(), vol 12416. Springer, Cham. https://doi.org/10.1007/978-3-030-61534-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-61534-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61533-8
Online ISBN: 978-3-030-61534-5
eBook Packages: Computer ScienceComputer Science (R0)