Abstract
Convolutional neural networks (CNNs) are widely used to categorize images. Successful training of a CNN requires rapid convergence of its weights, which increases the efficiency of training. In this paper, a CNN-RDM model, based on CNN and representational dissimilarity matrix (RDM), is proposed. In the proposed model, a loss function is defined in the RDM whose output is a minimized dissimilarity matrix. Therefore, by combining this minimized matrix of RDM loss function with CNN cross-entropy, the final output is minimized. The inputs of CNN-RDM model are pixels with low-level features, and the output is a set of features. The CNN-RDM model can actually change the structure of the neural network inspired by the visual pathway. The performance of our model is evaluated using 50 batches, including 10 image classes, each containing 5 samples on the data sets Cifar10, Cifar100, and Coco. Evaluation results demonstrate that our CNN-RDM model has achieved an accuracy of 60% in image classification, which is superior to 51% accuracy of the obtained model.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11227-022-04661-7/MediaObjects/11227_2022_4661_Fig8_HTML.png)
Similar content being viewed by others
References
Khallaf R, Khallaf M (2021) Classification and analysis of deep learning applications in construction: a systematic literature review. Automation in Construc 129:103760
Momeny M, Sarram MA, Latif AM, Sheikhpour R, Zhang YD (2021) A noise robust convolutional neural network for image classification. Results in Eng, p. 100225
Shariati M, Mafipour MS, Haido JH, Yousif ST, Toghroli A, Trung NT, Shariati A (2020) Identification of the most influencing parameters on the properties of corroded concrete beams using an Adaptive Neuro-Fuzzy Inference System (ANFIS). Steel Compos Struct 34(1):155
Liu L, Wang Z, Qiu T, Chen Q, Lu Y, Suen CY (2021) Document image classification: progress over two decades. Neurocomputing 453:223–240
Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117
Yan LC, Yoshua B, Geoffrey H (2015) Deep learning. Nature 521(7553):436–444
Volokitin A, Roig G, Poggio T (2017) Do deep neural networks suffer from crowding?. arXiv preprint arXiv:1706.08616
Helie S, Ashby FG (2012) Learning and transfer of category knowledge in an indirect categorization task. Psychol Res 76(3):292–303
Stettler M, Francis G (2018) Using a model of human visual perception to improve deep learning. Neural Netw 104:40–49
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778
He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks, In: European Conference on Computer Vision, pp. 630-645
Fong RC, Scheirer WJ, Cox DD (2018) Using human brain activity to guide machine learning. Sci Rep 8(1):5397
Zhang M, Li W, Du Q (2018) Diverse region-based CNN for hyper spectral image classification. IEEE Trans Image Process 27(6):2623–2634
Gong Z, Zhong P, Yu Y, Hu W, Li S (2019) A CNN with multi scale convolution and diversified metric for hyper spectral image classification. IEEE Trans Geosci Remote Sens 57(6):3599–3618
Pei Y, Huang Y, Zou Q, Zhang X, Wang S (2019) Effects of image degradation and degradation removal to cnn-based image classification. IEEE transactions on pattern analysis and machine intelligence
Gour M, Jain S, Sunil Kumar T (2020) Residual learning based CNN for breast cancer histopathological image classification. Int J Imag Syst Technol 30(3):621–635
Wang J, Song X, Sun L, Huang W, Wang J (2020) A novel cubic convolutional neural network for hyperspectral image classification. IEEE J Selected Topics in Appl Earth Observ Remote Sens 13:4133–4148
Kaur T, Gandhi TK (2020) Deep convolutional neural networks with transfer learning for automated brain image classification. Mach Vis Appl 31(3):1–16
Tong K, Wu Y, Zhou F (2020) Recent advances in small object detection based on deep learning: a review. Image and Vis Comput 97:103910
Popat P, Sheth P, Jain S (2019) Animal/object identification using deep learning on raspberry pi. In Information and Communication Technology for Intelligent Systems (pp. 319-327). Springer, Singapore
Guo Y, Chen Y, Tan M, Jia K, Chen J, Wang J (2021) Content-aware convolutional neural networks. Neural Netw 143:657–668
Guo Q, Wu XJ, Kittler J, Feng Z (2020) Self-grouping convolutional neural networks. Neural Netw 132:491–505
Qin X, Zhang Z, Huang C, Dehghan M, Zaiane OR, Jagersand M (2020) U2-Net: Going deeper with nested U-structure for salient object detection. Pattern Recogn 106:107404
Tek FB, Çam İ, Karlı D (2021) Adaptive convolution kernel for artificial neural networks. J Vis Commun Image Represent 75:103015
Paoletti ME, Tao X, Haut JM, Moreno-Álvarez S, Plaza A (2021) Deep mixed precision for hyperspectral image classification. The Journal of Supercomputing, pp. 1-12
Yu J, Liu H, Zheng X (2019) Two-dimensional joint local and nonlocal discriminant analysis-based 2D image feature extraction for deep learning. Neural Comput Appl, pp.1-16
Lateef F, Ruichek Y (2019) Survey on semantic segmentation using deep learning techniques. Neurocomputing 338:321–348
Wang J, Liu T, Wang X (2020) Human hand gesture recognition with convolutional neural networks for K-12 double-teachers instruction mode classroom. Infrared Phys Technol 111:103464
Sultana F, Sufian A, Dutta P (2018) Advancements in image classification using convolutional neural network. In 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN) (pp. 122-129). IEEE
Deng L (2014) A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Transactions on Signal and Information Processing, p. 3
Hussain M, Bird JJ, Faria DR (2018) A study on CNN transfer learning for image classification. In: UK Workshop on computational Intelligence (pp. 191-202). Springer, Cham
Garea AS, Heras DB, Argüello F (2019) Caffe CNN-based classification of hyperspectral images on GPU. J Supercomput 75(3):1065–1077
Heidari M, Mirniaharikandehei S, Khuzani AZ, Danala G, Qiu Y, Zheng B (2020) Improving the performance of CNN to predict the likelihood of COVID-19 using chest X-ray images with preprocessing algorithms. Int J Med Inform 144:104284
Seifi S, Tuytelaars T (2019) How to improve CNN-based 6-DoF camera pose estimation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (pp. 0-0)
Caldelli R, Becarelli R, Carrara F, Falchi F, Amato G (2019) Exploiting CNN layer activations to improve adversarial image classification. In: 2019 IEEE International Conference on Image Processing (ICIP) (pp. 2289-2293). IEEE
Qin J, Pan W, Xiang X, Tan Y, Hou G (2020) A biological image classification method based on improved CNN. Ecolog Inform 58:101093
Satapathy P, Pradhan SK, Hota S, Mahakud RR (2021) Brain Image Classification Using the Hybrid CNN Architecture. In Advances in Intelligent Computing and Communication (pp. 329-336). Springer, Singapore
Vaddi R, Manoharan P (2020) Hyper spectral image classification using CNN with spectral and spatial features integration. Infrared Phys Technol 107:103296
Gill HS, Khehra BS (2021) An integrated approach using CNN-RNN-LSTM for classification of fruit images. Materials Today: Proceedings
Sun Y, Xue B, Zhang M, Yen GG, Lv J (2020) Automatically designing CNN architectures using the genetic algorithm for image classification. IEEE Trans Cybernet 50(9):3840–3854
Brownlee J (2019) Impact of dataset size on deep learning model skill and performance estimates. Machine Learning Mastery, 6: arxiv
Yamashita R, Nishio M, Do RKG, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights into Imag 9(4):611–629
Han D, Liu Q, Fan W (2018) A new image classification method using CNN transfer learning and web data augmentation. Exp Syst Appl 95:43–56
Diedrichsen J, Berlot E, Mur M, Schütt H H, Shahbazi M, Kriegeskorte N (2020) Comparing representational geometries using whitened unbiased-distance-matrix similarity. arXiv preprint arXiv:2007.02789
Wan L, Wang Q, Papir A, Moreno IL (2018) Generalized end-to-end loss for speaker verification. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 4879-4883). IEEE
Rao D, McMahan B (2019) Natural language processing with PyTorch: build intelligent language applications using deep learning. O’Reilly Media, Inc.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We have no conflict of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Heydaran Daroogheh Amnyieh, Z., Rastegar Fatemi, S.M.J., Rastgarpour, M. et al. CNN-RDM: a new image processing model for improving the structure of deep learning based on representational dissimilarity matrix. J Supercomput 79, 4266–4290 (2023). https://doi.org/10.1007/s11227-022-04661-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-022-04661-7