Abstract
Accurate classification of medical images plays an essential role in the early diagnosis of disease. Although deep learning has achieved great success in medical images, it remains challenging due to the critical issue of significant intra-class variation and inter-class similarity caused by the diversity of imaging modalities and clinical pathologies. For this purpose, we propose a Class-center based Distribution loss (CD-loss) to guide the deep convolution neural networks (DCNNs) to extract more discriminative features for better classification accuracy. In detail, our CD-loss aims to force the extracted features from medical image data follow the distribution of that extracted from natural image data. That is because in general, there is less significant intra-class variation and inter-class similarity in natural images as that in medical images due to their different imaging mechanisms. In addition, the available medical images are usually very limited, and state-of-the-art (SOTA) metric learning loss functions easily suffer from over-fitting on such small data. On the contrary, our CD-loss extracts discriminative features not only based on the small medical image data but also the large natural image data to reduce over-fitting. To appreciate the performance of the proposed loss, in this experiment, several SOTA metric learning loss functions are used for comparison. The results demonstrate the effectiveness of our method in terms of classification accuracy and F1-scores.
Supported by National Natural Science Foundation of China No. 62006160, Educational Commission of Guangdong Province 2020KQNCX062, Shenzhen Fundamental Research Program 20200813102946001.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Altae-Tran, H., Ramsundar, B., Pappu, A.S., Pande, V.: Low data drug discovery with one-shot learning. ACS Cent. Sci. 3(4), 283–293 (2017)
Anand, V., Koundal, D.: Computer-assisted diagnosis of thyroid cancer using medical images: a survey. In: Singh, P.K., Kar, A.K., Singh, Y., Kolekar, M.H., Tanwar, S. (eds.) Proceedings of ICRIC 2019. LNEE, vol. 597, pp. 543–559. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-29407-6_39
Chopra, S., Hadsell, R., LeCun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 539–546. IEEE (2005)
Ding, J., Chen, B., Liu, H., Huang, M.: Convolutional neural network with data augmentation for SAR target recognition. IEEE Geosci. Remote Sens. Lett. 13(3), 364–368 (2016)
Ghasemi, M., Kelarestaghi, M., Eshghi, F., Sharifi, A.: FDSR: a new fuzzy discriminative sparse representation method for medical image classification. Artif. Intell. Med. 106, 101876 (2020)
Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1735–1742. IEEE (2006)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Huang, Z., Zhou, Q., Zhu, X., Zhang, X.: Batch similarity based triplet loss assembled into light-weighted convolutional neural networks for medical image classification. Sensors 21(3), 764 (2021)
Huang, Z., Zhu, X., Ding, M., Zhang, X.: Medical image classification using a light-weighted hybrid neural network based on PCANet and DenseNet. IEEE Access 8, 24697–24712 (2020)
Kearnes, S., Goldman, B., Pande, V.: Modeling industrial ADMET data with multitask networks. arXiv preprint arXiv:1606.08793 (2016)
Kermany, D.S., et al.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5), 1122–1131 (2018)
Khaneja, A., Srivastava, S., Rai, A., Cheema, A., Srivastava, P.K.: Analysing risk of coronary heart disease through discriminative neural networks. arXiv preprint arXiv:2008.02731 (2020)
Ma, X., et al.: Understanding adversarial attacks on deep learning based medical image analysis systems. Pattern Recogn. 110, 107332 (2021)
Meng, Z., Zhao, Z., Su, F.: Multi-classification of breast cancer histology images by using gravitation loss. In: ICASSP 2019–2019 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1030–1034. IEEE (2019)
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)
Shorfuzzaman, M., Hossain, M.S.: MetaCOVID: a Siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients. Pattern Recogn. 113, 107700 (2021)
Spanhol, F.A., Oliveira, L.S., Petitjean, C., Heutte, L.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2015)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 242–264. IGI global (2010)
Wen, Y., Zhang, K., Li, Z., Qiao, Yu.: A discriminative feature learning approach for deep face recognition. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9911, pp. 499–515. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_31
Yang, S., Liu, X., Zheng, Z., Wang, W., Ma, X.: Fusing medical image features and clinical features with deep learning for computer-aided diagnosis. arXiv preprint arXiv:2103.05855 (2021)
Zhang, H.P., et al.: Value of contrast-enhanced ultrasound in the differential diagnosis of gallbladder lesion. World J. Gastroenterol. 24(6), 744 (2018)
Zhao, J., Zhang, Y., He, X., Xie, P.: COVID-CT-dataset: a CT scan dataset about COVID-19. arXiv preprint arXiv:2003.13865 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, Y., Du, J., Liu, Y., Qiu, Y., Wang, T. (2021). CD Loss: A Class-Center Based Distribution Loss for Discriminative Feature Learning in Medical Image Classification. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12889. Springer, Cham. https://doi.org/10.1007/978-3-030-87358-5_51
Download citation
DOI: https://doi.org/10.1007/978-3-030-87358-5_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87357-8
Online ISBN: 978-3-030-87358-5
eBook Packages: Computer ScienceComputer Science (R0)