Abstract
Diabetic Foot Ulcer (DFU) is the main complication of Diabetes, which, if not properly treated, may lead to amputation. One of the approaches of DFU treatment depends on the attentiveness of clinicians and patients. This treatment approach has drawbacks such as the high cost of the diagnosis as well as the length of treatment. Although this approach gives powerful results, the need for a remote, cost-effective, and convenient DFU diagnosis approach is urgent. In this paper, we introduce a new dataset of 754-ft images which contain healthy skin and skin with a diabetic ulcer from different patients. A novel Deep Convolutional Neural Network, DFU_QUTNet, is also proposed for the automatic classification of normal skin (healthy skin) class versus abnormal skin (DFU) class. Stacking more layers to a traditional Convolutional Neural Network to make it very deep does not lead to better performance, instead leading to worse performance due to the gradient. Therefore, our proposed DFU_QUTNet network is designed based on the idea of increasing the width of the network while keeping the depth compared to the state-of-the-art networks. Our network has been proven to be very beneficial for gradient propagation, as the error can be back-propagated through multiple paths. It also helps to combine different levels of features at each step of the network. Features extracted by DFU_QUTNet network are used to train Support Vector Machine (SVM) and K-Nearest Neighbors (KNN) classifiers. For the sake of comparison, we have fine-tuned then re-trained and tested three pre-trained deep learning networks (GoogleNet, VGG16, and AlexNet) for the same task. The proposed DFU_QUTNet network outperformed the state-of-the-art CNN networks by achieving the F1-score of 94.5%.














Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Al-Zubaidi L (2016) Deep learning based nuclei detection for quantitative histopathology image analysis (Doctoral dissertation, University of Missouri--Columbia)
Alzubaidi L., Al-Shamma O., FadhelM.A., Farhan L., Zhang J. (2020) Classification of Red Blood Cells in Sickle Cell Anemia Using Deep Convolutionalrk. In: Abraham A., Cherukuri A., Melin P., Gandhi N. (eds) Intelligent Systems Design and Applications. ISDA 2018 2018. Advances in IntelligentSystems and Computing, vol 940. Springer, Cham
Armstrong DG, Lavery LA, Harkless LB (1998) Validation of a diabetic wound classification system: the contribution of depth, infection, and ischemia to risk of amputation. Diabetes Care 21(5):855 859
Bakator M, Radosav D (2018) Deep learning and medical diagnosis: a review of literature. Multimodal Technologies and Interaction 2(3):47
Boulton AJ, Vileikyte L, Ragnarson-Tennvall G, Apelqvist J (2005) The global burden of diabetic foot disease. Lancet 366(9498):1719–1724
Bowling FL, King L, Paterson JA, Hu J, Lipsky BA, Matthews DR, Boulton AJ (2011) Remote assessment of diabetic foot ulcers 11 using a novel wound imaging system. Wound Repair Regen 19(1):25–30
Cavanagh P, Attinger C, Abbas Z, Bal A, Rojas N, Xu Z-R (2012) Cost of treating diabetic foot ulcers in five different countries. Diabetes / Metabolism Research and Reviews 28(S1):107–111
Cheng PM, Malhi HS (2017) Transfer learning with convolutional neural networks for classification of abdominal ultrasound images. J Digit Imaging:234–243
Clemensen J, Larsen SB, Kirkevold M, Ejskjaer N (2008) Treatment of diabetic foot ulcers in the home: video consultations as an alternative to outpatient hospital care. Int J Telemed Appl 2008:1
Dahl GE, Sainath TN, Hinton GE (2013) Improving deep neural networks for LVCSR using rectified linear units and dropout. In: 2013 IEEE international conference on acoustics, speech and signal processing (pp. 8609–8613). IEEE
Deng Y, Manjunath BS (2001) Unsupervised segmentation of colortexture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23(8):800–810
El-Gayar O, Timsina P, Nawar N, Eid W (2013) A systematic review of it for diabetes self-management: are we there yet? Int J Med Inform 82(8):637–652
Foltynski P, Wojcicki JM, Ladyzynski P, Migalska-Musial K, Rosinski G, Krzymien J, Karnafel W (2011) Monitoring of diabetic foot syndrome treatment: some new perspectives. Artif Organs 35(2):176–182
Fraiwan L, AlKhodari M, Ninan J, Mustafa B, Saleh A, Ghazal M (2017) Diabetic foot ulcer mobile detection system using smart phone thermal camera: a feasibility study. Biomed Eng Online 16(1):117
Fraiwan L, Ninan J, Al-Khodari M (2018) Mobile application for ulcer detection. The Open Biomedical Engineering Journal 12:16
Franc S, Daoudi A, Mounier S, Bou cherie B, Laroye H, Peschard C, Dardari D, Juy O, Requeda E, Canipel L et al (2011) Telemedicine: what more is needed for its integration in everyday life? Diabetes Metab 37:S71–S77
Geng L, Yan T, Xiao Z, Xi J, Li Y (2017) Hatching eggs classification based on deep learning. Multimed Tools Appl:1–12
Gibiansky A (2018) Convolutional neural networks. http://andrew.gibiansky.com/blog/machine-learning / convolutional- neural-networks/. Accessed 26 December 2018
Goyal M, Reeves ND, Davison AK, Rajbhandari S, Spragg J, Yap MH (2018) Dfunet: convolutional neural networks for diabetic foot ulcer classification. IEEE Transactions on Emerging Topics in Computational Intelligence
Goyal M, Yap MH, Reeves ND, Rajbhandari S, Spragg J (2017) Fully convolutional networks for diabetic foot ulcer segmentation. In: 2017 IEEE international conference on systems, man, and cybernetics (SMC) (pp. 618–623). IEEE
Hazenberg CE, van Netten JJ, van Baal SG, Bus SA, Bus S (2014) Assessment of signs of foot infection in diabetes patients using photographic foot imaging and infrared thermography. Diabetes Technol Ther 16(6):370–377
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778)
Hermans MH (2010) Wounds and ulcers: back to the old nomenclature. Wounds 22(11):289–293
Huang J, Li B, Zhu J, Chen J (2017) Age classification with deep learning face representation. Multimed Tools Appl:20231–20247
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700–4708)
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167
Jegede O, Ferens K, Griffith B, Podaima B (2015) A smart shoe to prevent and manage diabetic foot diseases. In: Int’l Conf. Health informatics and medical systems (pp. 47–54)
Kolesnik M, Fexa A (2006) How robust is the SVM wound segmentation? In: Proceedings of the 7th Nordic Signal Processing Symposium-NORSIG 2006 (pp. 50–53). IEEE.
Koushik J (2016) Understanding convolutional neural networks. arXiv preprint arXiv:1605.09081
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097–1105)
Lavery LA, Armstrong DG, Harkless LB (1996) Classification of diabetic foot wounds. J Foot Ankle Surg 35(6):528–531
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88
Liu C, van Netten JJ, van Baal JG, Bus SA, van der Heijden F (2015) Automatic detection of diabetic foot complications with infrared thermography by asymmetric analysis. J Biomed Opt 20(2):26003
Lu H, Li Y, Uemura T, Ge Z, Xu X, He L, Kim H (2018) FDCNet: filtering deep convolutional network for marine organism classification. Multimed Tools Appl 77(17):21847–21860
Nair LR (2019) RetoNet: a deep learning architecture for automated retinal ailment detection. Multimed Tools Appl:1–10
Nawaz W, Ahmed S, Tahir A, Khan HA (2018) Classification of breast Cancer histology images using ALEXNET. In: International conference image analysis and recognition. Springer, Cham, pp 869–876
Ram Avrahami MD, Jonathan Rosenblum DPM, Michael Gazes DPM, Sean Rosenblum DPM (2015) The effect of combined ultrasound and electric field stimulation on wound healing in chronic ulcerations. Wounds 27(7):199–208
Ravishankar H, Sudhakar P, Venkataramani R, Thiruvenkadam S, Annangi P, Babu N, Vaidya V (2016) Understanding the mechanisms of deep transfer learning for medical images. In: Deep learning and data labeling for medical applications. Springer, Cham, pp 188–196
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Berg AC (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252
Sainath TN, Mohamed AR, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR. In: 2013 IEEE international conference on acoustics, speech and signal processing (pp. 8614–8618). IEEE
Salamon J, Bello JP (2017) Deep convolutional neural networks and data augmentation for environmental sound classification. IEEE Signal Processing Letters 24(3):279–283
Sert M, Boyacı E (2019) Sketch recognition using transfer learning. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-018-7067-1
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15(1):1929–1958
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9)
Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd ACM international conference on multimedia (pp. 689–692). ACM
Veredas FJ, Luque-Baena RM, Martín-Santos FJ, Morilla-Herrera JC, Morente L (2015) Wound image evaluation with machine learning. Neurocomputing 164:1–11
Veredas F, Mesa H, Morente L (2010) Binary tissue classification on wound images with neural networks and bayesian classifiers. IEEE Trans Med Imaging 29(2):410–427
Vesal S, Ravikumar N, Davari A, Ellmann S, Maier A (2018) Classification of breast cancer histology images using transfer learning. In: International conference image analysis and recognition. Springer, Cham, pp 812–819
Vijayalakshmi A, Rajesh Kanna B (2019) Deep learning approach to detect malaria from microscopic images. Multimedia Tools Application:1–21
Vilcahuaman L, Harba R, Canals R, Zequera M, Wilches C, Arista M, Torres L, Arbanil H (2015) Automatic analysis of plantar foot thermal images in at-risk type II diabetes by using an infrared camera. IFMBE Proc 51:228–231
Wang L, Pedersen PC, Agu E, Strong DM, Tulu B (2017) Area determination of diabetic foot ulcer images using a cascaded two-stage SVM-based classification. IEEE Trans Biomed Eng 64(9):2098–2109
Wang J, Perez L (2017) The effectiveness of data augmentation in image classification using deep learning. Convolutional Neural Networks Vis. Recognit.
Wild S, Roglic G, Green A, Sicree R, King H (2004) Global prevalence of diabetes estimates for the year 2000 and projections for 2030. Diabetes Care 27(5):1047–1053
World Health Organization (2016) Global report on diabetes. http://www.who.int/diabetes/global-report/en Accessed 6 Feb. 2009
Yu Y, Lin H, Meng J, Wei X, Guo H, Zhao Z (2017) Deep transfer learning for modality classification of medical images. Information 8(3):91
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision. Springer, pp 818–833
Zhang G, Hsu C-HR, Lai H, Zheng X (2018) Deep learning based feature representation for automated skin histopathological image annotation. Multimed Tools Appl 77(8):9849–9869
Zhu X, Li Z, Zhang X-Y, Li P, Xue Z, Wang L (2018) Deep convolutional representations and kernel extreme learning machines for image classification. Multimed Tools Appl:1–20
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alzubaidi, L., Fadhel, M.A., Oleiwi, S.R. et al. DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network. Multimed Tools Appl 79, 15655–15677 (2020). https://doi.org/10.1007/s11042-019-07820-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-07820-w