Skip to main content
SpringerLink
Log in

Enhanced U-Net segmentation with ensemble convolutional neural network for automated skin disease classification

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

In recent years, skin-related problems induce psychological problems and also injure physical health, particularly if the patient’s face was disfigured or damaged. Smart devices are used for gathering medical images for knowing their skin condition. Skin disease diagnosis is a complex task, which can be solved by adopting different lesion detection and classification approaches. However, the existing challenges cannot be solved by mixing the disease samples from diverse data sources while using simple data fusion approaches. The traditional deep learning-based computer-aided diagnosis approaches suffer from poor extraction of skin lesions due to complex features like limited training datasets, low contrast with the background, presence of artifacts, and fuzzy boundaries. It also includes problems like complex computation, poor generalization, and over-fitting while using the appropriate tuning of large-scale parameters. This paper intends to propose a new framework by using skin lesions classification and segmentation procedures for the automated diagnosis of various skin diseases. The significant stages of the given offered method are pre-processing lesion segmentation and classification. In the beginning, grey-level conversion, hair removal, and contrast enhancement are performed to make the image fit for effective classification. Once image pre-processing is over, the segmentation of skin lesions is done by the enhanced U-Net segmentation, in which the improvement is attained by proposing a hybrid optimization algorithm. Moreover, the offered hybridized optimization algorithm solves the local optimum issues, and also it has the ability for resolving a finite set of problems. Merging the optimization algorithms can balance the exploration and exploitation capability owing to its ability of convergence speed, searching global optimum, and simplicity. The classification is further performed by the optimized ensemble-convolutional neural network (E-CNN). Instead of the fully connected layer in CNN, five different expert systems like random forest, artificial neural network, support vector machine, Adaboost, and Extreme Gradient Boosting (XGBoost) are used for classifying the skin disease by CNN. The system also employs optimization of different parameters in the classification stage to improve computing efficiency and reduce network complexity. The hybrid meta-heuristic termed whale-electric fish optimization (W-EFO) based on EFO and whale optimization algorithm is used for improvising the segmentation and classification task. The comparative analysis over conventional models proves that the developed model encourages effective performance when analyzing diverse measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Abbreviations

BCC:

Basal cell carcinoma

SK:

Seborrheic keratosis

SCC:

Squamous cell carcinoma

AK:

Actinic keratosis

SVM:

Support vector machine

DNN:

Deep neural networks

ANN:

Artificial neural network

PSO:

Particle swarm optimization

MRI:

Magnetic resonance imaging

CT:

Computed tomography

DNN:

Deep neural networks

AUC:

Area under the ROC curve

ROS:

Rosacea

RNN:

Recurrent neural networks

LE:

Lupus erythematosus

FrCN:

Full-resolution convolutional network

GWO:

Grey wolf optimization

FCN:

Fully convolutional network

CRF:

Conditional random field

References

  1. Satheesha TY, Satyanarayana D, Prasad MNG, Dhruve KD (2017) Melanoma is skin deep: a 3D reconstruction technique for computerized dermoscopic skin lesion classification. IEEE J Transl Eng Health Med 5:1–17

    Article  Google Scholar 

  2. Zhang J, Xie Y, Xia Y, Shen C (2019) Attention residual learning for skin lesion classification. IEEE Trans Med Imaging 38(9):2092–2103

    Article  Google Scholar 

  3. Masood A, Ali Al-Jumaily A (2013) Computer aided diagnostic support system for skin cancer: a review of techniques and algorithms. Int J Biomed Imaging 2013:1–22

    Article  Google Scholar 

  4. Swetter SM, Geller AC, Leachman SA, Kirkwood JM, Katalinic A, Gershenwald JE (2020) Melanoma prevention and screening, cutaneous melanoma. Springer, pp 525–570

    Book  Google Scholar 

  5. Albahar MA (2019) Skin lesion classification using convolutional neural network with novel regularizer. IEEE Access 7:38306–38313

    Article  Google Scholar 

  6. Abbott LM, Smith SD (2018) Smartphone apps for skin cancer diagnosis: Implications for patients and practitioners. Australas J Dermatol 59(3):168–170

    Article  Google Scholar 

  7. Sáez A, Acha B, Serrano C (2014) Pattern analysis in dermoscopic images. In: Computer vision techniques for the diagnosis of skin cancer (series in bioengineering). Springer, pp 23–48

  8. Barata C, Marques J, Mendonça T (2013) Bag-of-features classification model for the diagnose of melanoma in dermoscopy images using color and texture descriptors. In: Kamel M, Campilho A (eds) Proceedings of international conferences on image analysis recognition. Lecture notes in computer science, vol 7950. Springer, Berlin, pp. 547–555

  9. Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828

    Article  Google Scholar 

  10. Chang H, Zhou Y, Borowsky A, Barner K, Spellman P, Parvin B (2014) Stacked predictive sparse decomposition for classification of histology sections. Int J Comput Vis 113(1):3–18

    Article  MathSciNet  Google Scholar 

  11. Wang H, Cruz-Roa A, Basavanhally A, Gilmore H, Shih N, Feldman M, Tomaszewski J, Gonzalez F, Madabhushi A (2014) Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection. Proc SPIE 9041:66–75

    Google Scholar 

  12. Deng J, Dong W, Socher R et al (2009) ImageNet: a large-scale hierarchical image database. In: Computer vision and pattern recognition, IEEE

  13. Kharazmi P, AlJasser MI, Lui H, Wang ZJ, Lee TK (2017) Automated detection and segmentation of vascular structures of skin lesions seen in dermoscopy, with an application to basal cell carcinoma classification. IEEE J Biomed Health Inform 21(6):1675–1684

    Article  Google Scholar 

  14. Celebi ME, Wen Q, Iyatomi H, Shimizu K, Zhou H, Schaefer G (2015) A state-of-the-art survey on lesion border detection in dermoscopy images. Dermoscopy Image Anal 10:97–129

    Google Scholar 

  15. Barata ACF, Celebi EM, Marques J (2018) A survey of feature extraction in dermoscopy image analysis of skin cancer. IEEE J Biomed Health Inform

  16. Kang Q, Shi L, Zhou M, Wang X, Wu Q, Wei Z (2018) A distance-based weighted undersampling scheme for support vector machines and its application to imbalanced classification. IEEE Trans Neural Netw Learn Syst 29(9):4152–4165

    Article  Google Scholar 

  17. Gessert N et al (2020) Skin lesion classification using CNNs with patch-based attention and diagnosis-guided loss weighting. IEEE Trans Biomed Eng 67(2):495–503

    Article  Google Scholar 

  18. Pham T-C, Doucet A, Luong C-M, Tran C-T, Hoang V-D (2020) Improving skin-disease classification based on customized loss function combined with balanced mini-batch logic and real-time image augmentation. IEEE Access 8:150725–150737

    Article  Google Scholar 

  19. Gu Y, Ge Z, Bonnington CP, Zhou J (2020) Progressive transfer learning and adversarial domain adaptation for cross-domain skin disease classification. IEEE J Biomed Health Inform 24(5):1379–1393

    Article  Google Scholar 

  20. Ahmad B, Usama M, Huang C, Hwang K, Hossain MS, Muhammad G (2020) Discriminative feature learning for skin disease classification using deep convolutional neural network. IEEE Access 8:39025–39033

    Article  Google Scholar 

  21. Wu Z et al (2019) Studies on different CNN algorithms for face skin disease classification based on clinical images. IEEE Access 7:66505–66511

    Article  Google Scholar 

  22. Adegun AA, Viriri S (2020) FCN-based DenseNet framework for automated detection and classification of skin lesions in dermoscopy images. IEEE Access 8:150377–150396

    Article  Google Scholar 

  23. Al-Masni MA, Kim DH, Kim TS (2020) Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification. Comput Methods Progr Biomed 190:105351

    Article  Google Scholar 

  24. Chaturvedi SS, Tembhurne JV, Diwan T (2020) A multi-class skin cancer classification using deep convolutional neural networks. Multimed Tools Appl 79(39):28477–28498

    Article  Google Scholar 

  25. Harangi B, Baran A, Hajdu A (2020) Assisted deep learning framework for multi-class skin lesion classification considering a binary classification support. Biomed Signal Process Control 62:102041

    Article  Google Scholar 

  26. Güneş A, Kalkan H, Durmuş E (2016) Optimizing the color-to-grayscale conversion for image classification. Signal Image Video Process 10:853–860

    Article  Google Scholar 

  27. Muthu R, Saritha S, Rani C, Pearl Mary S (2017) Morphological operations in medical image pre-processing. In: International conference on advanced computing and communication systems

  28. Patel O, Maravi YPS, Sharma S (2013) a comparative study of histogram equalization based image enhancement techniques for brightness preservation and contrast enhancement. Signal Image Process 4(5)

  29. Hambarde P et al (2020) Prostate lesion segmentation in MR images using radiomics based deeply supervised U-Net. Biocybern Biomed Eng 40(4):1421–1435

    Article  Google Scholar 

  30. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  31. Yilmaz S, Sen S (2020) Electric fish optimization: a new heuristic algorithm inspired by electrolocation. Neural Comput Appl 32:11543–11578

    Article  Google Scholar 

  32. Marsaline Beno M, Valarmathi IR, Swamy SM, Rajakumar BR (2014) Threshold prediction for segmenting tumour from brain MRI scans. Int J Imaging Syst Technol 24(2):129–137

    Article  Google Scholar 

  33. Akram T, Junaid Lodhi HM, Naqvi SR, Naeem S, Alhaisoni M, Ali M, Haider SA, Qadri NN (2020) A multilevel features selection framework for skin lesion classification. In: Human centric computing and information sciences, vol 10, no 12

  34. Martens D, Baesens BB, Van Gestel T (2009) Decompositional rule extraction from support vector machines by active learning. IEEE Trans Knowl Data Eng 21(2):178–191

    Article  Google Scholar 

  35. Dhivyaa CR, Sangeetha K, Balamurugan M, Amaran S, Vetriselvi T, Johnpaul P (2016) Skin lesion classifcation using decision trees and random forest algorithms. J Ambient Intell Hum Comput 161

  36. Taherkhani A, Cosma G, McGinnity TM (2020) AdaBoost-CNN: an adaptive boosting algorithm for convolutional neural networks to classify multi-class imbalanced datasets using transfer learning. Neurocomputing 404:351–366

    Article  Google Scholar 

  37. Rahman M, Cao Y, Sun X, Li B, Hao Y (2021) Deep pre-trained networks as a feature extractor with XGBoost to detect tuberculosis from chest X-ray. Comput Electr Eng 93:107252

    Article  Google Scholar 

  38. Moraes R, Valiati JF, Gavião Neto WP (2013) Document-level sentiment classification: an empirical comparison between SVM and ANN. Expert Syst Appl 40(2):621–633

    Article  Google Scholar 

  39. Abdenour M, Karim M (2015) Improved fuzzy C-means based Particle Swarm Optimization (PSO) initialization and outlier rejection with level set methods for MR brain image segmentation. Comput Methods Progr Biomed 122(2):266–281

    Article  Google Scholar 

  40. Nirmala Sreedharan NP, Ganesan B, Raveendran R, Sarala P, Dennis B, Boothalingam R (2018) Grey Wolf optimisation-based feature selection and classification for facial emotion recognition. IET Biometrics 7(5):490–499

    Article  Google Scholar 

  41. Song Q, Wu Y, Soh YC (2008) Robust adaptive gradient-descent training algorithm for recurrent neural networks in discrete time domain. IEEE Trans Neural Netw 19(11):1841–1853

    Article  Google Scholar 

  42. Ghassemi N, Shoeibi A, Rouhani M (2020) Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images. Biomed Signal Process Control 57:101678

    Article  Google Scholar 

  43. Sharma DK, Chakravarthi DS, Boddu RSK, Madduri A, Ayyagari MR, Mohiddin MK (2022) Effectiveness of machine learning technology in detecting patterns of certain diseases within patient electronic healthcare records. In: Proceedings of second international conference in mechanical and energy technology, vol 290, pp 73–81

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, NIT, Raipur, India

    Dasari Anantha Reddy, Sanjay Kumar & Rakesh Tripathi

  2. Department of Computer Applications, Sikkim University, 6th Mile, Samdur, Tadong, Gangtok, Sikkim, 737102, India

    Swarup Roy

Authors
  1. Dasari Anantha Reddy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Swarup Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sanjay Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rakesh Tripathi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have made substantial contributions to conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Swarup Roy.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Reddy, D.A., Roy, S., Kumar, S. et al. Enhanced U-Net segmentation with ensemble convolutional neural network for automated skin disease classification. Knowl Inf Syst 65, 4111–4156 (2023). https://doi.org/10.1007/s10115-023-01865-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-023-01865-y

Keywords

Search

Navigation