Skip to main content
Springer Nature Link
Log in

DermSegNet: smart IoT model for multi-class dermatological lesion diagnosis using adaptive segmentation and improved EfficientNetB3

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Subjective visual examination by human dermatologists is associated with inter-observer variability and error. To address this problem, we present a method to accurately diagnose the 23 most common skin conditions, using an adaptive GrabCut approach with the EfficientNetB3 model, for accurate segmentation and classification, respectively. Using a custom loss function, this strategy is combined with data-level preprocessing employing algorithm-level approaches. The unbalanced Dermnet dataset, which includes 19,500 images of skin lesions representing the 23 most common skin conditions, was corrected by downsampling the major classes and enhancing the minor classes. The custom loss function and ADG significantly enhanced model accuracy by accurately segmenting regions of interest in the images, retaining the most relevant diagnostic information. The MSE, PSNR and Jacquard index support the best segmentation result with values 32.94, 70.23, 0.71 respectively. The results demonstrated very high accuracy, with top-5 and top-1 accuracy rates of 95% and 80.02%, respectively. The diagnoses of acne and nail fungi were exceptionally good, with precision rates exceeding 0.80 and 0.856, respectively. Our Dermnet-trained model is the most accurate of all state-of-the-art models published to date.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The data presented in this study are available on request from the corresponding author.

Code availability

The data presented in this study are available on request from the corresponding author and the code is available on GitHub.

References

  1. Shinde RK, Alam Park M, Kim N (2022) Intelligent IoT (IIoT) device to identifying suspected COVID-19 infections using sensor fusion algorithm and real-time mask detection based on the Enhanced MobileNetV2 Model. Healthcare 10(3):454. https://doi.org/10.3390/healthcare10030454

    Article  Google Scholar 

  2. Shinde RK, Alam M, Hossain M, Md IS, J. Kim J, Padwal A, Kim N, et al (2022) Squeeze-MNet: precise skin cancer detection model for low computing IoT devices using transfer learning. Cancers 15(1):12. https://doi.org/10.3390/cancers15010012

    Article  Google Scholar 

  3. Hossain M, Kwon KC, Imtiaz S, Nam OS, Jeon SH, Kim N et al (2023) De-Aliasing and accelerated sparse magnetic resonance image reconstruction using fully dense cnn with attention gates. Bioengineering 10:22. https://doi.org/10.3390/bioengineering10010022

    Article  Google Scholar 

  4. Thieme AH, Zheng Y, Machiraju G, Sadee C, Mittermaier M, Gevaert O (2023) A deep-learning algorithm to classify skin lesions from mpox virus infection. Nat Med 29:738–747. https://doi.org/10.1038/s41591-023-02225-7

    Article  Google Scholar 

  5. Foersch S, Glasner C, Woerl A, Eckstein M, Wagner D, Schulz S et al (2023) Multistain deep learning for prediction of prognosis and therapy response in colorectal cancer. Nat Med 29:430–439. https://doi.org/10.1038/s41591-022-02134-1

    Article  Google Scholar 

  6. Franki R.(2017) Skin disease costs $75 billion a year. Mdedge. https://www.mdedge.com/internalmedicine/article/132680/practice-management/skin-disease-costs-75-billion-year

  7. Liu Y, Jain A, Eng C, Way DH, Lee K, Bui P (2020) A deep learning system for differential diagnosis of skin diseases. Nat Med 26:900–908. https://doi.org/10.1038/s41591-020-0842-3

    Article  Google Scholar 

  8. Viriri S, Adegun AA (2019) Deep learning-based system for automatic melanoma detection. IEEE Access 8:7160–7172. https://doi.org/10.1109/ACCESS.2019.2962812

    Article  Google Scholar 

  9. Quattrini A, Boër TLC, Paydar R (2022) A deep learning-based facial acne classification system. Clin Cosmet Investig Dermatol 15:851–857. https://doi.org/10.2147/CCID.S360450

    Article  Google Scholar 

  10. Phan DT, Bao QB, Huynh TC, Vo TH, Park S, Choi J, Oh J (2021) A smart LED therapy device with an automatic facial acne vulgaris diagnosis based on deep learning and internet of things application. Comput Biol Med 136:1–12. https://doi.org/10.1016/j.compbiomed.2021.10461

    Article  Google Scholar 

  11. Rai G, Naveen SS, Ansari A, Khanduja N (2021) An approach to detect alopecia areata hair disease using deep learning. In: Proceedings of 6th International Conference on Recent Trends in Computing. Lecture Notes in Networks and Systems. https://doi.org/10.1007/978-981-33-4501-0_71.

  12. Kassem M, Hosny KM, Damaševičius R, Eltoukhy MM (2021) Machine learning and deep learning methods for skin lesion classification and diagnosis: a systematic review. Diagnostics 11:1390. https://doi.org/10.3390/diagnostics11081390

    Article  Google Scholar 

  13. Son H, Jeon W, Kim J, Heo C, Park J (2021) AI-based localization and classification of skin disease with erythema. Sci Rep 11:5350. https://doi.org/10.1038/s41598-021-84593-z

    Article  Google Scholar 

  14. Wibowo A, Purnama SR, Rasyidi H (2021) Lightweight encoder-decoder model for automatic skin lesion segmentation. Inform Med Unlocked 25:1–17. https://doi.org/10.1016/j.imu.2021.100640

    Article  Google Scholar 

  15. Ozturk S, Ozkaya U (2020) Skin Lesion Segmentation with Improved Convolutional Neural Network. J Digital Imaging 33:989–970. https://doi.org/10.1007/s10278-020-00343-z

    Article  Google Scholar 

  16. Goel S.(2020) Dermnet. Kaggle, https://www.kaggle.com/datasets/shubhamgoel27/dermnet.

  17. Liao H (2015) A deep learning approach to universal skin disease classification. University of Rochster.

  18. Maron R, Utikal J, Hekler A, Hauchild A, Sattler E, Brinker T (2020) Artificial intelligence and its effect on dermatologists accuracy in dermoscopic melanoma image classification: Web-Based Survey Study. J Med Internet Res 22:1–9. https://doi.org/10.2196/18091

    Article  Google Scholar 

  19. Dhawan AP, Sim A (1992) Segmentation of images of skin lesions using color and texture information of surface pigmentation. Comput Med Imaging Graph 16:163–177. https://doi.org/10.1016/0895-6111(92)90071-G

    Article  Google Scholar 

  20. Friedman RJ, Rigel DS, Kopf AW (1985) Early detection of malignant melanoma: the role of physician examination and self-examination of the skin. CA: A Cancer J Clin 35:130–151. https://doi.org/10.3322/canjclin.35.3.130

    Article  Google Scholar 

  21. Uniqtech. (2020 )Understand jaccard index, jaccard similarity in minutes. Medium,. https://medium.com/data-science-bootcamp/understand-jaccard-index-jaccard-similarity-in-minutes-25a703fbf9d7. [Accessed 15 April 2023].

  22. Shen X, Zhang J, Yan C, Zhou H (2018) An automatic diagnosis method of facial acne vulgaris based on convolutional neural network. Sci Rep 8:10. https://doi.org/10.1038/s41598-018-24204-6

    Article  Google Scholar 

  23. Han SS, Park I, Chang SE, Lim W, Kim MS, Park GH et al (2020) Augmented intelligence dermatology: deep neural networks empower medical professionals in diagnosing skin cancer and predicting treatment options for 134 skin disorders. J Investig Dermatol 140:1753–1761. https://doi.org/10.1016/j.jid.2020.01.019

    Article  Google Scholar 

  24. Prakash J, Vinoth B, Ganesh C (2020) A comparative analysis of deep learning models to predict dermatological disorder. J Xi’an Univ Archit Technol 12(11):11

    Google Scholar 

  25. Jinnai S, Yamazaki N, Hirano Y, Sugawara Y, Ohe Y, Hamamoto R (2020) The development of a skin cancer classification system for pigmented skin lesions using deep learning. Biomolecules 10(8):1. https://doi.org/10.3390/biom10081123

    Article  Google Scholar 

  26. Thomas L, Tranchand P, Berard F, Secchi T, Colin C, Moulin G (1998) Semiological value of ABCDE criteria in the diagnosis of cutaneous pigmented tumors. Clin Lab Investig 197:11–17. https://doi.org/10.1159/000017969

    Article  Google Scholar 

  27. Jensen JD, Elewski B (2015) The ABCDEF Rule: combining the “ABCDE Rule” and the “Ugly Duckling Sign” in an effort to improve patient self-screening examinations. J Clin Aesthetic Derm 8:15–25

    Google Scholar 

  28. López-Leyva JA, Álvarez-Borrego J (2021) Multi-class diagnosis of skin lesions using the Fourier spectral information of images on additive color model by artificial neural network. IEEE Access 9:35207–35216. https://doi.org/10.1109/ACCESS.2021.3061873

    Article  Google Scholar 

  29. Kassem MA, Fouad MM (2020) Skin lesions classification into eight classes for ISIC 2019 using deep convolutional neural network and transfer learning. IEEE Access 8:114822–114832. https://doi.org/10.1109/ACCESS.2020.3003890

    Article  Google Scholar 

  30. Wang G, Li W, Zuluaga M, Pratt R, Patel P, Aertsen M (2018) Interactive medical image segmentation using deep learning with image-specific fine tuning. IEEE Trans Med Imaging 37:1562–1573. https://doi.org/10.1109/TMI.2018.2791721

    Article  Google Scholar 

  31. Jaisakthi SM, Mirunalini P, Aravindan C (2018) Automated skin lesion segmentation of dermoscopic images using GrabCut and k-means algorithms. IET Comput Vision 12:1088–1095. https://doi.org/10.1049/iet-cvi.2018.5289

    Article  Google Scholar 

  32. Ünver HM, Ayan E (2019) Skin lesion segmentation in dermoscopic images with combination of YOLO and GrabCut Algorithm. Diagnostics 9:79. https://doi.org/10.3390/diagnostics9030072

    Article  Google Scholar 

Download references

Funding

This work was supported by an Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea Government (MSIT) (IITP-2020–0-01846). The English in this document has been checked by at least two professional editors, both native speakers of English. For a certificate, please see: http://www.textcheck.com/certificate/w39MV9

Author information

Authors and Affiliations

  1. Information and Communication Engineering, Chungbuk National University, Cheongju, South Korea

    Rupali Kiran Shinde, Md.Biddut Hossain, Syed Naheel Raza Rizvi, Shariar Md Imtiaz, Ki-Chul Kwon & Nam Kim

Authors
  1. Rupali Kiran Shinde
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Md.Biddut Hossain
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Syed Naheel Raza Rizvi
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Shariar Md Imtiaz
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Ki-Chul Kwon
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Nam Kim
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Nam Kim.

Ethics declarations

Ethical and informed consent for data used.

The Derment database is freely accessible after acceptance of the terms and conditions.

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shinde, R.K., Hossain, M., Rizvi, S.N.R. et al. DermSegNet: smart IoT model for multi-class dermatological lesion diagnosis using adaptive segmentation and improved EfficientNetB3. Appl Intell 54, 6930–6945 (2024). https://doi.org/10.1007/s10489-024-05520-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05520-z

Keywords