Skip to main content
Log in

A novel and efficient approach for the classification of skin melanoma

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Melanoma is a very common type of skin cancer that is an out-of-control growth of the cell. The detection of melanoma is very crucial in clinical practice due to irregularity in the shape of border and difference of tissue. Even though there are several methods proposed in literature, the identification of melanoma is still a complex process. This work proposes a novel Color Local Directional Pattern-based feature extraction technique for the classification of the skin cancer images. Along with the Color Local Directional Pattern this work also uses various descriptors for shape, color and Pyramid Histogram of Oriented Gradients. This method also uses a stacked Restricted Boltzmann Machine in Deep Belief Network, Support Vector Machine and Random Forest classifier for the classification. The experiments used the images from International Skin Imaging Collaboration (ISIC) 2016, ISIC 2017, Pedro Hispano Hospital (PH2) dataset, Dermnet and DermIS datasets. The performance metrics like specificity, sensitivity, F-Score, positive predictive value, accuracy, harmonic mean, and Area Under the Curve (AUC) are used for the experimental analysis. The results show that the proposed work achieves best results while using the combination of texture, color and shape descriptors and stacked RBM in DBN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig.2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data availability

All data and materials as well as software application or custom code support their published claims and comply with field standards.

References

  • Akram T, Khan MA, Sharif M, Yasmin M (2018) Skin lesion segmentation and recognition using multichannel saliency estimation and M-SVM on selected serially fused features. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-018-1051-5

    Article  Google Scholar 

  • Alphonse AS, Starvin MS (2019) A novel maximum and minimum response-based Gabor (MMRG) feature extraction method for facial expression recognition. Multimed Tools Appl 78(16):23369–23397

    Article  Google Scholar 

  • Bai Y, Guo L, Jin L, Huang Q (2009) A novel feature extraction method using pyramid histogram of orientation gradients for smile recognition. 2009 16th IEEE International Conference on Image Processing (ICIP). IEEE, Cairo, pp 3305–3308

    Google Scholar 

  • Bajwa MN, Muta K, Malik MI, Siddiqui SA, Braun SA, Homey B, Dengel A, Ahmed S (2020) Computer-aided diagnosis of skin diseases using deep neural networks. Applied Sciences 10(7):2488

    Article  Google Scholar 

  • Bi L, Kim J, Ahn E, Feng D, Fulham M (2016) Automatic melanoma detection via multi-scale lesion-biased representation and joint reverse classification. 2016 IEEE 13th international symposium on biomedical imaging (ISBI). IEEE, Prague, pp 1055–1058

    Chapter  Google Scholar 

  • Brinker TJ, Hekler A, Enk AH, von Kalle C (2019) Enhanced classifier training to improve precision of a convolutional neural network to identify images of skin lesions. PLoS ONE 14(6):e0218713. https://doi.org/10.1371/journal.pone.0218713

    Article  Google Scholar 

  • Codella NC, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittle H, Halpern A (2018) Skin lesion analysis toward melanoma detection: a challenge at the 2017 International symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic). 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). IEEE, Washington, DC, pp 168–172

    Chapter  Google Scholar 

  • De Gruul FR, Van der Leun JC (1980) A dose-response model for skin cancer induction by chronic UV exposure of a human population. J Theor Biol 83(3):487–504

    Article  Google Scholar 

  • El-Regaily SA, Salem MA, Abdel Aziz MH, Roushdy MI (2018) Survey of computer aided detection systems for lung cancer in computed tomography. Curr Med Imaging Rev 14:3–18

    Article  Google Scholar 

  • Friedman JH (2002) Stochastic gradient boosting. Comput Stat Data Anal 38(4):367–378

    Article  MathSciNet  Google Scholar 

  • Garg N, Sharma V, Kaur P (2018) Melanoma skin cancer detection using image processing. Sensors and Image Processing. Springer, Singapore, pp 111–119

    Google Scholar 

  • Gonzalez-Castro V, Debayle J, Wazaefi Y, Rahim M, Gaudy-Marqueste C, Grob JJ, Fertil B (2015) Automatic classification of skin lesions using color mathematical morphology-based texture descriptors. Twelfth International Conference On Quality Control By Artificial Vision. International Society for Optics and Photonics, Washington DC

    Google Scholar 

  • Goyal M, Oakley A, Bansal P, Dancey D, Yap MH (2019) Automatic lesion boundary segmentation in dermoscopic images with ensemble deep learning methods. arXiv preprint. http://www.com/arXiv:1902.00809

  • Gutman D, Codella NC, Celebi E, Helba B, Marchetti M, Mishra N, Halpern A (2016) Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI), hosted by the International skin imaging collaboration (ISIC). arXiv preprint. http://www.com/arXiv:1605.01397

  • Hagerty JJ, Rabinovitz HS, Oliviero M, Stoecker WV (2019) Deep learning and handcrafted method fusion: higher diagnostic accuracy for melanoma dermoscopy images. IEEE J Biomed Health 23(4):1385–1391

    Article  Google Scholar 

  • Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern B 6:610–621

    Article  Google Scholar 

  • Harangi B (2018) Skin lesion classification with ensembles of deep convolutional neural networks. J Biomed Inform 86:25–32

    Article  Google Scholar 

  • Huang GB, Zhou H, Ding X, Zhang R (2011) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B 42(2):513–529

    Article  Google Scholar 

  • Jabid T, Kabir MH, Chae O (2010) Local directional pattern (LDP) for face recognition. Digest of technical papers IEEE International conference on consumer electronics (ICCE). IEEE, Las Vegas, pp 329–330

    Google Scholar 

  • Kasmi R, Mokrani K (2016) Classification of malignant melanoma and benign skin lesions: implementation of automatic ABCD rule. IET Image Process 10(6):448–455

    Article  Google Scholar 

  • Kaur R, Kaur G (2013) Skin Cancer–Melanoma Detection in Skin Images Using Local Binary Pattern (LBP) and GLCM. Int J Sci Res (IJSR) 4(7)

  • Keyvanrad MA, Homayounpour MM (2014) A brief survey on deep belief networks and introducing a new object oriented toolbox (DeeBNet). arXiv preprint. http://www.com/arXiv:1408.3264

  • Khan MA, Sharif M, Akram T, Bukhari SAC, Nayak RS (2020) Developed Newton-Raphson based deep features selection framework for skin lesion recognition. Pattern Recognit Lett 129:293–303

    Article  Google Scholar 

  • Lopez AR, Giro-i-Nieto X, Burdick J, Marques O (2017) Skin lesion classification from dermoscopic images using deep learning techniques. IEEE2017 13th IASTED International Conference on biomedical engineering (BioMed). IEEE, Innsbruck, pp 49–54

    Google Scholar 

  • Matsunaga K, Hamada A, Minagawa A, Koga H (2017) Image classification of melanoma, nevus and seborrheic keratosis by deep neural network ensemble. arXiv preprint. http://www.com/arXiv:1703.03108

  • Mendonça T, Ferreira PM, Marques JS, Marcal AR, Rozeira J (2013) PH 2-A dermoscopic image database for research and benchmarking. 2013 35th Annual International Conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, Osaka, pp 5437–5440

    Chapter  Google Scholar 

  • Mohan G, Subashini MM (2018) MRI based medical image analysis: survey on brain tumor grade classification. Biomed Signal Process Control 39:139–161

    Article  Google Scholar 

  • Mukherjee S, Adhikari A, Roy M (2019) Melanoma identification Using MLP with parameter selected by metaheuristic algorithms. Intelligent innovations in multimedia data engineering and management. IGI Global, Hershey, pp 241–268

    Chapter  Google Scholar 

  • Ojala T, Pietikäinen M, Mäenpää T (2001) A generalized local binary pattern operator for multi resolution gray scale and rotation invariant texture classification. International Conference on Advances in Pattern Recognition. Springer, Berlin, Heidelberg, pp 399–408

    MATH  Google Scholar 

  • Pang H, Lin A, Holford M, Enerson BE, Lu B, Lawton MP, Floyd E, Zhao H (2006) Pathway analysis using random forests classification and regression. Bioinformatics 22(16):2028–2036

    Article  Google Scholar 

  • Pathan S, Prabhu KG, Siddalingaswamy PC (2018) A methodological approach to classify typical and atypical pigment network patterns for melanoma diagnosis. Biomed signal proces 44:25–37

    Article  Google Scholar 

  • Pereira SM, Frade MAC, Rangayyan RM, Azevedo-Marques PM (2013) Classification of color images of dermatological ulcers. IEEE J Biomed Health Inform 17(1):136–142

    Article  Google Scholar 

  • Rajinikanth V, Satapathy SC, Dey N, Fernandes SL, Manic KS (2019) Skin melanoma assessment using Kapur’s entropy and level set—a study with bat algorithm. Smart intelligent computing and applications. Springer, Singapore, pp 193–202

    Google Scholar 

  • Razmjooy N, Mousavi BS, Soleymani F (2012) A real-time mathematical computer method for potato inspection using machine vision. Comput Math Appl 63:268–279

    Article  Google Scholar 

  • Satheesha TY, Satyanarayana D, Prasad MG, Dhruve KD (2017) Melanoma is Skin Deep: A 3D reconstruction technique for computerized dermoscopic skin lesion classification. IEEE J Transl Eng Health Med 5:1–17

    Article  Google Scholar 

  • Siegel RL, Miller KD, Jemal A (2019) Cancer statistics. CA Cancer J Clin 66:7–30

    Article  Google Scholar 

  • Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300

    Article  Google Scholar 

  • Waheed Z, Waheed A, Zafar M, Riaz F (2017) An efficient machine learning approach for the detection of melanoma using dermoscopic images. 2017 IEEE International Conference on Communication, Computing and Digital Systems (C-CODE). IEEE, Islamabad, pp 316–319

    Chapter  Google Scholar 

  • Yu P, Qin AK, Clausi DA (2011) Unsupervised polarimetric SAR image segmentation and classification using region growing with edge penalty. IEEE Trans Geosci Remote Sens 50(4):1302–1317

    Article  Google Scholar 

  • Yu Z, Ni D, Chen S, Qin J, Li S, Wang T, Lei B (2017) Hybrid dermoscopy image classification framework based on deep convolutional neural network and Fisher vector. 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). IEEE, Melbourne, pp 301–304

    Chapter  Google Scholar 

  • Zahia S, Sierra-Sosa D, Garcia-Zapirain B, Elmaghraby A (2018) Tissue classification and segmentation of pressure injuries using convolutional neural networks. Comput Method Program Biomed 159:51–58

    Article  Google Scholar 

  • Zhang N, Cai YX, Wang YY, Tian YT, Wang XL, Badami B (2020) Skin cancer diagnosis based on optimized convolutional neural network. Artif Intell Med 102:101756

    Article  Google Scholar 

Download references

Funding

No funding was provided.

Author information

Authors and Affiliations

Authors

Contributions

ASA is assigned as Corresponding Author and acts on behalf of all co-authors and ensures that questions related to the accuracy or integrity of any part of the work are appropriately addressed.

Corresponding author

Correspondence to A. Sherly Alphonse.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest.

Consent to participate

The authors have consent to participate.

Consent for publication

The authors have consent to publish.

Informed consent

No Informed consent was obtained as humans were not involved as individual participants included in the study.

Research involving human and/or animal participants

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix 1: To calculate the CLDP feature vector using the proposed method, perform the following steps. Consider a 3 × 3 block in the given image as shown below.

Appendix 1: To calculate the CLDP feature vector using the proposed method, perform the following steps. Consider a 3 × 3 block in the given image as shown below.

Step 1: Obtain R, G, B color channel images from the preprocessed sample image in dataset. A sample 3 × 3 block from each channel is given below.

figure a

Step 2: Create combined channel images like RR, GG, BB, RG, RB and GB. Convolution of each 3 × 3 block is done with the 3 × 3 eight directional Kirsch masks.

figure b

CLDPR,R(u,v,θ) CLDPG,G(u,v,θ) CLDPB,B(u,v,θ) CLDPR,G(u,v,θ) CLDPR,B(u,v,θ) CLDPG,B(u,v,θ).

The CLDP images are created for different channel combinations as in Eq. (1). The \(i, j\) values used in Eq. (1) are determined according to the angular positions defined in Eq. (2). The Kirsch compass masks are used for convolution with the combined channel images. The Kirsch masks are given in Fig. 11

Step 3: Creation of feature vectors.

Consider the Kirsch mask responses obtained after convolution, form six CLDP code images using only the maximum responses to eliminate the random noise included in images during image acquisition. Then, the feature vectors are created from the histograms of the six CLDP code images. The \(\mathrm{code }\left(\mathrm{x},\mathrm{y}\right)\) is created as given in Eq. (3) by considering the maximum of responses obtained from the eight directional masks given in Fig. 9. From the code(x,y) obtained for each pixel as in Fig. 9 the CLDP code image is formed. The feature vector of each code image is calculated using its histograms obtained from the grids as in Eq. (4) and as in Fig. 10.

figure c
figure d
figure e
figure f
figure g
figure h

Step 4: Concatenate all the feature vectors.

As in Eq. (5) all the feature vectors are concatenated to obtain the final feature vector used for classification.

figure i

The feature vectors thus obtained helps in extracting the color, texture, edge and structural information from the images excluding noise which helps in obtaining good classification accuracy.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alphonse, A.S., Starvin, M.S. A novel and efficient approach for the classification of skin melanoma. J Ambient Intell Human Comput 12, 10435–10459 (2021). https://doi.org/10.1007/s12652-020-02648-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-02648-x

Keywords

Navigation