Automated prescreening of pigmented skin lesions using standard cameras

https://doi.org/10.1016/j.compmedimag.2011.02.007Get rights and content

Abstract

This paper describes a new method for classifying pigmented skin lesions as benign or malignant. The skin lesion images are acquired with standard cameras, and our method can be used in telemedicine by non-specialists. Each acquired image undergoes a sequence of processing steps, namely: (1) preprocessing, where shading effects are attenuated; (2) segmentation, where a 3-channel image representation is generated and later used to distinguish between lesion and healthy skin areas; (3) feature extraction, where a quantitative representation for the lesion area is generated; and (4) lesion classification, producing an estimate if the lesion is benign or malignant (melanoma). Our method was tested on two publicly available datasets of pigmented skin lesion images. The preliminary experimental results are promising, and suggest that our method can achieve a classification accuracy of 96.71%, which is significantly better than the accuracy of comparable methods available in the literature.

Introduction

Pigmented skin lesions include both, benign and malignant forms. Melanoma is a kind of malignant pigmented skin lesion, and currently is among the most dangerous existing cancers, resulting in about 10,000 deaths from the 40,000 to 50,000 diagnosed cases per year, just in United States of America [1]. According to World Health Organization [2], about 132,000 melanoma cases occur globally each year. Benign pigmented skin lesions are called moles, or nevi. However, differentiating benign and malignant lesions can be challenging. For example, there are nevi known as Clark Nevi (also referred as Dysplastic or Atypical Nevi) that present similar characteristics to melanomas [3]. It is consensual that the early diagnosis of malignant skin lesions (melanomas) is essential for the patient prognosis.

Recently, telemedicine techniques have been studied as a resource to obtain an early diagnosis of skin lesions. Besides the fact that dermatology probably is the most visual specialty in medicine, the teledermatology consultation brings some benefits, like easier access to health care and faster clinical results [4]. Comparing the physical examination (face-to-face diagnosis) with the remote diagnosis, experiments indicate that teledermatology is effective and reliable [5]. Teledermatology can benefit from image prescreening to help identify potentially malignant cases in their early stages.

To help distinguishing between benign and malignant cases, dermatologists often analyze each lesion with a dermoscope, which is a noninvasive tool that facilitates the evaluation of submacroscopic morphologic and vascular structures. As can be seen in Fig. 1, dermoscopy enables the generation of images with constant illumination, different texture patterns, and characteristics that are not measurable in standard camera images, such as lesion area and perimeter. In this way, many research groups developed digital dermoscopy image analysis schemes to help in skin lesion diagnosis [6].

In an attempt to prescreen/classify dermoscopy images, Celebi et al. [8] achieved 92.34% and 93.33% of specificity and sensitivity, respectively, using a JSEG-based segmentation algorithm and Support Vector Machines in the classification. More recently, Iyatomi et al. [9] proposed, to the best of our knowledge, the first publicly accessible system (“Dermatologist-like”), based on a region growing segmentation method and an Artificial Neural Network classifier. The user can upload an image at their website ‘http://dermoscopy.k.hosei.ac.jp’ and obtain a prescreening result. This system achieved a sensitivity of 85.9% and a specificity of 86.0% for a set of 1258 dermoscopy images [9].

Despite the importance of these efforts, a disadvantage of these methods is that they require dermoscopy images, and dermoscopes are not common among non-specialists. Moreover, studies indicate that dermoscopy images do not increase diagnosis accuracy in early stages [10]. So, with the proposal to facilitate the access to health care, also have been developed teledermatology systems making use of images acquired with standard cameras. In this way, patients do not need to go physically to a hospital or a clinic for a preliminary evaluation (even in benign cases), specially in remote areas. However, due to the already mentioned different visible characteristics in standard camera images and in dermoscopy images (see Fig. 1), these systems require different segmentation methods and feature extraction techniques.

A recent approach proposed by Alcon et al. [11] is an easy-to-use melanoma prescreening system based on standard camera images. A skin lesion photograph is provided as an input, and its prescreening is automatically produced, using segmentation and classification algorithms. However, often the acquired images contain artifacts, such as uneven illumination, which causes difficulties in the lesion segmentation stage, therefore their system initially corrects the image background. Afterwards, 55 features are extracted and the ABCD rule (Asymmetry, Border irregularity, Color variation and Differential structures) is employed to classify the lesion image as benign or malignant. Their system reaches an accuracy of 86.64% in its best performance [11].

This paper describes a new melanoma prescreening method using standard camera images and new techniques to improve the processing and analysis of such images, which was designed to be used remotely by non-specialists. In our experiments (see Section 6), we used 220 images obtained from two websites, with no special care in image acquisition or postprocessing. Each one of these images was submitted to a sequence of processing steps, namely: (1) preprocessing, where shading effects are attenuated by a new preprocessing stage proposed in this paper, as described in Section 2; (2) segmentation, where a new 3-channel image representation is proposed and used to discriminate between lesion and healthy skin areas, as described in Section 3; (3) feature extraction, where a quantitative lesion description containing new features extracted from our 3-channel representation is generated, as described in Section 4; and finally (4) lesion classification provides a lesion pre-diagnosis (using a hybrid classifier proposed in this paper); this processing step was designed to reduce the number of false negatives in the classification of skin lesion images as malignant or non-malignant, as described in Section 5. In Section 6, experimental results are presented, and Section 7 we present our conclusions.

Section snippets

Preprocessing

As mentioned before, the input image may be affected by illumination artifacts, and if used directly in the segmentation process, shading and lesion regions could be confused. Therefore, shading is attenuated in the input image before the image segmentation.

We start by converting the input image Īic (Īic(x,y)[0,1],i=1,2,3) from the original RGB color space to the HSV color space ĪiHSV [12]. This is justified by the better shading visibility in the Value channel, and also by the simplicity of

Skin lesion segmentation

The skin lesion segmentation helps identify the skin lesion area and its rim in monochromatic [11], [18], or in color [8], [9] images. However, skin artifacts such as hair and freckles can be confused with lesions, and affect negatively the prescreening process (e.g., feature extraction and classification). Moreover, segmentation techniques developed for dermoscopy images consider texture and color patterns that are usually not visible in standard camera images. Thus, we propose a new method to

Feature extraction

We extract a set of image features to distinguish between benign and malignant skin lesions. Given the segmentation results, we compute the local characteristics from the lesion areas according to the ABCD rule [22]. The ABCD acronym refers to the four criteria used in this rule, namely: Asymmetry, Border irregularity, Color variation and Differential structures.

The ABCD rule in important dermatology, and most dermatological prescreening systems rely on some scheme for quantifying the four

Lesion classification

After segmenting a lesion segment, and extracting 52 features f1f52 (see Section 4), we can discriminate a benign from a malignant pigmented skin lesion by classification. We present in the following subsections our classification scheme.

Experimental results and discussion

We used in our experiments two datasets of images: (a) the dataset used by Alcon et al. [11], with 152 images from the Dermnet dataset [31] (i.e., 45 benign Clark Nevi and 107 Melanomas); and (b) an extended dataset, which was built by adding 68 extra images from the DermQuest dataset [32] (37 Clark Nevi and 31 Melanomas), constituting a total of 82 Clark Nevi and 138 Melanomas in this extended dataset. The idea is to test our method in a dataset used in the literature (i.e. the Alcon et al.

Conclusion

This paper presented a method for classifying pigmented skin lesions as benign or malignant. It is assumed that the lesion is located in the central part of the image, which contains the lesion entirely, and healthy skin areas are expected in the four image corners [16], [17]. Besides the lesion position in the image, no special care is required in the skin lesion image acquisition (e.g. dermoscopy is not used), and the images are acquired with standard cameras and standard illumination, making

References (32)

  • A. Blum et al.

    Digital image analysis for diagnosis of skin tumors

    Semin Cutan Med Surg

    (2008)
  • E. Ehrsam, Dermoscopy; 2010....
  • H. Skvara et al.

    Limitations of dermoscopy in the recognition of melanoma

    Arch Dermatol

    (2005)
  • J.F. Alcon et al.

    Automatic imaging system with decision support for inspection of pigmented skin lesions and melanoma diagnosis

    IEEE J Select Top Signal Process

    (2009)
  • A.R. Smith

    Color gamut transform pairs

    SIGGRAPH Comput Graph

    (1978)
  • P. Soille

    Morphological operators

  • Cited by (120)

    • Segmentation of skin lesion images using discrete wavelet transform

      2021, Biomedical Signal Processing and Control
    View all citing articles on Scopus
    View full text