Abstract
According to diagnostic criteria, skin tumors can be divided into three categories: benign, low degree and high degree malignancy. For high degree malignant skin tumors, if not detected in time, they can do serious harm to patients’ health. However, in clinical practice, identifying malignant degree requires biopsy and pathological examination which is time costly. Furthermore, in many areas, due to the severe shortage of dermatologists, it’s inconvenient for patients to go to hospital for examination. Therefore, an easy to access screening method of malignant skin tumors is needed urgently. Firstly, we spend 5 years to build a dataset which includes 4,500 images of 10 kinds of skin tumors. All instances are verified pathologically thus trustworthy; Secondly, we label each instance to be either low-risk, high-risk or dangerous in which Junctional nevus, Intradermal nevus, Dermatofibroma, Lipoma and Seborrheic keratosis are low-risk, Basal cell carcinoma, Bowen’s disease and Actinic keratosis are high-risk, Squamous cell carcinoma and Malignant melanoma are dangerous; Thirdly, we apply the Xception architecture to build the risk degree classifier. The area under the curve (AUC) for three risk degrees reach 0.959, 0.919 and 0.947 respectively. To further evaluate the validity of the proposed risk degree classifier, we conduct a competition with 20 professional dermatologists. The results showed the proposed classifier outperforms dermatologists. Our system is helpful to patients in preliminary screening. It can identify the patients who are at risk and alert them to go to hospital for further examination.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Apalla, Z., Lallas, A., Sotiriou, E., Lazaridou, E., and Ioannides, D., Epidemiological trends in skin cancer. Dermatol Pract Concept. 7(2):1, 2017.
Wernli, K. J., Henrikson, N. B., Morrison, C. C., Nguyen, M., Pocobelli, G., and Blasi, P. R., Screening for skin cancer in adults: Updated evidence report and systematic review for the US preventive services task force. JAMA. 316(4):436–447, 2016.
Zhao, S., Wu, L., Kuang, Y., Su, J., Luo, Z., Wang, Y., Li, J., Zhang, J., Chen, W., Li, F., and He, Y., Downregulation of CD147 induces malignant melanoma cell apoptosis via the regulation of IGFBP2 expression. Int J Oncol. 53(6):2397–2408, 2018.
de Polo, A., Luo, Z., Gerarduzzi, C., Chen, X., Little, J. B., and Yuan, Z. M., AXL receptor signalling suppresses p53 in melanoma through stabilization of the MDMX–MDM2 complex. J Mol Cell Biol. 9(2):154–165, 2017.
Liu, X. S., Genet, M. D., Haines, J. E., Mehanna, E. K., Wu, S., Chen, H. I., Chen, Y., Qureshi, A. A., Han, J., Chen, X., and Fisher, D. E., ZBTB7A suppresses melanoma metastasis by transcriptionally repressing MCAM. Mol Cancer Res. 13(8):1206–1217, 2015.
Zeng, W., Su, J., Wu, L., Yang, D., Long, T., Li, D., Kuang, Y., Li, J., Qi, M., Zhang, J., and Chen, X., CD147 promotes melanoma progression through hypoxia-induced MMP2 activation. Curr Mol Med. 14(1):163–173, 2014.
Luo, Z., Zeng, W., Tang, W., Long, T., Zhang, J., Xie, X., Kuang, Y., Chen, M., Su, J., and Chen, X., CD147 interacts with NDUFS6 in regulating mitochondrial complex I activity and the mitochondrial apoptotic pathway in human malignant melanoma cells. Curr Mol Med. 14(10):1252–1264, 2014.
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., and Kim, R., Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA – J Am Med Assoc. 316(22):2402–2410, 2016.
Gurovich, Y., Hanani, Y., Bar, O., Nadav, G., Fleischer, N., Gelbman, D., Basel-Salmon, L., Krawitz, P. M., Kamphausen, S. B., Zenker, M., and Bird, L. M., Identifying facial phenotypes of genetic disorders using deep learning. Nature medicine. 25(1):60, 2019.
Kooi, T., Litjens, G., Van Ginneken, B., Gubern-Mérida, A., Sánchez, C. I., Mann, R., den Heeten, A., and Karssemeijer, N., Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal. 35:303–312, 2017.
Liao, H., A deep learning approach to universal skin disease classification. University of Rochester Department of Computer Science, CSC, 2016.
Liao, H., Li, Y., Luo, J., Skin disease classification versus skin lesion characterization: Achieving robust diagnosis using multi-label deep neural networks. In 2016 23rd International Conference on Pattern Recognition (ICPR) 2016 Dec 4 (pp. 355-360). IEEE.
Haofu, L, Luo, J., A deep multi-task learning approach to skin lesion classification. InWorkshops at the Thirty-First AAAI Conference on Artificial Intelligence 2017 Mar 21.
Sun, X., Yang, J., Sun, M., Wang, K., A benchmark for automatic visual classification of clinical skin disease images. InEuropean Conference on Computer Vision 2016 Oct 8 (pp. 206-222). Springer, Cham.
Codella, N. C., Nguyen, Q. B., Pankanti, S., Gutman, D. A., Helba, B., Halpern, A. C., and Smith, J. R., Deep learning ensembles for melanoma recognition in dermoscopy images. IBM Journal of Research and Development. 61(4/5):5–1, 2017.
Yu, L., Chen, H., Dou, Q., Qin, J., and Heng, P. A., Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Trans Med Imaging. 36(4):994–1004, 2017.
Zhang, J., Xie, Y., Wu, Q., Xia, Y., Skin lesion classification in dermoscopy images using synergic deep learning. In International Conference on Medical Image Computing and Computer-Assisted Intervention 2018 Sep 16 (pp. 12-20). Springer, Cham.
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., and Thrun, S., Dermatologist-level classification of skin cancer with deep neural networks. Nature. 542(7639):115, 2017.
Han, S. S., Kim, M. S., Lim, W., Park, G. H., Park, I., and Chang, S. E., Classification of the clinical images for benign and malignant cutaneous tumors using a deep learning algorithm. J Invest Dermatol. 138(7):1529–1538, 2018.
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B., Thomas, L., Enk, A., and Uhlmann, L., Man against machine: Diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann Oncol. 29(8):1836–1842, 2018.
Walker, B. N., Rehg, J. M., Kalra, A., Winters, R. M., Drews, P., Dascalu, J., David, E. O., Dascalu, A., Dermoscopy diagnosis of cancerous lesions utilizing dual deep learning algorithms via visual and audio (sonification) outputs: Laboratory and prospective observational studies. EBioMedicine, 2019.
Acknowledgements
First, second and third authors contributed equally to this paper. Authors are grateful to all the doctors and nurses in Department of Dermatology, Xiangya Hospital Central South University.
Funding
This research was funded by National Key R&D Program of China (2018YFC0117000), Specialized Basic Work of Science and Technology (2015FY111100) and Hunan Provincial Science and Technology Department (2018SK2092).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
All the authors of this article are aware of the content.
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Patient Facing Systems
Rights and permissions
About this article
Cite this article
Zhao, Xy., Wu, X., Li, Ff. et al. The Application of Deep Learning in the Risk Grading of Skin Tumors for Patients Using Clinical Images. J Med Syst 43, 283 (2019). https://doi.org/10.1007/s10916-019-1414-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-019-1414-2