Skip to main content
SpringerLink
Log in

An Image Diagnosis Algorithm for Keratitis Based on Deep Learning

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Clinical diagnosis of keratitis highly depends on the observation of medical images. Since there are many classifications of keratitis, and the pathogenic factors are different, ophthalmologists will be more demanding. In this paper, a multi-task recognition method is proposed for the automatic diagnosis of keratitis. The diagnosis basis of keratitis is obtained, and the image of the anterior segment is interpreted. Under the guidance of ophthalmologists, all anterior segment images are labeled from five signs, consisting of opacity area in the cornea (turbid and clear), boundary of the focus (distinct and vague), epithelium of the focus area (intact and incomplete), hyperemia (congestive and healthy), and neovascularization (yes and no), which are important in the diagnosis of keratitis. A multi-label image dataset is constructed, and the images are enhanced by horizontal flipping according to the image characteristics. In this paper, an improved multi-attribute network based on ResNet50 is proposed, including a feature extraction module and a classification module. The feature extraction module is to extract image features, and the classification module is a multi-output network in which each channel corresponds to each attribute. In order to improve the overall recognition accuracy of multi-task, the loss function is optimized. In the loss function, the loss weights of different tasks are determined based on the classification difficulty. A joint training approach is used to train the multi-attribute network which can simultaneously recognize the five attributes and obtain the specific symptoms of keratitis. The experimental results show that the average accuracy of these five attributes can be achieved 84.89% in the multi-attribute network, among which the highest accuracy can be achieved 89.51%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Painter R (2015) Slit lamp photography: the basics. J Audiov Media Med 38(1–2):119–123

    Google Scholar 

  2. Armstrong SM, Cohen KL (2017) Anterior segment OCT: posterior segment imaging, anterior eye photography, and slit lamp biomicrography. Ophthalmic Imaging

  3. Meng K, Zhou CC (2012) Multi-disciplinary intersection and integration: the development tendency and the change in meteorology in colleges. Value Eng 36:219–220

    Google Scholar 

  4. Patel VL et al (2009) The coming of age of artificial intelligence in medicine. Artif Intel Med 46:5–17

    Article  Google Scholar 

  5. Plis SM et al (2014) Deep learning for neuroimaging: a validation study. Front Neurosci 8:229

    Article  Google Scholar 

  6. Shen D, Wu G, Suk HI (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19:221–248

    Article  Google Scholar 

  7. Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436

    Article  Google Scholar 

  8. Schmidhuber J (2015) rgen. Deep learning in neural networks. Elsevier Science Ltd., Amsterdam

  9. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22):2402–2410

    Article  Google Scholar 

  10. Johnson J, Karpathy A, Fei-Fei L (2016) DenseCap: fully convolutional localization networks for dense captioning. In: IEEE Conference on Computer Vision and Pattern Recognition. Seattle, WA. IEEE. p 4565–74

  11. Liu Z, Gao J, Yang G, Zhang H, He Y (2016) Localization and classifcation of paddy feld pests using a saliency map and deep convolutional neural network. Sci Rep 6:20410

    Article  Google Scholar 

  12. Perednia DA, Allen A. Telemedicine technology and clinical applications. JAMA 1995 Feb 08,273(6):483–488. [Medline: 7837367]

  13. Hao X, Zhang G, Ma S (2016) Deep learning. Int J Semantic Comput 10(03):417–439

    Article  Google Scholar 

  14. Goodfellow I, Bengio Y, Courville A (2016) Deep learning. The MIT Press, Cambridge

    MATH  Google Scholar 

  15. Alpaydin E (2016) Neural networks and deep learning. Machine learning: the new AI. MIT Press, Cambridge

  16. Theodoridis S (2016) Neural networks and deep learning. Machine Learning

  17. Lecun Y, Bottou L (1998) Gradient-based learning applied to document recognition[J]. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  18. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, pp 1097–1105

  19. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  20. Szegedy C, Liu W, Jia YQ et al. (2015) Going deeper with convolutions. IEEE Conference on Computer Vision and Pattern Recognition. pp 1–9

  21. Szegedy C, Vanhoucke V, Ioffe S et al. (2016) Rethinking the Inception Architecture for Computer Vision. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2818–2826

  22. Szegedy C, Ioffe S, Vanhoucke V et al. (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. Thirty-First AAAI Conference on Artificial Intelligence

  23. He KM, Zhang XY, Ren SQ et al. (2016) Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. pp 770–778

  24. Litjens G, Kooi T, Bejnordi BE et al (2017) A survey on deep learning in medical image analysis. Med Image Anal 42(9):60–88

    Article  Google Scholar 

  25. Wang L, Zhang K, Liu X et al (2017) Comparative analysis of image classification methods for automatic diagnosis of ophthalmic images. Sci Rep 7(1):41545–41545

    Article  Google Scholar 

  26. Liu X, Jiang J, Zhang K et al. (2017) Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. PLOS ONE, 12(3)

  27. Saini JS, Jain AK, Kumar S et al (2003) Neural network approach to classify infective keratitis. Curr Eye Res 27(2):111–116

    Article  Google Scholar 

  28. Zhang K, Liu X, Liu F, et al. (2018) an interpretable and expandable deep learning diagnostic system for multiple ocular diseases: qualitative study. Journal of Medical Internet Research, 20(11)

  29. Kim JY, Lee HE, Choi YH et al. (2019) CNN-based diagnosis models for canine ulcerative keratitis. Scientific Reports, 9(1)

  30. Deng L, Lyu J, Huang H et al (2020) The SUSTech-SYSU dataset for automatically segmenting and classifying corneal ulcers. Scientific Data 7(1):1–7

    Article  Google Scholar 

  31. Qiu Q, Liu Z, Zhao Y, et al. (2016) Automatic detecting cornea fungi based on texture analysis. IEEE International Conference on Smart Cloud. IEEE

  32. Liu Z, Cao Y, Li Y, Xiao X, Qiu Q, Yang M, Zhao Y, Cui L (2020) Automatic diagnosis of fungal keratitis using data augmentation and image fusion with deep convolutional neural network. Computer Methods and Programs in Biomedicine, 187

  33. Caruana R (1997) Multitask learning. Mach Learn 28(1):41–75

    Article  MathSciNet  Google Scholar 

  34. Gong T, Lee T, Stephenson C et al. (2019) A comparison of loss weighting strategies for multi task learning in deep neural networks. IEEE Access, PP(99):1–1

Download references

Author information

Authors and Affiliations

  1. College of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, Heilongjiang Province, China

    Qingbo Ji & Han Zhang

  2. Key Laboratory of Advanced Marine Communication and Information Technology, Ministry of Industry and Information Technology, Harbin Engineering University, Harbin, 150001, Heilongjiang Province, China

    Yue Jiang

  3. Department of Ophthalmology, Second Affiliated Hospital of Harbin Medical University, Harbin, 150086, Heilongjiang Province, China

    Lijun Qu & Qian Yang

Authors
  1. Qingbo Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yue Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lijun Qu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qian Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Han Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yue Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, Q., Jiang, Y., Qu, L. et al. An Image Diagnosis Algorithm for Keratitis Based on Deep Learning. Neural Process Lett 54, 2007–2024 (2022). https://doi.org/10.1007/s11063-021-10716-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-021-10716-2

Keywords

Search

Navigation