Current Application of Digital Diagnosing Systems for Retinopathy of Prematurity

https://doi.org/10.1016/j.cmpb.2020.105871Get rights and content

Highlights

  • Retinopathy of prematurity is a blind-causing disease affecting children.

  • Computer-based image analysis has been applied in the diagnosis of ROP.

  • Automated diagnostic systems are advantageous and promising for ROP diagnosis.

Abstract

Background and Objective

Retinopathy of prematurity (ROP), a proliferative vascular eye disease, is one of the leading causes of blindness in childhood and prevails in premature infants with low-birth-weight. The recent progress in digital image analysis offers novel strategies for ROP diagnosis. This paper provides a comprehensive review on the development of digital diagnosing systems for ROP to software researchers. It may also be adopted as a guide to ophthalmologists for selecting the most suitable diagnostic software in the clinical setting, particularly for the remote ophthalmic support.

Methods

We review the latest literatures concerning the application of digital diagnosing systems for ROP. The diagnosing systems are analyzed and categorized. Articles published between 1998 and 2020 were screened with the two searching engines Pubmed and Google Scholar.

Results

Telemedicine is a method of remote image interpretation that can provide medical service to remote regions, and yet requires training to local operators. On the basis of image collection in telemedicine, computer-based image analytical systems for ROP were later developed. So far, the aforementioned systems have been mainly developed by virtue of classic machine learning, deep learning (DL) and multiple machine learning. During the past two decades, various computer-aided systems for ROP based on classic machine learning (e.g. RISA, ROPtool, CAIER) became available and have achieved satisfactory performance. Further, automated systems for ROP diagnosis based on DL are developed for clinical applications and exhibit high accuracy. Moreover, multiple instance learning is another method to establish an automated system for ROP detection besides DL, which, however, warrants further investigation in future.

Conclusion

At present, the incorporation of computer-based image analysis with telemedicine potentially enables the detection, supervision and in-time treatment of ROP for the preterm babies.

Introduction

Retinopathy of prematurity (ROP) is a vascular disease prevalent in premature infants, especially those with a birth weight lower than 1250 g. As a major cause of blindness in infants and young children [1], the incidence of ROP is rising due to the rapid improvement of rescue technology in neonatology worldwide. Nonetheless, the course of ROP is short, thereby making the effective therapeutic window relatively narrow. Once the disease progresses to the late stage or the tractional retinal detachment occurs, the prognosis of visual functions will be poor. Hence, diagnosing and treating ROP timely and accurately can effectively prevent blindness. According to the Early Treatment for Retinopathy of Prematurity (ETROP) trial [2], a timely clinical intervention is conducive to enhance the vision of high-risk patients with ROP, even though 9% became blind ultimately. Thus, the early screening and regular monitoring are particularly crucial. Plus disease in ROP is a key feature that requires treatment and can be identified by comparison with the published photographs regarding the arterial tortuosity and venous dilation of posterior retinal vessels. Therefore, conducting research on time- and labor-saving screening for ROP plus disease is necessary. Current therapies for ROP mainly include laser photocoagulation, intraocular injection, cryotherapy, scleral buckling and vitrectomy, based on the stages of the disease. Still, timely treatments are the key point for a good prognosis, given the fact that in the late stage of ROP, maneuvers like vitrectomy can manage to reduce a partial or complete anatomical impairment and yet fail to retain the normal visual function. Accordingly, it is critical to identify the treatment-warranted ROP (TW-ROP) in the high-risk infants.

In recent years, numerous morphological datasets have become accessible by digital images. By use of these large databases, retinal images can be analyzed efficiently with artificial intelligence (AI). Methods involving machine learning (ML) especially deep learning (DL) are capable of recognizing pathological characteristics in retinal diseases. Automated AI programs have been well developed and widely applied to screen diabetes in many countries. A breakthrough is that the world's first market-oriented AI medical device developed by Abramoff et al. was approved by the United States Food and Drug Administration (US FDA) in the April, 2018, which allowed automatic screening and diagnosis of diabetic retinopathy (DR) in diabetic adults using the autonomous DR and DME detection software (IDx-DR) [3]. The progresses in computer-aided technology are also gradually changing the diagnostic method for ROP. Although the traditional binocular indirect ophthalmoscopy (BIO) remains the golden standard for ROP screening, it requests the direct practice by experienced clinicians. The wide-angle digital retinal imaging system (Retcam) is increasingly utilized for fundus examination of ROP nowadays. Compared with BIO, Retcam is easier to operate with a shorter learning cycle, and in the meantime can be used for photographing, storage, output and transmission of multi-directional fundus images. Further, Retcam system is more conducive for follow-up, consultation, scientific research and education. These advantages of Retcam guarantee satisfactory results when applying it to diagnostic digital image analysis on ROP.

Telemedicine is a method of long-distance image interpretation, which provides medical service to remote regions but requires training to the local operators. Developed from the concept of image collection and analysis in telemedicine, various systems of computer-based image analysis using classic ML have been invented with promising outcomes. These systems were developed based on a small number of images and have relatively low demand for web server. However, they require manual delineation of selected features, and thus systemic bias may result from handcrafted extraction. Automated systems for ROP diagnosis based on DL have been developed for clinical applications. These systems are more time- and labor-saving compared with those based on classic ML. Unfortunately, they still call for large datasets covering various ROP features and different severities, together with high demand for web server. Notably, for convolutional neural networks, innovative programs are expected to be designed based on different datasets with the population from distinct countries, so that the networks can be modified properly in various situations. Moreover, it is difficult to compare the existing systems in a uniform way owing to the lack of a standard strategy. Consequently, it is called upon to establish a program able to compare the existing ROP programs. Also, multiple instance learning (MIL) is anticipated to be applicable for automated diagnosis in future.

In this work, we have reviewed the current application of digital diagnosing systems for ROP by use of classic ML methods, MIL and DL. We compared these systems with analysis parameters, outcomes, performances, etc (Table 1). We found that to date, each currently-used system has its own merits and disadvantages. An incorporation of telemedicine and computer-based image analysis potentially enhances detection, supervision and in-time treatment of ROP for the preterm babies.

Section snippets

Methodology

We conducted a comprehensive review of published literatures on the application of diagnosing systems for ROP. We developed a search strategy in consultation with a senior reviewer, and searched through the online engines PubMed and Google Scholar for articles containing the following terms: retinopathy of prematurity, artificial intelligence, digital diagnosing systems, deep learning, computer-based image analysis, machine learning, and telemedicine. We performed the searching with MeSH terms

Telemedicine

As a method for long-range image interpretation, telemedicine offers patients in remote regions a chance of better medical service, despite that the final quality depends highly on local operators. In 2013, the application of digital retinal image photographed for remote interpretation of ROP screening was acknowledged by the American Academy Of Pediatrics (AAP), American Academy of Ophthalmology (AAO), and American Association for Pediatric Ophthalmology and Strabismus (AAPOS) for the first

Current development of computer-based image analysis (CBIA)

As mentioned above, CBIA systems for diagnosing ROP were developed from the concept of image collection in telemedicine, and the current platforms have mostly relied on the methods of classic ML, DL and multiple machine learning, as elaborated below. Parameter values of different methods are concluded in Supplementary Table 1.

Future perspectives

Due to the growing shortage of pediatric ophthalmologists, incorporating telemedicine and CBIA systems for screening and examination of ROP is urgently required all over the world. This can improve the efficiency and effectiveness of detection, supervision and in-time treatment of ROP for the preterm babies. Even though the current automated systems perform well in the research, there have been few reports about the accuracy of ROP on large-scale clinical applications. Moreover, it is difficult

Declaration of Competing Interest

The authors declare no competing financial interests.

Acknowledgements

The study is supported by the National NSFC (82074169, 82071372), Hygiene & Health Appropriated Technology and Promoting Project of Guangdong Province (202006130025341204, 201905270933056876), the Outstanding Scholar Program of Bioland Laboratory (Guangzhou Regenerative Medicine and Health Guangdong Laboratory) (2018GZR110102002) and Science and Technology Program of Guangzhou (202007030012).

References (54)

  • F. Oloumi et al.

    Computer-aided diagnosis of plus disease via measurement of vessel thickness in retinal fundus images of preterm infants

    Comput Biol Med

    (2015)
  • L. Ghergherehchi et al.

    Plus Disease in Retinopathy of Prematurity: More Than Meets the ICROP?

    Asia Pac J Ophthalmol (Phila)

    (2018)
  • J. Kalpathy-Cramer et al.

    Informatics in Retinopathy of Prematurity Research, Plus Disease in Retinopathy of Prematurity: Improving Diagnosis by Ranking Disease Severity and Using Quantitative Image Analysis

    Ophthalmology

    (2016)
  • J.P. Campbell et al.

    Plus Disease in Retinopathy of Prematurity A Continuous Spectrum of Vascular Abnormality as a Basis of Diagnostic Variability

    Ophthalmology

    (2016)
  • M.F. Chiang et al.

    Detection of Clinically Significant Retinopathy of Prematurity Using Wide-angle Digital Retinal Photography A Report by the American Academy of Ophthalmology

    Ophthalmology

    (2012)
  • J. Wang et al.

    Automated retinopathy of prematurity screening using deep neural networks

    EBioMedicine

    (2018)
  • M.F. Chiang et al.

    Image analysis for retinopathy of prematurity diagnosis

    J AAPOS

    (2009)
  • T. Lundberg et al.

    Digital imaging and telemedicine as a tool for studying inflammatory conditions in the middle ear–evaluation of image quality and agreement between examiners

    Int J Pediatr Otorhinolaryngol

    (2008)
  • J.I. Orlando et al.

    A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs

    Med Image Anal

    (2020)
  • W.V. Good et al.

    Final visual acuity results in the early treatment for retinopathy of prematurity study

    Archives of ophthalmology (Chicago, Ill.: 1960

    (2010)
  • M.D. Abramoff et al.

    Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices

    NPJ Digit Med

    (2018)
  • W.M. Fierson

    O. American Academy of Pediatrics Section on, O. American Academy of, O. American Association for Pediatric, Strabismus, O. American Association of Certified, Screening examination of premature infants for retinopathy of prematurity

    Pediatrics

    (2013)
  • M.F. Chiang et al.

    Accuracy and reliability of remote retinopathy of prematurity diagnosis

    Arch Ophthalmol

    (2006)
  • M.F. Chiang et al.

    Telemedical retinopathy of prematurity diagnosis: accuracy, reliability, and image quality

    Arch Ophthalmol

    (2007)
  • C. Dhaliwal et al.

    Wide-field digital retinal imaging versus binocular indirect ophthalmoscopy for retinopathy of prematurity screening: a two-observer prospective, randomised comparison

    Br J Ophthalmol

    (2009)
  • W.M. Fierson et al.

    O. American Academy of Pediatrics Section on, A.A.o.C.O. American Academy of Ophthalmology, Telemedicine for evaluation of retinopathy of prematurity

    Pediatrics

    (2015)
  • D. Rajashekar et al.

    Comprehensive Retinal Image Analysis for Aggressive Posterior Retinopathy of Prematurity

    PLoS One

    (2016)
  • Cited by (10)

    • A review on utilizing machine learning technology in the fields of electronic emergency triage and patient priority systems in telemedicine: Coherent taxonomy, motivations, open research challenges and recommendations for intelligent future work

      2021, Computer Methods and Programs in Biomedicine
      Citation Excerpt :

      Therefore, advanced systems need to be considered to address the challenges of patients with chronic diseases. To this end, telemedicine systems [1,6] have been proposed to overcome such challenges. The telemedicine system consists of three tiers.

    • Prediction of ROP Zones Using Deep Learning Algorithms and Voting Classifier Technique

      2023, International Journal of Computational Intelligence Systems
    View all citing articles on Scopus
    View full text