July 2018
Volume 59, Issue 9
Open Access
ARVO Annual Meeting Abstract  |   July 2018
Deep Learning for Image Quality Assessment of Fundus Images in Retinopathy of Prematurity
Author Affiliations & Notes
  • Aaron S Coyner
    Oregon Health & Science University, Portland, Oregon, United States
  • Ryan Swan
    Oregon Health & Science University, Portland, Oregon, United States
  • James M Brown
    MGH/Harvard Medical School, Boston, Massachusetts, United States
  • Jayashree Kalpathy-Cramer
    MGH/Harvard Medical School, Boston, Massachusetts, United States
  • Sang Jin Kim
    Oregon Health & Science University, Portland, Oregon, United States
  • J. Peter Campbell
    Oregon Health & Science University, Portland, Oregon, United States
  • Karyn Jonas
    University of Illinois College of Medicine, Chicago, Illinois, United States
  • R.V. Paul Chan
    University of Illinois College of Medicine, Chicago, Illinois, United States
  • Susan Ostmo
    Oregon Health & Science University, Portland, Oregon, United States
  • Michael F Chiang
    Oregon Health & Science University, Portland, Oregon, United States
  • Footnotes
    Commercial Relationships   Aaron Coyner, None; Ryan Swan, None; James Brown, None; Jayashree Kalpathy-Cramer, None; Sang Kim, None; J. Peter Campbell, None; Karyn Jonas, None; R.V. Chan, None; Susan Ostmo, None; Michael Chiang, Clarity Medical Systems (S), NIH P30EY010572 (F), NIH R01 EY019474 (F), Novartis (C), NSF SCH-1622679 (F)
  • Footnotes
    Support  NLM Training Grant 4T15LM007088-25, NIH Grant R01 EY019474, NIH Grant P30EY010572, NSF Grant SCH-1622679
Investigative Ophthalmology & Visual Science July 2018, Vol.59, 2762. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Aaron S Coyner, Ryan Swan, James M Brown, Jayashree Kalpathy-Cramer, Sang Jin Kim, J. Peter Campbell, Karyn Jonas, R.V. Paul Chan, Susan Ostmo, Michael F Chiang; Deep Learning for Image Quality Assessment of Fundus Images in Retinopathy of Prematurity. Invest. Ophthalmol. Vis. Sci. 2018;59(9):2762.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Accurate image-based ophthalmic diagnosis relies on clarity of fundus images. This has important implications for ophthalmic diagnosis, and for emerging methods such as telemedicine and computer-based image analysis. The purpose of this study was to implement a convolutional neural network (CNN) for automatically assessing the quality of fundus images in retinopathy of prematurity (ROP).

Methods : 5,204 wide-angle fundus images were collected from preterm infants during routine ROP screening examinations. Images were assessed for quality via ability to diagnose ROP accurately, and labeled “acceptable” or “not acceptable.” Acceptable images included only those that were deemed acceptable for ROP diagnosis by the majority of image graders.

2,550 images were used for training, 1,000 for validation, and 1,624 for testing. Additionally, 30 images of varying quality were selected for review by six individual expert graders who performed pairwise comparisons between images to rank them from worst to best quality. An overall expert consensus rank was developed from individual rankings.

A CNN was trained using dropout and early stopping to avoid overfitting. For the set of 30 images, rank was established using the predicted probabilities of each image belonging to the acceptable image class.

Results : CNN training was halted when validation accuracy for identifying acceptable vs. not acceptable images reached 95%. Test set accuracy was 94.5%, with area under the receiver operating curve (AUROC) equal to 0.972, and area under the precision-recall curve (AUPR) equal to 0.975.

Individual expert ranks were highly correlated with one another (correlation coefficient [CC] 0.89-0.94) and with the consensus rank (CC 0.94-0.98). The CNN image rank correlated with individual expert ranks (CC 0.75- 0.82) and the consensus rank (CC 0.77).

Conclusions : A CNN can accurately distinguish acceptable vs. not acceptable quality retinal fundus photos acquired from preterm infants during routine ROP examinations. The CNN ranks images similarly to expert graders, which suggests that similar image features may be used for quality assessment. Future directions will explore the features used for quality assessment by the CNN.

This is an abstract that was submitted for the 2018 ARVO Annual Meeting, held in Honolulu, Hawaii, April 29 - May 3, 2018.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×