May 2008
Volume 49, Issue 13
Free
ARVO Annual Meeting Abstract  |   May 2008
Improved Computer Aided Detection of Diabetic Retinopathy Evaluated on 10,000 Screening Exams
Author Affiliations & Notes
  • M. D. Abramoff
    Ophthal & Visual Sciences, Univ of Iowa Hosp & Clinics, Iowa City, Iowa
    Eye, VAMC Iowa City, Iowa City, Iowa
  • B. Van Ginneken
    Ophthal & Visual Sciences, Univ of Iowa Hosp & Clinics, Iowa City, Iowa
    Image Sciences Institute, University of Utrecht, The Netherlands
  • M. S. A. Suttorp
    Oogheelkunde, OLVG, Amsterdam, The Netherlands
  • S. R. Russell
    Ophthal & Visual Sciences, Univ of Iowa Hosp & Clinics, Iowa City, Iowa
  • M. Niemeijer
    Ophthal & Visual Sciences, Univ of Iowa Hosp & Clinics, Iowa City, Iowa
  • Footnotes
    Commercial Relationships  M.D. Abramoff, Patent application, P; B. Van Ginneken, Patent application, P; M.S.A. Suttorp, None; S.R. Russell, None; M. Niemeijer, Patent application, P.
  • Footnotes
    Support  NEI R01-EY017066; DoD A064-032-0056; Research to Prevent Blindness, IOP IBVA02016
Investigative Ophthalmology & Visual Science May 2008, Vol.49, 2735. doi:https://doi.org/
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      M. D. Abramoff, B. Van Ginneken, M. S. A. Suttorp, S. R. Russell, M. Niemeijer; Improved Computer Aided Detection of Diabetic Retinopathy Evaluated on 10,000 Screening Exams. Invest. Ophthalmol. Vis. Sci. 2008;49(13):2735. doi: https://doi.org/.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose: : to study the performance effect of retraining a system for automated detection of diabetic retinopathy in digital retinal photographs. We have previously shown that the performance of such a system on 10,000 exams (40,000 photographs) from a true screening population approaches that of retinal specialists (area under the ROC curve(AUC) =0.84)[in press, Diabetes Care].

Methods: : A new, more recent, previously unseen set of 10,000 consecutive exams (4 retinal photographs, two left and two right) from 6100 unique patients was selected from a diabetic retinopathy screening project in the Netherlands imaged with three types of cameras at ten centers. Inclusion criteria: no previous diagnosis of diabetic retinopathy, no previous visit to ophthalmologist for dilated eye exam, both eyes photographed. One of three retinal specialists evaluated each exam as unacceptable quality, no referable retinopathy, or referable retinopathy. The system selected exams with sufficient image quality, on those, determined presence or absence of referable retinopathy. The algorithm was retrained with the current dataset, and detection performance (AUC) compared to the expert evaluation was evaluated in leave-one-out fashion.

Results: : human expert classified 253/10,000 exams as referable retinopathy. Total AUC of the system was 0.88. At the optimal threshold for screening, the sensitivity was 94% and the specificity was 59%, the number needing to be screened to miss one case (NSM) was 667. At this point, 7308/10,000 exams had sufficient image quality, 4176/7308 (57%) were true negatives, 11/7308 (0.15%) false negatives, 167/7308 (2.3%) true positives, and 2953/7308 (40%) false positives, and 74/2692 of insufficient quality were positive. Analysis of cases in terms of lesion type is ongoing and will be presented.

Conclusions: : retraining a supervised system for automated detection of diabetic retinopathy can have a considerable impact on performance. Performance is now close to that of retinal specialists, in this low prevalence dataset, and evaluation on large, validated, available datasets should be vigorously pursued. If systems can be improved even further, they may lead to improved prevention of blindness and visual loss in patients with diabetes, through greater accesibility and cost-effectiveness of screening.

Keywords: diabetic retinopathy • imaging/image analysis: clinical • detection 
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×