June 2021
Volume 62, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2021
Intergrader Agreement for Diabetic Retinopathy (DR) using Hand-Held Retinal Imaging
Author Affiliations & Notes
  • Paolo S Silva
    Beetham Eye Institute, Joslin Diabetes Center, Boston, Massachusetts, United States
    Ophthalmology, Harvard Medical School, Boston, Massachusetts, United States
  • Recivall Pascual Salongcay
    Philippine Eye Research Institute, University of the Philippines Manila, Manila, Metro Manila, Philippines
    Centre for Public Health, Queen's University Belfast, Belfast, United Kingdom
  • Lizzie Anne Aquino
    Philippine Eye Research Institute, University of the Philippines Manila, Manila, Metro Manila, Philippines
  • Claude Salva
    Philippine Eye Research Institute, University of the Philippines Manila, Manila, Metro Manila, Philippines
  • Jennifer K Sun
    Beetham Eye Institute, Joslin Diabetes Center, Boston, Massachusetts, United States
    Ophthalmology, Harvard Medical School, Boston, Massachusetts, United States
  • Tunde Peto
    Centre for Public Health, Queen's University Belfast, Belfast, United Kingdom
  • Lloyd Paul Aiello
    Beetham Eye Institute, Joslin Diabetes Center, Boston, Massachusetts, United States
    Ophthalmology, Harvard Medical School, Boston, Massachusetts, United States
  • Footnotes
    Commercial Relationships   Paolo Silva, Hill-rom (F), Optomed (F), Optos plc (F); Recivall Salongcay, None; Lizzie Anne Aquino, None; Claude Salva, None; Jennifer Sun, None; Tunde Peto, None; Lloyd Aiello, KalVista (F), KalVista (I), Novo Nordisk (F)
  • Footnotes
    Support  Newton Agham Research Grant
Investigative Ophthalmology & Visual Science June 2021, Vol.62, 1896. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Paolo S Silva, Recivall Pascual Salongcay, Lizzie Anne Aquino, Claude Salva, Jennifer K Sun, Tunde Peto, Lloyd Paul Aiello; Intergrader Agreement for Diabetic Retinopathy (DR) using Hand-Held Retinal Imaging. Invest. Ophthalmol. Vis. Sci. 2021;62(8):1896.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : To assess intergrader agreement when interpreting retinal images acquired with handheld retinal imaging devices for DR screening.

Methods : Mydriatic retinal images acquired using 3 hand-held retinal cameras [Aurora (AU), Smartscope (SS), RV700 (RV)] were compared with Early Treatment Diabetic Retinopathy Study 7-field standard photography (ETDRS photos). All handheld retinal images were independently evaluated by 2 grader-certified nonphysician staff and 1 retina specialist (RPS). The ETDRS photos were evaluated by a senior retina specialist (PSS). All graders had completed a structured certification program in DR assessment. Grading was performed using the International Classification for DR. Agreement was measured using kappa (k) statistics, multirater k across graders and sensitivity/specificity was calculated for vision threatening DR [(vtDR): severe NPDR or worse].

Results : Images from 177 eyes of 92 patients with diabetes were evaluated. Severity by ETDRS photos: no DR 40.1%, mild NPDR 19.2%, moderate 14.7%, severe 10.2%, proliferative DR 15.8%. Ungradable rate for DR was AU: 0%; SS: 4.5%; RV: 4.0%; and ETDRS: 0%. Results are presented in table 1. Multirater κ for DR severity (0.58 – 0.65) and vtDR (0.71 – 0.74) was uniform across all devices. Agreement (κ) for DR severity between ETDRS photos and graders was similar across nonphysician graders across devices (0.46 – 0.48) and highest with retina specialist evaluation across devices (0.70-0.78). Sensitivity/specificity for vtDR on ETDRS photo for nonphsician graders was over 0.95 in all devices but specificity was 0.87-0.89. Retina specialist specificity for vtDR was 0.96-0.97.

Conclusions : In assessing DR severity, substantial over-all agreement (0.58-0.74) among all graders was achieved emphasizing the benefit of a structured program of grading certification. Retinal images obtained using all 3 handheld cameras achieved the highest agreement with ETDRS photos (0.70-0.78) when evaluated by a retinal specialist. Among the nonphysician graders for all devices, sensitivity for vtDR was over 90% but specificity remained 87-89%. These findings suggest that in DR screening programs using hand-held retinal imaging, secondary grading of eyes with vtDR by more experienced graders may be necessary to minimize unnecessary referrals that would otherwise decrease the effectiveness of screening programs.

This is a 2021 ARVO Annual Meeting abstract.

 

Intergrader Agreement of Handheld Imaging w/ ETDRS photography

Intergrader Agreement of Handheld Imaging w/ ETDRS photography

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×